-- Logs begin at Mon 2022-05-30 11:22:34 UTC, end at Mon 2022-05-30 12:26:33 UTC. -- May 30 11:51:46.362314 dv-cinder-839793-13-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 30 11:51:46.371228 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 30 11:51:46.372165 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 30 11:51:46 2022] *** May 30 11:51:46.372165 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 30 11:51:46.372165 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 30 11:51:46.372165 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: nodename: dv-cinder-839793-13-iscsi May 30 11:51:46.372165 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: machine: x86_64 May 30 11:51:46.372165 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: clock source: unix May 30 11:51:46.372165 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: pcre jit disabled May 30 11:51:46.372165 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: detected number of CPU cores: 4 May 30 11:51:46.372165 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: current working directory: / May 30 11:51:46.372165 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: detected binary path: /usr/bin/uwsgi-core May 30 11:51:46.372735 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: your processes number limit is 47680 May 30 11:51:46.372735 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: your memory page size is 4096 bytes May 30 11:51:46.372735 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: detected max file descriptor number: 2048 May 30 11:51:46.372735 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: lock engine: pthread robust mutexes May 30 11:51:46.372735 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: thunder lock: enabled May 30 11:51:46.372735 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 30 11:51:46.372735 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 30 11:51:46.418130 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: Python main interpreter initialized at 0x55ea1a0e09c0 May 30 11:51:46.418130 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: python threads support enabled May 30 11:51:46.418130 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: your server socket listen backlog is limited to 100 connections May 30 11:51:46.418130 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: your mercy for graceful operations on workers is 90 seconds May 30 11:51:46.418457 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: mapped 403077 bytes (393 KB) for 2 cores May 30 11:51:46.418552 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: *** Operational MODE: preforking *** May 30 11:51:46.418831 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: *** uWSGI is running in multiple interpreter mode *** May 30 11:51:46.418831 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: spawned uWSGI master process (pid: 80179) May 30 11:51:46.419026 dv-cinder-839793-13-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 30 11:51:46.420080 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: spawned uWSGI worker 1 (pid: 80189, cores: 1) May 30 11:51:46.422635 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: spawned uWSGI worker 2 (pid: 80190, cores: 1) May 30 11:51:46.422635 dv-cinder-839793-13-iscsi devstack@keystone.service[80179]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 30 11:51:52.159733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 11:51:52.159733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: from cryptography.utils import int_from_bytes May 30 11:51:52.160514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 11:51:52.160514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: from cryptography.utils import int_from_bytes May 30 11:51:52.160629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 11:51:52.160629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: from cryptography.utils import int_from_bytes May 30 11:51:52.161043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 11:51:52.161043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: from cryptography.utils import int_from_bytes May 30 11:51:52.211318 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 30 11:51:52.211497 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 30 11:51:52.211578 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 30 11:51:52.211665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 30 11:51:52.211748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] command line args: [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 30 11:51:52.211836 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] command line args: [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 30 11:51:52.211973 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 30 11:51:52.212082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 30 11:51:52.212165 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ================================================================================ {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 30 11:51:52.212267 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ================================================================================ {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 30 11:51:52.212417 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] admin_token = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.212542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] admin_token = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.212764 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] config_dir = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.212863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] config_dir = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.212944 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.213050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.213143 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] config_source = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.213241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] config_source = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.213323 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] debug = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.213424 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] debug = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.213509 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.213722 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.213862 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.213938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.214041 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.214126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.214275 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.214353 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.214524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.214608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.214754 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.214844 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.214956 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_config_append = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.215037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] log_config_append = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.215097 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.215153 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.215279 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] log_dir = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.215369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_dir = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.215468 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_file = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.215539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] log_file = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.215686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.215771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.215958 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.216055 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.216208 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.216281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.216455 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.216543 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.216646 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.216764 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.216851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.216932 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.217045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.217147 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.217290 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.217383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.217523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.217620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.217756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.217863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.218010 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.218121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.218261 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.218375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.218480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.218612 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.218726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.218831 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.218962 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.219073 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.219404 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.41/identity {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.219524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.41/identity {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.219664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] publish_errors = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.219769 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] publish_errors = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.219913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.220058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.220162 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.220296 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.220406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.220913 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.221034 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.221246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.221324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.221428 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.221498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] standard_threads = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.221609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] standard_threads = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.221692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.221761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.221829 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.221896 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.222002 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.222078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.222153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] use_journal = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.222223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] use_journal = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.222291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] use_json = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.222364 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] use_json = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.222441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] use_stderr = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.222517 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] use_stderr = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.222586 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] use_syslog = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.222653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] use_syslog = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.222756 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.222832 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:51:52.222913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.222989 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.223057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.223124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.223197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.223305 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.223388 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.223555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.223640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.223808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.223920 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.224307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.224479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.224554 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.224629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.224705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.224774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.224842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.224921 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.225065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.225150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.225271 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.225389 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.225509 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.225639 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.225760 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.225878 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.225998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.226146 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.226290 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.226417 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.226531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.226649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.226763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.226881 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.227030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.227185 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.227304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.227423 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.227534 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.227651 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.227764 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.227946 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.228065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.228183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.228294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.228411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.228523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.228641 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.228760 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.228880 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.228991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.229108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.229220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.229338 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.229450 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.229567 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.229679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.229796 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.229983 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.230098 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.230215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.230333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.230444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.230554 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.230674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.230786 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.230897 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.231009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.231119 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.231229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.231351 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.231464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.231574 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.231684 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.231799 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.231936 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.232059 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.232182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.232294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.232405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.232516 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.232626 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.232745 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.232856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.232966 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.233077 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.233188 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.233298 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.233401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.233496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.233589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.233689 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.233782 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.233875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.233976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.234078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.234173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.234266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.234359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.234457 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.234578 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.234697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.234830 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.234953 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.235056 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.235167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.235286 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.235391 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.235500 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.235611 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.235722 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.235856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.235982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.236612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.237106 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.237224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.237224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.237445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.237565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.237687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.237791 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.237909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.238031 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.238150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.238273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.238385 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.238505 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.238618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.238720 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.238830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.238947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.239071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.239195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.239309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.239420 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.239531 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.239642 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.239764 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.239895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.240019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.240133 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.240244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.240356 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.240475 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.240594 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.240712 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.240825 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.240936 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.241048 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.241167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.241279 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.241391 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.241503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.241613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.241724 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.241906 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.242021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.242133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.242244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.242355 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.242467 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.242587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.242700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.242816 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.242928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.243045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.243158 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.243282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.243395 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.243508 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.243620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.243731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.243883 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.244011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.244133 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.244246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.244356 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.244467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.244579 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.244701 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.244823 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.244947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.245060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.245172 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.245282 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.245399 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.245512 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.245633 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.245747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.245858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.245969 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.246080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.246191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.246310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.246423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.246534 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.246652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.246765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.246884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.247004 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.247116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.247228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.247339 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.247450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.247570 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.247689 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.248082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.248195 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.external = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.248318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.external = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.248430 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.248550 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.248663 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.248803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.248926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.249041 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.249153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.password = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.249265 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.password = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.249383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.token = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.249504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.token = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.249617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.249729 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.249842 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.249953 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.250065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.250185 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.250299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.250411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.250529 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.250643 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.250754 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.250876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.250996 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.251109 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.251227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.251340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.251451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.251571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.251691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.252885 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.253019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.253134 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.253247 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.253247 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.253480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.253593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.253705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.253705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.253914 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.254036 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.254150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.254263 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.254375 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.254493 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.254607 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.254727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.254841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.254953 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.255074 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.255187 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.255299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.255418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.255532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.255643 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.255756 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.255883 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.255998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.256124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.256238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.256349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.256462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.256574 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.256686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.256872 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.256989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.257110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.257225 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.257337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.257450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.257570 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.257683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.257795 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.257911 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.258023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.258135 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.258256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.258370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.258495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.258608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.258720 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.258831 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.258954 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.259068 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.259180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.259294 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.259406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.259526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.259640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.259752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.259876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.259990 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.259990 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.260212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.260212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.260426 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.260538 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.260649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.260761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.260880 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.260880 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.261091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.261203 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.261315 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.261427 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.261547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.261547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.261764 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.261877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.261990 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.262102 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.262227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.262341 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.262455 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.262567 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.262679 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.262791 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.262912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.262912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.263122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.263234 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.263346 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.263458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.263578 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.263691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.263809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.263942 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.264055 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.264167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.264291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.264406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.264519 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.264631 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.264750 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.264863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.264983 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.265103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.265216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.265328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.265447 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.265573 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.265723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.265838 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.265957 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.266070 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.266187 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.266299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.266420 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.266532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.266645 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.266757 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.266869 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.266980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.267100 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.267214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.267325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.267436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.268044 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.268162 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.268285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.268399 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.268511 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.268624 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.268737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.268850 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.268971 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.269084 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.269197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.269309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.269421 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.269533 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.269653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.269769 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.269881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.269993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.270105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.270217 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.270337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.270457 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.270570 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.270683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.270796 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.270908 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.271029 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.271142 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.271255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.271366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.271480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.271600 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.271714 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.271856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.271972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.272097 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.272211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.272331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.272445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.272557 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.272557 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.272773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.272888 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.273008 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.273121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.273233 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.273345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.273456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.273568 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.273688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.273801 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.273914 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.274026 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.274138 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.274249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.274369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.274483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.274595 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.274706 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.274818 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.274929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.275049 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.275163 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.275275 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.275391 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.275509 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.275622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.275742 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.275906 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.276023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.276135 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.276247 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.276358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.276482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.276597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.276708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.276820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.276931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.277044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.277165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.277279 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.277391 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.277502 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.277614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.277729 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.277850 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.277964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.278076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.278188 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.278300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.278411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.278531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.278644 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.278756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.278868 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.278979 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.279097 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.279282 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.279398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.279510 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.279622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.279733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.279857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.279983 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.280097 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.280211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.280323 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.280435 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.280547 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.280666 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.280779 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.280891 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.281003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.281115 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.281243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.281393 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.281508 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.281620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.281732 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] role.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.281843 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.281955 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] role.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.282075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.282189 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.282303 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] role.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.282414 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.282526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] role.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.282638 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.282759 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.282873 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.283514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.283696 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.283937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.284148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.284285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.284402 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.284515 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.284628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.284740 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.284861 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.284974 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.285087 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.285198 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.285311 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.285423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.285543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.285658 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.285770 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.285882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.285995 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.286107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.286107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.286329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.286329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.286540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.286653 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.286765 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.286885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.286999 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.287111 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.287223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.287335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.287451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.287573 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.287687 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.287799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.287931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.288044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.288156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.288281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.288395 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.288507 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.288621 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.288733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.288845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.288970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.289084 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.289196 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.289308 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.289420 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.289539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.289654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.289767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.289878 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.289990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.290102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.290222 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.290335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.290446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.290558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] token.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.290670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.290782 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.290902 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.291016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.291127 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.291239 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.291351 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.291462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.291583 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.291696 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.291808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.291952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.292064 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.292176 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.292301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.292414 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.292526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.292638 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.292749 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.292861 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.292982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.293095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.293207 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.293318 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.293430 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.293542 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.293662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.293776 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.293890 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.294001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.294113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.294226 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.294345 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.294459 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.294571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.294682 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.connection = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.294802 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.294925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.295039 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.295152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.295272 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.connection = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.295393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.295515 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.295628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.295740 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.295865 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.295981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.296105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.296220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.296331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.296443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.296555 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.296667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.296787 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.296902 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.297015 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.297130 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.297243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.297355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.297476 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.297596 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.297710 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.297822 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.297934 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.298047 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.298232 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.298232 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.298448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.298592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.299727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.299864 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.299995 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.300112 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 30 11:51:52.300225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.300225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.300225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:51:52.300225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 30 11:51:52.327548 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.327781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.328035 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.328233 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.328472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.328704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.336558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.337291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.365986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.366216 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.366986 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.367225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.421512 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.421662 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.472002 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.472238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.473417 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.473657 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.539602 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.539762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.539942 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.540046 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.540133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.540210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.540284 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.540357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.540471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.540556 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.540687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.540770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.563793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.564057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.564657 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.565099 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.565264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.565342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.565448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.565524 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.565596 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.565662 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.565732 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.565798 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.565877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.565877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.577004 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.577343 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.589686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.589921 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.590118 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.590201 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.590352 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.590432 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.590570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.590649 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.590786 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.590866 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.590998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.591077 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.591212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.591427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:51:52.608614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.608826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 30 11:51:52.609163 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.609266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.609352 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 30 11:51:52.609427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 30 11:51:52.609626 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.609706 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.609889 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.609980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 30 11:51:52.610149 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.610231 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.610408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.610488 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.610668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.610925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.622019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.622297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.622551 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.622633 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.623083 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.623170 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.623387 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.623670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.631196 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.631839 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.634496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.634771 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.635050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.635132 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.635329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.635411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.635611 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.635691 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.635971 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.636066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.636259 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.636341 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.636534 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.636635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.636809 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.636898 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.637084 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.637164 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.637353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.637432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.637704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.637976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.664053 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.665053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.665766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.666047 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.666776 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.667057 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.671285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.671606 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.671868 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.672333 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.672614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.672895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.679874 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.680156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.680902 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.681186 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.684619 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.685021 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.685307 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.685588 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.685693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.685862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.686101 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.686181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.686385 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.686474 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.686655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.686733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.686939 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.687221 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.687494 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.687766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.705955 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.706222 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.707123 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.707405 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.710895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.712183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.714564 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.714858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.715883 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.716191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.719893 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.722029 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.724143 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.725645 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.729229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.729535 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.729832 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.730121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.730410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.730693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.730773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.731078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.731369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.731658 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.731974 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.732263 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.749880 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.750171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.750439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.750710 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.751661 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.752244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.752408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.752686 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.758796 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.760565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.760675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.760843 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.762412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.762690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.764309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.764309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.764449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.764710 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.765001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.765792 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.766066 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.766342 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.766622 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.766914 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.779076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.779368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.779656 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.779963 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.780248 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.780523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.780800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.781096 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.781380 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.781664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.781949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.782227 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.782503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.782782 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.799518 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.801841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.802806 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.805135 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.806123 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.807720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.808476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.809405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.809688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.809968 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.810080 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.811737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.812041 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.812323 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.817574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.819199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.819768 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.821429 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.822410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.822703 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.822990 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.823268 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.824647 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.824941 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.825227 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.825508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.833024 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.833310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.833694 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.835165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.835453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.835859 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.841582 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.841859 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.842138 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.842415 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.842689 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.842975 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.843252 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.843538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.843722 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:51:52.843801 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.844028 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.844120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.844313 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.844393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.844594 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.844728 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.844867 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.844946 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.845134 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.845212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.845710 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.845710 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.846210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.846481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.846756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.847030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.847323 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.847588 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:51:52.883726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ea1a0e09c0 pid: 80189 (default app) May 30 11:51:52.886158 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ea1a0e09c0 pid: 80190 (default app) May 30 11:51:52.887046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4e843-2b0f-4be2-a991-e678c0f8938e None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:51:52.887339 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4e843-2b0f-4be2-a991-e678c0f8938e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:51:52.887617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4e843-2b0f-4be2-a991-e678c0f8938e None None] PATH_INFO: `/v3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:51:52.891877 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 791 bytes} [Mon May 30 11:51:52 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:00.948840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4c14f-7db1-4ec1-be3c-826f343b00ac None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:00.949396 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4c14f-7db1-4ec1-be3c-826f343b00ac None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:00.949396 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4c14f-7db1-4ec1-be3c-826f343b00ac None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:00.953771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1/2] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:52:00.959310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb629a7-78aa-4ffd-bca6-6b36fb111c18 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:00.959735 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb629a7-78aa-4ffd-bca6-6b36fb111c18 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:00.959927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb629a7-78aa-4ffd-bca6-6b36fb111c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:01.029374 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: INFO dbcounter [None req-aeb629a7-78aa-4ffd-bca6-6b36fb111c18 None None] Registered counter for database keystone May 30 11:52:01.051696 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG oslo_db.sqlalchemy.engines [None req-aeb629a7-78aa-4ffd-bca6-6b36fb111c18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:52:01.057884 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writer thread running {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:52:01.344172 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG passlib.handlers.bcrypt [None req-aeb629a7-78aa-4ffd-bca6-6b36fb111c18 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80189) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 30 11:52:01.344506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG passlib.handlers.bcrypt [None req-aeb629a7-78aa-4ffd-bca6-6b36fb111c18 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80189) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 30 11:52:01.401473 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-aeb629a7-78aa-4ffd-bca6-6b36fb111c18 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:01.403061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-aeb629a7-78aa-4ffd-bca6-6b36fb111c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:01.528926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 2/3] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 571 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 30 11:52:01.721759 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4c14f-7db1-4ec1-be3c-826f343b00ac None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:01.791787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: INFO dbcounter [None req-b3b4c14f-7db1-4ec1-be3c-826f343b00ac None None] Registered counter for database keystone May 30 11:52:01.810894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG oslo_db.sqlalchemy.engines [None req-b3b4c14f-7db1-4ec1-be3c-826f343b00ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:52:01.817898 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writer thread running {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:52:02.044059 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4c14f-7db1-4ec1-be3c-826f343b00ac None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:02.048217 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd866d-7dd3-4976-9ab7-3c2e5c0c23d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:02.048939 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd866d-7dd3-4976-9ab7-3c2e5c0c23d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:02.049222 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd866d-7dd3-4976-9ab7-3c2e5c0c23d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:02.049499 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd866d-7dd3-4976-9ab7-3c2e5c0c23d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:02.057476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd866d-7dd3-4976-9ab7-3c2e5c0c23d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:02.108713 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: WARNING keystone.common.rbac_enforcer.enforcer [None req-dffd866d-7dd3-4976-9ab7-3c2e5c0c23d3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 30 11:52:02.109058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd866d-7dd3-4976-9ab7-3c2e5c0c23d3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:02.118953 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 2/4] 10.222.0.41 () {58 vars in 1324 bytes} [Mon May 30 11:52:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 11:52:02.125215 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb629a7-78aa-4ffd-bca6-6b36fb111c18 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:02.140111 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb629a7-78aa-4ffd-bca6-6b36fb111c18 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:02.144903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076c9b6-997e-42b8-b933-a0c45566327c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:02.146009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076c9b6-997e-42b8-b933-a0c45566327c admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:02.146312 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076c9b6-997e-42b8-b933-a0c45566327c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:02.146593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076c9b6-997e-42b8-b933-a0c45566327c admin admin] PATH_INFO: `/v3/projects/93674931dbb347aea1d901cb89aa3b24` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:02.148147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076c9b6-997e-42b8-b933-a0c45566327c admin admin] RBAC: Authorizing `identity:get_project(project_id=93674931dbb347aea1d901cb89aa3b24)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:02.200075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d076c9b6-997e-42b8-b933-a0c45566327c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 30 11:52:02.200419 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076c9b6-997e-42b8-b933-a0c45566327c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:02.205212 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 3/5] 10.222.0.41 () {56 vars in 1207 bytes} [Mon May 30 11:52:02 2022] GET /identity/v3/projects/93674931dbb347aea1d901cb89aa3b24 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:04.457169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9d5ec-c186-441b-9544-beabd37f1976 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:04.457701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9d5ec-c186-441b-9544-beabd37f1976 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:04.457805 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9d5ec-c186-441b-9544-beabd37f1976 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:04.461848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 3/6] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:52:04.467449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58e080-a457-4430-a31b-fc387e519ef0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:04.467863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58e080-a457-4430-a31b-fc387e519ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:04.468041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58e080-a457-4430-a31b-fc387e519ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:04.487128 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6c58e080-a457-4430-a31b-fc387e519ef0 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:04.488688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6c58e080-a457-4430-a31b-fc387e519ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:04.496525 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 4/7] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 30 11:52:04.519702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9d5ec-c186-441b-9544-beabd37f1976 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:04.531922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9d5ec-c186-441b-9544-beabd37f1976 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:04.536885 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825bbb9-6f33-416f-a31e-b291b5ec977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:04.537678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825bbb9-6f33-416f-a31e-b291b5ec977c admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:04.538040 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825bbb9-6f33-416f-a31e-b291b5ec977c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:04.538437 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825bbb9-6f33-416f-a31e-b291b5ec977c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:04.547358 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825bbb9-6f33-416f-a31e-b291b5ec977c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:04.549619 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825bbb9-6f33-416f-a31e-b291b5ec977c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:04.558471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 4/8] 10.222.0.41 () {58 vars in 1324 bytes} [Mon May 30 11:52:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 11:52:04.564137 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58e080-a457-4430-a31b-fc387e519ef0 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:04.573257 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58e080-a457-4430-a31b-fc387e519ef0 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:04.577630 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7568e47-0b06-47a3-aaa2-3556dae53913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:04.578489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7568e47-0b06-47a3-aaa2-3556dae53913 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:04.578772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7568e47-0b06-47a3-aaa2-3556dae53913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:04.579051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7568e47-0b06-47a3-aaa2-3556dae53913 admin admin] PATH_INFO: `/v3/users/6a1c89e7dfbe47f0b169c936907738b0` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:04.581110 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7568e47-0b06-47a3-aaa2-3556dae53913 admin admin] RBAC: Authorizing `identity:get_user(user_id=6a1c89e7dfbe47f0b169c936907738b0)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:04.582930 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7568e47-0b06-47a3-aaa2-3556dae53913 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:04.584519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 5/9] 10.222.0.41 () {56 vars in 1198 bytes} [Mon May 30 11:52:04 2022] GET /identity/v3/users/6a1c89e7dfbe47f0b169c936907738b0 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:06.866411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffce6e9-d376-40f0-9566-a57fab3f5a95 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:06.866925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffce6e9-d376-40f0-9566-a57fab3f5a95 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:06.867025 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffce6e9-d376-40f0-9566-a57fab3f5a95 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:06.868350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 5/10] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:06.873813 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a41030-3605-4746-86c5-4248cdd091a8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:06.874246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a41030-3605-4746-86c5-4248cdd091a8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:06.874380 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a41030-3605-4746-86c5-4248cdd091a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:06.891353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-09a41030-3605-4746-86c5-4248cdd091a8 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:06.892612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-09a41030-3605-4746-86c5-4248cdd091a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:06.924612 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08e4d2-c3eb-406c-aaec-c9d39dedae1c None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:06.924903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08e4d2-c3eb-406c-aaec-c9d39dedae1c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:06.925186 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08e4d2-c3eb-406c-aaec-c9d39dedae1c None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:06.926528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 6/11] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:52:06.931693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a068bce-7541-4bd1-8805-466ef8cd6d0a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:06.932022 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a068bce-7541-4bd1-8805-466ef8cd6d0a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:06.932312 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a068bce-7541-4bd1-8805-466ef8cd6d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:06.973002 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 6/12] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:06.973910 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG passlib.handlers.bcrypt [None req-2a068bce-7541-4bd1-8805-466ef8cd6d0a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80190) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 30 11:52:06.974333 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG passlib.handlers.bcrypt [None req-2a068bce-7541-4bd1-8805-466ef8cd6d0a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80190) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 30 11:52:06.996341 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a41030-3605-4746-86c5-4248cdd091a8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:07.020184 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:07.021010 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2a068bce-7541-4bd1-8805-466ef8cd6d0a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:07.022672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2a068bce-7541-4bd1-8805-466ef8cd6d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:07.100393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a41030-3605-4746-86c5-4248cdd091a8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:07.121267 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 7/13] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:52:07.134430 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a103857-4974-4c6f-ae2f-f4c761f6c603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:07.135228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a103857-4974-4c6f-ae2f-f4c761f6c603 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:07.135511 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a103857-4974-4c6f-ae2f-f4c761f6c603 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:07.135788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a103857-4974-4c6f-ae2f-f4c761f6c603 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:07.143963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a068bce-7541-4bd1-8805-466ef8cd6d0a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:07.147569 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a103857-4974-4c6f-ae2f-f4c761f6c603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:07.159840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-8a103857-4974-4c6f-ae2f-f4c761f6c603 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:52:07.159840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:07.159840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:07.159840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:07.159840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:07.159840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:07.159840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:07.159840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:07.159840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:07.159840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:07.159840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:07.159840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:07.159840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:07.159840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:07.159840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:07.159840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:07.160803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:07.160803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:07.160803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:07.160803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:07.160803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:07.160803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:07.160803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:07.160803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:07.160803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:07.160803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:07.160803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:07.160803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:07.160803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:07.160803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:07.160803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:07.160803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:07.161597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:07.161597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:07.161597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:07.161597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:07.161597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:07.161597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:07.161597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:07.161597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:07.161597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:07.161597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:07.161597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:52:07.161597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:07.161597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 7/14] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:52:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:52:07.168052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a103857-4974-4c6f-ae2f-f4c761f6c603 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:07.245805 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a068bce-7541-4bd1-8805-466ef8cd6d0a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:07.248378 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:07.250251 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:07.269683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a103857-4974-4c6f-ae2f-f4c761f6c603 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:07.284357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800a95d-f27c-4183-beb3-922a35e28521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:07.285189 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800a95d-f27c-4183-beb3-922a35e28521 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:07.285482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800a95d-f27c-4183-beb3-922a35e28521 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:07.285762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800a95d-f27c-4183-beb3-922a35e28521 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:07.305046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca6104-bb75-4d50-b99f-fd1b1c0fcc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:07.305714 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca6104-bb75-4d50-b99f-fd1b1c0fcc6e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:07.306005 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca6104-bb75-4d50-b99f-fd1b1c0fcc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:07.306286 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca6104-bb75-4d50-b99f-fd1b1c0fcc6e None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:07.307039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca6104-bb75-4d50-b99f-fd1b1c0fcc6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:07.307355 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca6104-bb75-4d50-b99f-fd1b1c0fcc6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:07.308796 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca6104-bb75-4d50-b99f-fd1b1c0fcc6e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:07.321595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 8/15] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:07.327105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca6104-bb75-4d50-b99f-fd1b1c0fcc6e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:07.356732 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800a95d-f27c-4183-beb3-922a35e28521 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:07.358262 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800a95d-f27c-4183-beb3-922a35e28521 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:07.425935 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca6104-bb75-4d50-b99f-fd1b1c0fcc6e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:07.457301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 8/16] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 30 11:52:07.461708 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513317e3-ee7b-499d-9db8-3a1e1bc3841c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:07.462589 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513317e3-ee7b-499d-9db8-3a1e1bc3841c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:07.462873 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513317e3-ee7b-499d-9db8-3a1e1bc3841c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:07.463040 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800a95d-f27c-4183-beb3-922a35e28521 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:07.463151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513317e3-ee7b-499d-9db8-3a1e1bc3841c None admin] PATH_INFO: `/v3/users/6a1c89e7dfbe47f0b169c936907738b0` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:07.464385 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513317e3-ee7b-499d-9db8-3a1e1bc3841c None admin] RBAC: Authorizing `identity:get_user(user_id=6a1c89e7dfbe47f0b169c936907738b0)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:07.466267 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:07.466384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513317e3-ee7b-499d-9db8-3a1e1bc3841c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:07.467486 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 9/17] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:07 2022] GET /identity/v3/users/6a1c89e7dfbe47f0b169c936907738b0 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:07.473238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513317e3-ee7b-499d-9db8-3a1e1bc3841c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:07.487255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:07.565651 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800a95d-f27c-4183-beb3-922a35e28521 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:07.571704 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513317e3-ee7b-499d-9db8-3a1e1bc3841c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:07.599025 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f01a35-973a-495e-ab09-578e0eb9f664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:07.599834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f01a35-973a-495e-ab09-578e0eb9f664 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:07.600121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f01a35-973a-495e-ab09-578e0eb9f664 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:07.600407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f01a35-973a-495e-ab09-578e0eb9f664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:07.605868 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f65030-5196-440a-b6ed-ae2f3f48ee72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:07.606655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f65030-5196-440a-b6ed-ae2f3f48ee72 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:07.606944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f65030-5196-440a-b6ed-ae2f3f48ee72 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:07.607226 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f65030-5196-440a-b6ed-ae2f3f48ee72 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:07.608448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f65030-5196-440a-b6ed-ae2f3f48ee72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:07.609918 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f65030-5196-440a-b6ed-ae2f3f48ee72 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:07.611582 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 10/18] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:52:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:07.617720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f65030-5196-440a-b6ed-ae2f3f48ee72 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:07.618999 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f01a35-973a-495e-ab09-578e0eb9f664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:07.620762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f01a35-973a-495e-ab09-578e0eb9f664 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:07.642736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-a9f01a35-973a-495e-ab09-578e0eb9f664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:52:07.642736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:07.642736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:07.642736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:07.642736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:07.642736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:07.642736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:07.642736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:07.642736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:07.642736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:07.642736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:07.642736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:07.642736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:52:07.642736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:52:07.642736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:52:07.643613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:52:07.643613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:07.643613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:07.643613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:07.643613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:07.643613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:07.643613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:07.643613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:07.643613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:07.643613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:07.643613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:07.643613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:07.643613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:07.643613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:07.643613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:07.643613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:07.643613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:07.644438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:52:07.644438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:52:07.644438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:52:07.644438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:07.644438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 9/19] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:52:07.649674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f01a35-973a-495e-ab09-578e0eb9f664 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:07.706822 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:07.707226 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:07.727355 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f65030-5196-440a-b6ed-ae2f3f48ee72 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:07.753950 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f01a35-973a-495e-ab09-578e0eb9f664 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:07.761051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354284ed-e80c-4514-8d2a-729c85cf7604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:07.761712 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354284ed-e80c-4514-8d2a-729c85cf7604 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:07.761998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354284ed-e80c-4514-8d2a-729c85cf7604 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:07.762277 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354284ed-e80c-4514-8d2a-729c85cf7604 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:07.763110 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354284ed-e80c-4514-8d2a-729c85cf7604 None admin] RBAC: Adding query filter params (role.id=8196ef570097443bac15d3cf39878486, scope.domain.id=default, user.id=6a1c89e7dfbe47f0b169c936907738b0) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:07.763425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354284ed-e80c-4514-8d2a-729c85cf7604 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:07.764932 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354284ed-e80c-4514-8d2a-729c85cf7604 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:07.772677 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 11/20] 10.222.0.41 () {56 vars in 1322 bytes} [Mon May 30 11:52:07 2022] GET /identity/v3/role_assignments?user.id=6a1c89e7dfbe47f0b169c936907738b0&scope.domain.id=default&role.id=8196ef570097443bac15d3cf39878486 => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:07.796013 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d8954-d1c0-4ff0-becc-1d879d9fc343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:07.796705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d8954-d1c0-4ff0-becc-1d879d9fc343 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:07.796992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d8954-d1c0-4ff0-becc-1d879d9fc343 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:07.797272 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d8954-d1c0-4ff0-becc-1d879d9fc343 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:07.798030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d8954-d1c0-4ff0-becc-1d879d9fc343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:07.798352 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d8954-d1c0-4ff0-becc-1d879d9fc343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:07.799808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d8954-d1c0-4ff0-becc-1d879d9fc343 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:07.820667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 10/21] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:10.654866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9a0ee-fd88-4de1-b43c-fd8921f07ed2 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:10.655374 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9a0ee-fd88-4de1-b43c-fd8921f07ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:10.655448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9a0ee-fd88-4de1-b43c-fd8921f07ed2 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:10.657107 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 12/22] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:10.662351 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f91a8a-84bb-4b64-b0b9-fd134d147588 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:10.663187 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f91a8a-84bb-4b64-b0b9-fd134d147588 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:10.663685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f91a8a-84bb-4b64-b0b9-fd134d147588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:10.666386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdad81-c697-41e8-b706-9efc581692ce None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:10.666900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdad81-c697-41e8-b706-9efc581692ce None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:10.667365 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdad81-c697-41e8-b706-9efc581692ce None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:10.669161 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 13/23] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:10.674473 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5baa5-ce59-4e65-8ae8-ed4069936f59 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:10.674999 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5baa5-ce59-4e65-8ae8-ed4069936f59 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:10.675470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5baa5-ce59-4e65-8ae8-ed4069936f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:10.685156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-56f91a8a-84bb-4b64-b0b9-fd134d147588 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:10.686534 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-56f91a8a-84bb-4b64-b0b9-fd134d147588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:10.700763 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b9a5baa5-ce59-4e65-8ae8-ed4069936f59 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:10.702070 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b9a5baa5-ce59-4e65-8ae8-ed4069936f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:10.829534 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 11/24] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:10.864896 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f91a8a-84bb-4b64-b0b9-fd134d147588 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:10.866325 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 14/25] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:52:10.901361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5baa5-ce59-4e65-8ae8-ed4069936f59 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:10.956927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:11.066251 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:11.083841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f91a8a-84bb-4b64-b0b9-fd134d147588 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:11.119402 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5baa5-ce59-4e65-8ae8-ed4069936f59 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:11.132950 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd5e74-7ea1-4af4-b2e2-d1d14600fa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:11.133847 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd5e74-7ea1-4af4-b2e2-d1d14600fa3a None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:11.134377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd5e74-7ea1-4af4-b2e2-d1d14600fa3a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:11.134793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd5e74-7ea1-4af4-b2e2-d1d14600fa3a None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:11.135699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd5e74-7ea1-4af4-b2e2-d1d14600fa3a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:11.137449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd5e74-7ea1-4af4-b2e2-d1d14600fa3a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:11.163237 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dacd98-6311-4d67-a77c-6972dc4fbb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:11.164358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dacd98-6311-4d67-a77c-6972dc4fbb00 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:11.164819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dacd98-6311-4d67-a77c-6972dc4fbb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:11.165254 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dacd98-6311-4d67-a77c-6972dc4fbb00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:11.177746 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dacd98-6311-4d67-a77c-6972dc4fbb00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:11.185788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-e3dacd98-6311-4d67-a77c-6972dc4fbb00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:52:11.185788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:11.185788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:11.185788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:11.185788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:11.185788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:11.185788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:11.185788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:11.185788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:11.185788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:11.185788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:11.185788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:11.185788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:11.185788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:11.185788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:11.185788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:11.186810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:11.186810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:11.186810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:11.186810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:11.186810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:11.186810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:11.186810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:11.186810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:11.186810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:11.186810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:11.186810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:11.186810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:11.186810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:11.186810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:11.186810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:11.186810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:11.187739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:11.187739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:11.187739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:11.187739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:11.187739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:11.187739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:11.187739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:11.187739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:11.187739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:11.187739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:11.187739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:52:11.187739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:11.190547 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 15/26] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:52:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:52:11.192041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1bc58-1e35-40e5-a0d8-6f4d3671b0b9 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:11.192467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1bc58-1e35-40e5-a0d8-6f4d3671b0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:11.193471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1bc58-1e35-40e5-a0d8-6f4d3671b0b9 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:11.194898 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 16/27] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:11.196389 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecee11-53f8-4746-bd61-394da2642068 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:11.196906 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecee11-53f8-4746-bd61-394da2642068 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:11.197352 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecee11-53f8-4746-bd61-394da2642068 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:11.198719 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 17/28] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:11.199596 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecee11-53f8-4746-bd61-394da2642068 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:11.278700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 12/29] 10.222.0.41 () {60 vars in 1131 bytes} [Mon May 30 11:52:10 2022] POST /identity/v3/roles => generated 219 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:52:11.280716 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e117b-0d63-49fe-884d-fe725483128a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:11.281256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e117b-0d63-49fe-884d-fe725483128a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:11.281746 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e117b-0d63-49fe-884d-fe725483128a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:11.302749 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1c1e117b-0d63-49fe-884d-fe725483128a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:11.304752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1c1e117b-0d63-49fe-884d-fe725483128a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:11.332658 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecee11-53f8-4746-bd61-394da2642068 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:11.380317 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb12f2-1dc5-497b-8484-c81ce208f0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:11.381007 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb12f2-1dc5-497b-8484-c81ce208f0ed None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:11.381294 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb12f2-1dc5-497b-8484-c81ce208f0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:11.381574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb12f2-1dc5-497b-8484-c81ce208f0ed None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:11.382341 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb12f2-1dc5-497b-8484-c81ce208f0ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:11.382653 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb12f2-1dc5-497b-8484-c81ce208f0ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:11.384343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb12f2-1dc5-497b-8484-c81ce208f0ed None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:11.385508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 13/30] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:11.385919 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:11.387354 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0f518-4eaa-4ca1-bebe-5df2e1eac6ac None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:11.387888 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0f518-4eaa-4ca1-bebe-5df2e1eac6ac None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:11.388406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0f518-4eaa-4ca1-bebe-5df2e1eac6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:11.395031 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 18/31] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:11.400623 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb12f2-1dc5-497b-8484-c81ce208f0ed None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:11.416410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-76b0f518-4eaa-4ca1-bebe-5df2e1eac6ac None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:11.418154 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-76b0f518-4eaa-4ca1-bebe-5df2e1eac6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:11.515931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:11.523495 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb12f2-1dc5-497b-8484-c81ce208f0ed None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:11.565092 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48accff9-72a4-40f3-9eee-fc147e587ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:11.566266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48accff9-72a4-40f3-9eee-fc147e587ecf None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:11.566562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48accff9-72a4-40f3-9eee-fc147e587ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:11.566998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48accff9-72a4-40f3-9eee-fc147e587ecf None admin] PATH_INFO: `/v3/users/6a1c89e7dfbe47f0b169c936907738b0` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:11.569397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48accff9-72a4-40f3-9eee-fc147e587ecf None admin] RBAC: Authorizing `identity:get_user(user_id=6a1c89e7dfbe47f0b169c936907738b0)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:11.569753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48accff9-72a4-40f3-9eee-fc147e587ecf None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:11.571775 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 19/32] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:11 2022] GET /identity/v3/users/6a1c89e7dfbe47f0b169c936907738b0 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:11.572356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48accff9-72a4-40f3-9eee-fc147e587ecf None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:11.610029 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 14/33] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:11.612230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0f518-4eaa-4ca1-bebe-5df2e1eac6ac None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:11.643036 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:11.686756 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48accff9-72a4-40f3-9eee-fc147e587ecf None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:11.723198 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9d70-6f99-4c6b-aeb2-ab4f21b6d9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:11.724038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9d70-6f99-4c6b-aeb2-ab4f21b6d9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:11.724325 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9d70-6f99-4c6b-aeb2-ab4f21b6d9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:11.724604 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9d70-6f99-4c6b-aeb2-ab4f21b6d9c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:11.736915 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a9d70-6f99-4c6b-aeb2-ab4f21b6d9c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:11.738413 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a9d70-6f99-4c6b-aeb2-ab4f21b6d9c7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:11.741466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0f518-4eaa-4ca1-bebe-5df2e1eac6ac None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:11.758191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-084a9d70-6f99-4c6b-aeb2-ab4f21b6d9c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:52:11.758191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:11.758191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:11.758191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:11.758191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:11.758191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:11.758191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:11.758191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:11.758191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:11.758191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:11.758191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:11.758191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:11.758191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:52:11.758191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:52:11.758191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:52:11.759040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:52:11.759040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:11.759040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:11.759040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:11.759040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:11.759040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:11.759040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:11.759040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:11.759040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:11.759040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:11.759040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:11.759040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:11.759040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:11.759040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:11.759040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:11.759040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:11.759040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:11.759853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:52:11.759853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:52:11.759853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:52:11.759853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:11.759853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 20/34] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:11.760635 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9d70-6f99-4c6b-aeb2-ab4f21b6d9c7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:11.786866 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f92f8-e1e7-49d4-8fd0-7aa5ccbcf4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:11.788158 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f92f8-e1e7-49d4-8fd0-7aa5ccbcf4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:11.788706 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f92f8-e1e7-49d4-8fd0-7aa5ccbcf4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:11.789181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f92f8-e1e7-49d4-8fd0-7aa5ccbcf4f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:11.790983 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f92f8-e1e7-49d4-8fd0-7aa5ccbcf4f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:11.793037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f92f8-e1e7-49d4-8fd0-7aa5ccbcf4f0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:11.795439 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 15/35] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:52:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:11.796546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f92f8-e1e7-49d4-8fd0-7aa5ccbcf4f0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:11.839966 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:11.873278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9d70-6f99-4c6b-aeb2-ab4f21b6d9c7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:11.891160 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:11.915678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c2c37-1ac5-4e13-a2f3-9bae205fd38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:11.916407 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c2c37-1ac5-4e13-a2f3-9bae205fd38e None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:11.916698 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c2c37-1ac5-4e13-a2f3-9bae205fd38e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:11.916980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c2c37-1ac5-4e13-a2f3-9bae205fd38e None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:11.917765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c2c37-1ac5-4e13-a2f3-9bae205fd38e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:11.919217 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c2c37-1ac5-4e13-a2f3-9bae205fd38e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:11.920135 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f92f8-e1e7-49d4-8fd0-7aa5ccbcf4f0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:11.960692 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18ebf4-02de-494b-9d10-b89ba7a3e769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:11.961367 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18ebf4-02de-494b-9d10-b89ba7a3e769 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:11.961660 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18ebf4-02de-494b-9d10-b89ba7a3e769 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:11.962001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18ebf4-02de-494b-9d10-b89ba7a3e769 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:11.962737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18ebf4-02de-494b-9d10-b89ba7a3e769 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:11.963057 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18ebf4-02de-494b-9d10-b89ba7a3e769 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:11.964492 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18ebf4-02de-494b-9d10-b89ba7a3e769 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:11.980788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 16/36] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:11.980788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e8823-297f-46ea-92f4-a79cbf88369f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:11.980788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e8823-297f-46ea-92f4-a79cbf88369f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:11.980788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e8823-297f-46ea-92f4-a79cbf88369f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:11.980788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 17/37] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:11.980788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e8823-297f-46ea-92f4-a79cbf88369f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:12.044298 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 21/38] 10.222.0.41 () {60 vars in 1131 bytes} [Mon May 30 11:52:11 2022] POST /identity/v3/roles => generated 225 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:52:12.045410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c2c37-1ac5-4e13-a2f3-9bae205fd38e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:12.103754 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:12.115658 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e8823-297f-46ea-92f4-a79cbf88369f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:12.157189 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145c318-a1fd-4644-accd-f9f6b45c1a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:12.158542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145c318-a1fd-4644-accd-f9f6b45c1a56 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:12.159030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145c318-a1fd-4644-accd-f9f6b45c1a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:12.159549 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145c318-a1fd-4644-accd-f9f6b45c1a56 None admin] PATH_INFO: `/v3/domains/default/users/6a1c89e7dfbe47f0b169c936907738b0/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:12.162228 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145c318-a1fd-4644-accd-f9f6b45c1a56 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6a1c89e7dfbe47f0b169c936907738b0, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:12.164117 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145c318-a1fd-4644-accd-f9f6b45c1a56 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:12.191898 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 18/39] 10.222.0.41 () {58 vars in 1361 bytes} [Mon May 30 11:52:11 2022] PUT /identity/v3/domains/default/users/6a1c89e7dfbe47f0b169c936907738b0/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:52:12.193645 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217e162-6475-440e-96ec-e20729e62632 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:12.194177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217e162-6475-440e-96ec-e20729e62632 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:12.194710 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217e162-6475-440e-96ec-e20729e62632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:12.202265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c2c37-1ac5-4e13-a2f3-9bae205fd38e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:12.230845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6217e162-6475-440e-96ec-e20729e62632 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:12.232221 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6217e162-6475-440e-96ec-e20729e62632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:12.268228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d7d02-9355-43f2-9532-49695c358f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:12.269500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d7d02-9355-43f2-9532-49695c358f1c None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:12.269987 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d7d02-9355-43f2-9532-49695c358f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:12.270591 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d7d02-9355-43f2-9532-49695c358f1c None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:12.271725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d7d02-9355-43f2-9532-49695c358f1c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:12.273669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d7d02-9355-43f2-9532-49695c358f1c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:12.316210 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 22/40] 10.222.0.41 () {60 vars in 1141 bytes} [Mon May 30 11:52:12 2022] POST /identity/v3/projects => generated 301 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:52:12.318012 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b7e40-0874-46b0-840d-e1d310197d57 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:12.319197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b7e40-0874-46b0-840d-e1d310197d57 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:12.319577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b7e40-0874-46b0-840d-e1d310197d57 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:12.321203 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 23/41] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:12.325369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 19/42] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:12.330627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076fd14-03ee-4028-b37c-cdbf16513f14 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:12.331016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076fd14-03ee-4028-b37c-cdbf16513f14 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:12.331377 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076fd14-03ee-4028-b37c-cdbf16513f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:12.351616 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217e162-6475-440e-96ec-e20729e62632 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:12.353038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7076fd14-03ee-4028-b37c-cdbf16513f14 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:12.354932 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7076fd14-03ee-4028-b37c-cdbf16513f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:12.386832 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:12.442083 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 24/43] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:12.458392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:12.468993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076fd14-03ee-4028-b37c-cdbf16513f14 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:12.483524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217e162-6475-440e-96ec-e20729e62632 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:12.526972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a2889-ffb6-4a40-8cae-97c947f0ba7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:12.528060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a2889-ffb6-4a40-8cae-97c947f0ba7d None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:12.528521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a2889-ffb6-4a40-8cae-97c947f0ba7d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:12.528823 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a2889-ffb6-4a40-8cae-97c947f0ba7d None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:12.530063 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a2889-ffb6-4a40-8cae-97c947f0ba7d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:12.531504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a2889-ffb6-4a40-8cae-97c947f0ba7d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:12.556763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 20/44] 10.222.0.41 () {60 vars in 1131 bytes} [Mon May 30 11:52:12 2022] POST /identity/v3/roles => generated 223 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:52:12.613973 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076fd14-03ee-4028-b37c-cdbf16513f14 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:12.657420 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce27fed-189f-4de2-8dc2-106498cb74e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:12.659192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce27fed-189f-4de2-8dc2-106498cb74e7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:12.659693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce27fed-189f-4de2-8dc2-106498cb74e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:12.660217 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce27fed-189f-4de2-8dc2-106498cb74e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:12.661876 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce27fed-189f-4de2-8dc2-106498cb74e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:12.663730 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce27fed-189f-4de2-8dc2-106498cb74e7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:12.665866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 25/45] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:52:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:12.671954 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a2889-ffb6-4a40-8cae-97c947f0ba7d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:12.789331 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a2889-ffb6-4a40-8cae-97c947f0ba7d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:12.823720 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dda7ab-fe5d-4abc-860d-39c1339ce5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:12.824414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dda7ab-fe5d-4abc-860d-39c1339ce5e2 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:12.824700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dda7ab-fe5d-4abc-860d-39c1339ce5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:12.824979 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dda7ab-fe5d-4abc-860d-39c1339ce5e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:12.825695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dda7ab-fe5d-4abc-860d-39c1339ce5e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:12.827162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dda7ab-fe5d-4abc-860d-39c1339ce5e2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:12.844676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:12.857831 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 21/46] 10.222.0.41 () {60 vars in 1141 bytes} [Mon May 30 11:52:12 2022] POST /identity/v3/projects => generated 312 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:52:14.609502 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eae9a5-51eb-4cbc-ab9e-71214a1c25c9 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:14.610044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eae9a5-51eb-4cbc-ab9e-71214a1c25c9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:14.610044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eae9a5-51eb-4cbc-ab9e-71214a1c25c9 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:14.612050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 26/47] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:14.617327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d551b-922f-43a4-b2de-0bf6379b627b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:14.617714 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d551b-922f-43a4-b2de-0bf6379b627b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:14.617900 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d551b-922f-43a4-b2de-0bf6379b627b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:14.634577 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-122d551b-922f-43a4-b2de-0bf6379b627b None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:14.635775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-122d551b-922f-43a4-b2de-0bf6379b627b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:14.701613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 22/48] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:14.725032 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eae9a5-51eb-4cbc-ab9e-71214a1c25c9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:14.753473 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:14.834157 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eae9a5-51eb-4cbc-ab9e-71214a1c25c9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:14.868276 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff5d12-0d22-4265-8bab-d3891be879c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:14.868998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff5d12-0d22-4265-8bab-d3891be879c0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:14.869286 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff5d12-0d22-4265-8bab-d3891be879c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:14.869568 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff5d12-0d22-4265-8bab-d3891be879c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:14.880068 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff5d12-0d22-4265-8bab-d3891be879c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:14.887618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-dfff5d12-0d22-4265-8bab-d3891be879c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:52:14.887618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:14.887618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:14.887618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:14.887618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:14.887618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:14.887618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:14.887618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:14.887618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:14.887618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:14.887618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:14.887618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:14.887618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:14.887618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:14.887618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:14.887618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:14.888460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:14.888460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:14.888460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:14.888460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:14.888460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:14.888460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:14.888460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:14.888460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:14.888460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:14.888460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:14.888460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:14.888460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:14.888460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:14.888460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:14.888460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:14.888460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:14.889425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:14.889425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:14.889425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:14.889425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:14.889425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:14.889425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:14.889425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:14.889425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:14.889425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:14.889425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:14.889425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:52:14.889425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:14.889425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 27/49] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:52:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:14.895210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d551b-922f-43a4-b2de-0bf6379b627b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:14.994485 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d551b-922f-43a4-b2de-0bf6379b627b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:15.020498 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:15.029174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a260431-78d2-4577-b5cd-6b7de59c9699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:15.029850 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a260431-78d2-4577-b5cd-6b7de59c9699 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:15.030144 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a260431-78d2-4577-b5cd-6b7de59c9699 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:15.030431 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a260431-78d2-4577-b5cd-6b7de59c9699 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:15.031190 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a260431-78d2-4577-b5cd-6b7de59c9699 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:15.031504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a260431-78d2-4577-b5cd-6b7de59c9699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:15.033769 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a260431-78d2-4577-b5cd-6b7de59c9699 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:15.045202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 23/50] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:15.051214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff5d12-0d22-4265-8bab-d3891be879c0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:15.099727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ee69c-c55d-4eae-86ee-fd56d524bf21 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:15.100048 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ee69c-c55d-4eae-86ee-fd56d524bf21 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:15.100336 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ee69c-c55d-4eae-86ee-fd56d524bf21 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:15.101699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 24/51] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:52:15.106526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63621b4-dde2-493e-86b6-65f0449f7eba None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:15.106824 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63621b4-dde2-493e-86b6-65f0449f7eba None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:15.107106 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63621b4-dde2-493e-86b6-65f0449f7eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:15.123904 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d63621b4-dde2-493e-86b6-65f0449f7eba None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:15.125021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d63621b4-dde2-493e-86b6-65f0449f7eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:15.136823 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:15.152980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff5d12-0d22-4265-8bab-d3891be879c0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:15.187076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2a5ce-8427-49bf-81a5-c2531efd1c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:15.187980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2a5ce-8427-49bf-81a5-c2531efd1c9d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:15.188267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2a5ce-8427-49bf-81a5-c2531efd1c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:15.189090 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2a5ce-8427-49bf-81a5-c2531efd1c9d None admin] PATH_INFO: `/v3/users/6a1c89e7dfbe47f0b169c936907738b0` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:15.190759 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2a5ce-8427-49bf-81a5-c2531efd1c9d None admin] RBAC: Authorizing `identity:get_user(user_id=6a1c89e7dfbe47f0b169c936907738b0)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:15.192270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2a5ce-8427-49bf-81a5-c2531efd1c9d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:15.193335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 25/52] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:15.193872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 28/53] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:15 2022] GET /identity/v3/users/6a1c89e7dfbe47f0b169c936907738b0 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:15.199175 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63621b4-dde2-493e-86b6-65f0449f7eba None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:15.216634 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2a5ce-8427-49bf-81a5-c2531efd1c9d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:15.300084 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63621b4-dde2-493e-86b6-65f0449f7eba None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:15.317539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2a5ce-8427-49bf-81a5-c2531efd1c9d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:15.318319 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:15.336508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc4f75-6990-49ce-8b93-201cae9e1961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:15.337307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc4f75-6990-49ce-8b93-201cae9e1961 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:15.337593 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc4f75-6990-49ce-8b93-201cae9e1961 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:15.337880 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc4f75-6990-49ce-8b93-201cae9e1961 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:15.339068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc4f75-6990-49ce-8b93-201cae9e1961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:15.340570 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc4f75-6990-49ce-8b93-201cae9e1961 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:15.342172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 26/54] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:52:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:15.348808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc4f75-6990-49ce-8b93-201cae9e1961 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:15.354108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf5939-d69d-46bb-8c24-8a69da2903c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:15.354913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf5939-d69d-46bb-8c24-8a69da2903c8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:15.355207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf5939-d69d-46bb-8c24-8a69da2903c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:15.355490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf5939-d69d-46bb-8c24-8a69da2903c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:15.356711 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf5939-d69d-46bb-8c24-8a69da2903c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:15.358164 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf5939-d69d-46bb-8c24-8a69da2903c8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:15.359777 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 29/55] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:52:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:15.365435 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf5939-d69d-46bb-8c24-8a69da2903c8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:15.390105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:15.449804 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc4f75-6990-49ce-8b93-201cae9e1961 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:15.476979 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf5939-d69d-46bb-8c24-8a69da2903c8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:15.487895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3fa1a-d5e5-4bc3-9915-03a6df2c8c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:15.488564 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3fa1a-d5e5-4bc3-9915-03a6df2c8c4b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:15.488853 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3fa1a-d5e5-4bc3-9915-03a6df2c8c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:15.489163 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3fa1a-d5e5-4bc3-9915-03a6df2c8c4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:15.490010 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3fa1a-d5e5-4bc3-9915-03a6df2c8c4b None admin] RBAC: Adding query filter params (role.id=8196ef570097443bac15d3cf39878486, scope.domain.id=default, user.id=6a1c89e7dfbe47f0b169c936907738b0) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:15.490332 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3fa1a-d5e5-4bc3-9915-03a6df2c8c4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:15.491802 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3fa1a-d5e5-4bc3-9915-03a6df2c8c4b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:15.500032 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 27/56] 10.222.0.41 () {56 vars in 1322 bytes} [Mon May 30 11:52:15 2022] GET /identity/v3/role_assignments?user.id=6a1c89e7dfbe47f0b169c936907738b0&scope.domain.id=default&role.id=8196ef570097443bac15d3cf39878486 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:15.512095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c80d4-7c4f-4b0c-91d2-3a3dd20dc217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:15.512793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c80d4-7c4f-4b0c-91d2-3a3dd20dc217 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:15.513087 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c80d4-7c4f-4b0c-91d2-3a3dd20dc217 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:15.513376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c80d4-7c4f-4b0c-91d2-3a3dd20dc217 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:15.514118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c80d4-7c4f-4b0c-91d2-3a3dd20dc217 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:15.515618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c80d4-7c4f-4b0c-91d2-3a3dd20dc217 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:15.544737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 30/57] 10.222.0.41 () {60 vars in 1140 bytes} [Mon May 30 11:52:15 2022] POST /identity/v3/projects => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:52:17.859212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a598ccb-c2cf-4b96-86cd-a873df36ca0e None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:17.859690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a598ccb-c2cf-4b96-86cd-a873df36ca0e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:17.859798 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a598ccb-c2cf-4b96-86cd-a873df36ca0e None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:17.861674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 28/58] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:17.866792 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392ceb7-2ed8-4dd4-b3f4-fed6c322f132 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:17.867218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392ceb7-2ed8-4dd4-b3f4-fed6c322f132 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:17.867371 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392ceb7-2ed8-4dd4-b3f4-fed6c322f132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:17.884898 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7392ceb7-2ed8-4dd4-b3f4-fed6c322f132 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:17.886105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7392ceb7-2ed8-4dd4-b3f4-fed6c322f132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:17.951108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 31/59] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:17.975524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a598ccb-c2cf-4b96-86cd-a873df36ca0e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:18.025918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:18.076290 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a598ccb-c2cf-4b96-86cd-a873df36ca0e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:18.107655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d978942-afb5-4100-8742-674d8f5bb0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:18.108466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d978942-afb5-4100-8742-674d8f5bb0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:18.108754 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d978942-afb5-4100-8742-674d8f5bb0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:18.109034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d978942-afb5-4100-8742-674d8f5bb0a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:18.110221 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d978942-afb5-4100-8742-674d8f5bb0a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:18.112304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d978942-afb5-4100-8742-674d8f5bb0a9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:18.113885 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 29/60] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:52:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:18.119321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392ceb7-2ed8-4dd4-b3f4-fed6c322f132 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:18.122647 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:18.216865 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392ceb7-2ed8-4dd4-b3f4-fed6c322f132 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:18.250010 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8936f-3ee4-498a-920f-d0cef2972190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:18.250677 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8936f-3ee4-498a-920f-d0cef2972190 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:18.251506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8936f-3ee4-498a-920f-d0cef2972190 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:18.251793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8936f-3ee4-498a-920f-d0cef2972190 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:18.252543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8936f-3ee4-498a-920f-d0cef2972190 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:18.254004 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8936f-3ee4-498a-920f-d0cef2972190 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:18.278625 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 32/61] 10.222.0.41 () {60 vars in 1132 bytes} [Mon May 30 11:52:18 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:52:21.734067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f354d3-2d6c-4113-9467-97fe00c9bfbc None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:21.734067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f354d3-2d6c-4113-9467-97fe00c9bfbc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:21.734067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f354d3-2d6c-4113-9467-97fe00c9bfbc None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:21.734067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 30/62] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:21.741178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864a226-a706-484f-8eb2-eebd2027e4b6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:21.742027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864a226-a706-484f-8eb2-eebd2027e4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:21.742503 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864a226-a706-484f-8eb2-eebd2027e4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:21.771140 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9864a226-a706-484f-8eb2-eebd2027e4b6 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:21.773324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9864a226-a706-484f-8eb2-eebd2027e4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:21.858451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:21.879581 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 33/63] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:52:21.916463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f354d3-2d6c-4113-9467-97fe00c9bfbc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:21.993563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7d946-df88-4fc3-ac1d-7bd1e3545431 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:21.993771 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7d946-df88-4fc3-ac1d-7bd1e3545431 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:21.994506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7d946-df88-4fc3-ac1d-7bd1e3545431 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:21.996555 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 34/64] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:22.005595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5474690-4331-4093-98dd-47604150c262 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:22.006999 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5474690-4331-4093-98dd-47604150c262 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:22.007523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5474690-4331-4093-98dd-47604150c262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:22.055841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e5474690-4331-4093-98dd-47604150c262 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:22.056826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e5474690-4331-4093-98dd-47604150c262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:22.106508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f354d3-2d6c-4113-9467-97fe00c9bfbc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:22.142426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:22.171957 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821306a-32e7-419e-9350-f3a6bb06a5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:22.173233 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821306a-32e7-419e-9350-f3a6bb06a5fe None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:22.174054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821306a-32e7-419e-9350-f3a6bb06a5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:22.175063 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821306a-32e7-419e-9350-f3a6bb06a5fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:22.180416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 35/65] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:22.182017 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d724459-6b26-498c-9390-1e4318597d62 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:22.182682 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d724459-6b26-498c-9390-1e4318597d62 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:22.183143 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d724459-6b26-498c-9390-1e4318597d62 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:22.184592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 36/66] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:22.199386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8fda3-b9b2-4806-884c-249b61b66c27 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:22.199902 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8fda3-b9b2-4806-884c-249b61b66c27 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:22.200347 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8fda3-b9b2-4806-884c-249b61b66c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:22.217349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821306a-32e7-419e-9350-f3a6bb06a5fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:22.227114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-2821306a-32e7-419e-9350-f3a6bb06a5fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:52:22.227114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:22.227114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:22.227114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:22.227114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:22.227114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:22.227114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:22.227114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:22.227114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:22.227114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:22.227114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:22.227114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:22.227114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:22.227114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:22.227114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:22.227114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:22.227998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:22.227998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:22.227998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:22.227998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:22.227998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:22.227998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:22.227998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:22.227998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:22.227998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:22.227998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:22.227998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:22.227998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:22.227998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:22.227998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:22.227998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:22.227998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:22.228743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:22.228743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:22.228743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:22.228743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:22.228743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:22.228743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:22.228743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:22.228743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:22.228743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:22.228743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:22.228743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:52:22.228743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:22.236388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 31/67] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:52:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:22.237723 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d6a8fda3-b9b2-4806-884c-249b61b66c27 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:22.238714 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821306a-32e7-419e-9350-f3a6bb06a5fe None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:22.240109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d6a8fda3-b9b2-4806-884c-249b61b66c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:22.326490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 37/68] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:22.327253 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8fda3-b9b2-4806-884c-249b61b66c27 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:22.358982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821306a-32e7-419e-9350-f3a6bb06a5fe None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:22.378317 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:22.394148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0836b-83ca-473d-8891-6afad472788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:22.394952 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0836b-83ca-473d-8891-6afad472788c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:22.395239 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0836b-83ca-473d-8891-6afad472788c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:22.395519 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0836b-83ca-473d-8891-6afad472788c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:22.407165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0836b-83ca-473d-8891-6afad472788c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:22.415157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-dbe0836b-83ca-473d-8891-6afad472788c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:22.415157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:22.415157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:22.415157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:22.415157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:22.415157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:22.415157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:22.415157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:22.415157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:22.415157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:22.415157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:22.415157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:22.415157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:22.415157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:22.415157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:22.415157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:22.416052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:22.416052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:22.416052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:22.416052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:22.416052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:22.416052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:22.416052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:22.416052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:22.416052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:22.416052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:22.416052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:22.416052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:22.416052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:22.416052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:22.416052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:22.416052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:22.416848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:22.416848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:22.416848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:22.416848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:22.416848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:22.416848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:22.416848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:22.416848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:22.416848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:22.416848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:22.416848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:22.416848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:22.416848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 32/69] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:22.417569 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95aff0-a56a-436f-9e29-bd00b5a7483d None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:22.417861 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95aff0-a56a-436f-9e29-bd00b5a7483d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:22.418144 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95aff0-a56a-436f-9e29-bd00b5a7483d None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:22.419407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 33/70] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:22.425080 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1588c5-f568-4d6d-82f1-b32ed67ee3fd None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:22.425374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1588c5-f568-4d6d-82f1-b32ed67ee3fd None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:22.425658 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1588c5-f568-4d6d-82f1-b32ed67ee3fd None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:22.426910 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 34/71] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:22.427618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1588c5-f568-4d6d-82f1-b32ed67ee3fd None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:22.428304 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8fda3-b9b2-4806-884c-249b61b66c27 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:22.464851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566cf5b-fe3f-47e0-943c-c7054ca5107f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:22.465628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566cf5b-fe3f-47e0-943c-c7054ca5107f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:22.465917 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566cf5b-fe3f-47e0-943c-c7054ca5107f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:22.466195 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566cf5b-fe3f-47e0-943c-c7054ca5107f None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:22.466946 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566cf5b-fe3f-47e0-943c-c7054ca5107f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:22.467256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566cf5b-fe3f-47e0-943c-c7054ca5107f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:22.468681 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566cf5b-fe3f-47e0-943c-c7054ca5107f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:22.470146 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:22.477954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 38/72] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:22.478565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566cf5b-fe3f-47e0-943c-c7054ca5107f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:22.535854 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1588c5-f568-4d6d-82f1-b32ed67ee3fd None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:22.569502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a545c-fd62-4bf4-a860-a73c497221cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:22.570291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a545c-fd62-4bf4-a860-a73c497221cf None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:22.570577 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a545c-fd62-4bf4-a860-a73c497221cf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:22.570845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a545c-fd62-4bf4-a860-a73c497221cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:22.572037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a545c-fd62-4bf4-a860-a73c497221cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:22.573479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a545c-fd62-4bf4-a860-a73c497221cf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:22.575067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 35/73] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:52:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:22.576031 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566cf5b-fe3f-47e0-943c-c7054ca5107f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:22.576221 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681419ef-ac63-42c1-86b9-f482a6060d8e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:22.576557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681419ef-ac63-42c1-86b9-f482a6060d8e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:22.576787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681419ef-ac63-42c1-86b9-f482a6060d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:22.592483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-681419ef-ac63-42c1-86b9-f482a6060d8e None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:22.592657 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:22.593732 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-681419ef-ac63-42c1-86b9-f482a6060d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:22.616008 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f89767-7903-402e-9c3a-68c84af99c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:22.616684 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f89767-7903-402e-9c3a-68c84af99c75 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:22.616973 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f89767-7903-402e-9c3a-68c84af99c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:22.617263 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f89767-7903-402e-9c3a-68c84af99c75 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:22.618014 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f89767-7903-402e-9c3a-68c84af99c75 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:22.618327 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f89767-7903-402e-9c3a-68c84af99c75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:22.619709 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f89767-7903-402e-9c3a-68c84af99c75 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:22.628583 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 39/74] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:22.629826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbb19a-7043-4997-88bc-1b12d3e36c57 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:22.630124 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbb19a-7043-4997-88bc-1b12d3e36c57 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:22.630406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbb19a-7043-4997-88bc-1b12d3e36c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:22.646354 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-22fbb19a-7043-4997-88bc-1b12d3e36c57 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:22.647543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-22fbb19a-7043-4997-88bc-1b12d3e36c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:22.664306 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 36/75] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:22.665140 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681419ef-ac63-42c1-86b9-f482a6060d8e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:22.700202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:22.715044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 40/76] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:22.715899 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbb19a-7043-4997-88bc-1b12d3e36c57 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:22.766183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681419ef-ac63-42c1-86b9-f482a6060d8e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:22.802584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff06bb-d758-4894-b30d-aac238fa7806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:22.803458 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff06bb-d758-4894-b30d-aac238fa7806 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:22.803742 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff06bb-d758-4894-b30d-aac238fa7806 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:22.804060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff06bb-d758-4894-b30d-aac238fa7806 None admin] PATH_INFO: `/v3/users/6a1c89e7dfbe47f0b169c936907738b0` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:22.805254 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff06bb-d758-4894-b30d-aac238fa7806 None admin] RBAC: Authorizing `identity:get_user(user_id=6a1c89e7dfbe47f0b169c936907738b0)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:22.806706 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff06bb-d758-4894-b30d-aac238fa7806 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:22.808318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 37/77] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:22 2022] GET /identity/v3/users/6a1c89e7dfbe47f0b169c936907738b0 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:22.809069 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff06bb-d758-4894-b30d-aac238fa7806 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:22.822153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbb19a-7043-4997-88bc-1b12d3e36c57 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:22.824789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:22.857883 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e9e73-522f-44b4-8e48-a4440e4e989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:22.858489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e9e73-522f-44b4-8e48-a4440e4e989f None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:22.858780 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e9e73-522f-44b4-8e48-a4440e4e989f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:22.859068 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e9e73-522f-44b4-8e48-a4440e4e989f None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:22.859777 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e9e73-522f-44b4-8e48-a4440e4e989f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:22.862124 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e9e73-522f-44b4-8e48-a4440e4e989f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:22.883688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 41/78] 10.222.0.41 () {60 vars in 1132 bytes} [Mon May 30 11:52:22 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:52:22.884529 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e9e73-522f-44b4-8e48-a4440e4e989f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:22.915019 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff06bb-d758-4894-b30d-aac238fa7806 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:22.919122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:22.958946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdc0b3-c7a5-4da1-81fc-0c9cdb2f6b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:22.959863 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdc0b3-c7a5-4da1-81fc-0c9cdb2f6b0f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:22.960148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdc0b3-c7a5-4da1-81fc-0c9cdb2f6b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:22.960425 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdc0b3-c7a5-4da1-81fc-0c9cdb2f6b0f None admin] PATH_INFO: `/v3/users/025f07f81f754e028089307575d89269` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:22.979847 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdc0b3-c7a5-4da1-81fc-0c9cdb2f6b0f None admin] RBAC: Authorizing `identity:get_user(user_id=025f07f81f754e028089307575d89269)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:22.981342 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdc0b3-c7a5-4da1-81fc-0c9cdb2f6b0f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:22.988311 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 38/79] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:22 2022] GET /identity/v3/users/025f07f81f754e028089307575d89269 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:22.988311 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdc0b3-c7a5-4da1-81fc-0c9cdb2f6b0f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:23.014376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e9e73-522f-44b4-8e48-a4440e4e989f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:23.052143 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55a18e-fe62-46c2-ac62-81db2405e305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:23.053006 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55a18e-fe62-46c2-ac62-81db2405e305 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:23.053306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55a18e-fe62-46c2-ac62-81db2405e305 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:23.053596 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55a18e-fe62-46c2-ac62-81db2405e305 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:23.065791 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55a18e-fe62-46c2-ac62-81db2405e305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:23.073727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-8f55a18e-fe62-46c2-ac62-81db2405e305 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:23.073727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:23.073727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:23.073727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:23.073727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:23.073727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:23.073727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:23.073727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:23.073727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:23.073727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:23.073727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:23.073727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:23.073727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:23.073727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:23.073727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:23.073727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:23.074760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:23.074760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:23.074760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:23.074760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:23.074760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:23.074760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:23.074760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:23.074760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:23.074760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:23.074760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:23.074760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:23.074760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:23.074760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:23.074760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:23.074760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:23.074760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:23.075552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:23.075552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:23.075552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:23.075552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:23.075552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:23.075552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:23.075552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:23.075552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:23.075552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:23.075552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:23.075552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:23.075552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:23.075552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 42/80] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:23.076314 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55a18e-fe62-46c2-ac62-81db2405e305 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:23.103968 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:23.112460 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdc0b3-c7a5-4da1-81fc-0c9cdb2f6b0f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:23.152451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d193cd-6057-4e35-a63d-38994518c4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:23.153275 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d193cd-6057-4e35-a63d-38994518c4bd None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:23.153754 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d193cd-6057-4e35-a63d-38994518c4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:23.153882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d193cd-6057-4e35-a63d-38994518c4bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:23.170175 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d193cd-6057-4e35-a63d-38994518c4bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:23.179081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-c5d193cd-6057-4e35-a63d-38994518c4bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:52:23.179081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:23.179081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:23.179081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:23.179081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:23.179081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:23.179081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:23.179081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:23.179081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:23.179081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:23.179081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:23.179081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:23.179081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:23.179081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:23.179081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:23.179081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:23.180015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:23.180015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:23.180015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:23.180015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:23.180015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:23.180015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:23.180015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:23.180015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:23.180015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:23.180015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:23.180015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:23.180015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:23.180015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:23.180015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:23.180015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:23.180015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:23.180752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:23.180752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:23.180752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:23.180752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:23.180752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:23.180752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:23.180752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:23.180752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:23.180752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:23.180752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:23.180752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:52:23.180752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:23.180752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 39/81] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:52:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:23.181380 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d193cd-6057-4e35-a63d-38994518c4bd None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:23.214935 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55a18e-fe62-46c2-ac62-81db2405e305 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:23.216016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:23.259645 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659efe6-0fdf-4f56-a1aa-8df8b8bd26cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:23.261536 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659efe6-0fdf-4f56-a1aa-8df8b8bd26cb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:23.261536 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659efe6-0fdf-4f56-a1aa-8df8b8bd26cb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:23.261536 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659efe6-0fdf-4f56-a1aa-8df8b8bd26cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:23.317561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d193cd-6057-4e35-a63d-38994518c4bd None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:23.343847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659efe6-0fdf-4f56-a1aa-8df8b8bd26cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:23.346768 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659efe6-0fdf-4f56-a1aa-8df8b8bd26cb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:23.358201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096118f-7017-40a9-a6fe-9f5e677cc7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:23.358917 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096118f-7017-40a9-a6fe-9f5e677cc7ad None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:23.359206 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096118f-7017-40a9-a6fe-9f5e677cc7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:23.359535 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096118f-7017-40a9-a6fe-9f5e677cc7ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:23.374070 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:23.438344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096118f-7017-40a9-a6fe-9f5e677cc7ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:23.440651 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096118f-7017-40a9-a6fe-9f5e677cc7ad None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:23.466573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:23.486450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 43/82] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:52:23.487462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659efe6-0fdf-4f56-a1aa-8df8b8bd26cb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:23.559524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 40/83] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:52:23.560779 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096118f-7017-40a9-a6fe-9f5e677cc7ad None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:23.612175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659efe6-0fdf-4f56-a1aa-8df8b8bd26cb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:23.639261 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:23.660670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ec374-fa2d-4c5c-9b70-8d5be4b5c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:23.661727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ec374-fa2d-4c5c-9b70-8d5be4b5c487 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:23.662094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ec374-fa2d-4c5c-9b70-8d5be4b5c487 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:23.662452 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ec374-fa2d-4c5c-9b70-8d5be4b5c487 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:23.663455 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ec374-fa2d-4c5c-9b70-8d5be4b5c487 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:23.664116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ec374-fa2d-4c5c-9b70-8d5be4b5c487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:23.665813 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ec374-fa2d-4c5c-9b70-8d5be4b5c487 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:23.674248 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096118f-7017-40a9-a6fe-9f5e677cc7ad None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:23.677442 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 44/84] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:23.678360 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ec374-fa2d-4c5c-9b70-8d5be4b5c487 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:23.705045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:23.715569 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68e7bc-7ac9-43ed-a24f-398426eea9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:23.716423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68e7bc-7ac9-43ed-a24f-398426eea9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:23.716809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68e7bc-7ac9-43ed-a24f-398426eea9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:23.717187 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68e7bc-7ac9-43ed-a24f-398426eea9a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:23.718041 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68e7bc-7ac9-43ed-a24f-398426eea9a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:23.718505 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68e7bc-7ac9-43ed-a24f-398426eea9a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:23.720564 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68e7bc-7ac9-43ed-a24f-398426eea9a2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:23.729421 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 41/85] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:52:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:23.730359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68e7bc-7ac9-43ed-a24f-398426eea9a2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:23.802001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ec374-fa2d-4c5c-9b70-8d5be4b5c487 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:23.838763 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2595d6a-661c-447b-b886-32263ed6d241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:23.839388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68e7bc-7ac9-43ed-a24f-398426eea9a2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:23.840685 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2595d6a-661c-447b-b886-32263ed6d241 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:23.841119 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2595d6a-661c-447b-b886-32263ed6d241 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:23.841540 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2595d6a-661c-447b-b886-32263ed6d241 None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:23.843006 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2595d6a-661c-447b-b886-32263ed6d241 None admin] RBAC: Authorizing `identity:get_project(project_id=3bc1541c2b5e4bde81670004fdd58f45)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:23.844972 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2595d6a-661c-447b-b886-32263ed6d241 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:23.846925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 45/86] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:23 2022] GET /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:23.847957 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2595d6a-661c-447b-b886-32263ed6d241 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:23.876459 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8673f7-9f21-430e-a14e-e87649ee62b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:23.877460 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8673f7-9f21-430e-a14e-e87649ee62b4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:23.877745 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8673f7-9f21-430e-a14e-e87649ee62b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:23.878020 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8673f7-9f21-430e-a14e-e87649ee62b4 None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:23.879252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8673f7-9f21-430e-a14e-e87649ee62b4 None admin] RBAC: Authorizing `identity:get_project(project_id=3bc1541c2b5e4bde81670004fdd58f45)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:23.880829 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8673f7-9f21-430e-a14e-e87649ee62b4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:23.882604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 42/87] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:23 2022] GET /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:23.888407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8673f7-9f21-430e-a14e-e87649ee62b4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:23.904423 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:23.947172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:23.961250 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2595d6a-661c-447b-b886-32263ed6d241 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:23.997707 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92886630-c4c0-42cb-b1c5-83aab147f656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:23.999011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92886630-c4c0-42cb-b1c5-83aab147f656 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:23.999500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92886630-c4c0-42cb-b1c5-83aab147f656 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:24.000028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92886630-c4c0-42cb-b1c5-83aab147f656 None admin] PATH_INFO: `/v3/users/025f07f81f754e028089307575d89269` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:24.000666 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8673f7-9f21-430e-a14e-e87649ee62b4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:24.001772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92886630-c4c0-42cb-b1c5-83aab147f656 None admin] RBAC: Authorizing `identity:get_user(user_id=025f07f81f754e028089307575d89269)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:24.003470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92886630-c4c0-42cb-b1c5-83aab147f656 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:24.005648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 46/88] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:23 2022] GET /identity/v3/users/025f07f81f754e028089307575d89269 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:24.006690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92886630-c4c0-42cb-b1c5-83aab147f656 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:24.037753 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0a488-5188-46a9-9b75-c801b220e8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:24.038618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0a488-5188-46a9-9b75-c801b220e8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:24.038904 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0a488-5188-46a9-9b75-c801b220e8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:24.039181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0a488-5188-46a9-9b75-c801b220e8e7 None admin] PATH_INFO: `/v3/users/025f07f81f754e028089307575d89269` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:24.040443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0a488-5188-46a9-9b75-c801b220e8e7 None admin] RBAC: Authorizing `identity:get_user(user_id=025f07f81f754e028089307575d89269)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:24.041923 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0a488-5188-46a9-9b75-c801b220e8e7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:24.043961 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 43/89] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:23 2022] GET /identity/v3/users/025f07f81f754e028089307575d89269 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:24.044729 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0a488-5188-46a9-9b75-c801b220e8e7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:24.113601 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92886630-c4c0-42cb-b1c5-83aab147f656 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:24.131760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:24.150712 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0a488-5188-46a9-9b75-c801b220e8e7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:24.151766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe98e9-cc62-4596-9b2c-dccffd3aa4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:24.152709 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe98e9-cc62-4596-9b2c-dccffd3aa4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:24.153195 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe98e9-cc62-4596-9b2c-dccffd3aa4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:24.153689 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe98e9-cc62-4596-9b2c-dccffd3aa4a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:24.154777 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe98e9-cc62-4596-9b2c-dccffd3aa4a7 None admin] RBAC: Adding query filter params (role.id=8196ef570097443bac15d3cf39878486, scope.project.id=3bc1541c2b5e4bde81670004fdd58f45, user.id=6a1c89e7dfbe47f0b169c936907738b0) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:24.155317 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe98e9-cc62-4596-9b2c-dccffd3aa4a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:24.157016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe98e9-cc62-4596-9b2c-dccffd3aa4a7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:24.163258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 47/90] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:52:24 2022] GET /identity/v3/role_assignments?user.id=6a1c89e7dfbe47f0b169c936907738b0&scope.project.id=3bc1541c2b5e4bde81670004fdd58f45&role.id=8196ef570097443bac15d3cf39878486 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:24.173142 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe98e9-cc62-4596-9b2c-dccffd3aa4a7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:24.173329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:24.192200 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adb8a7-6b79-4f9f-b5f3-ecf930f9228c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:24.192583 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adb8a7-6b79-4f9f-b5f3-ecf930f9228c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:24.192905 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adb8a7-6b79-4f9f-b5f3-ecf930f9228c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:24.193185 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adb8a7-6b79-4f9f-b5f3-ecf930f9228c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:24.194110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adb8a7-6b79-4f9f-b5f3-ecf930f9228c None admin] RBAC: Adding query filter params (role.id=5674314ace5445ccbca611d8cfdc25f1, scope.project.id=3bc1541c2b5e4bde81670004fdd58f45, user.id=025f07f81f754e028089307575d89269) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:24.194431 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adb8a7-6b79-4f9f-b5f3-ecf930f9228c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:24.196243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adb8a7-6b79-4f9f-b5f3-ecf930f9228c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:24.203550 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 44/91] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:52:24 2022] GET /identity/v3/role_assignments?user.id=025f07f81f754e028089307575d89269&scope.project.id=3bc1541c2b5e4bde81670004fdd58f45&role.id=5674314ace5445ccbca611d8cfdc25f1 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:24.212806 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adb8a7-6b79-4f9f-b5f3-ecf930f9228c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:24.300754 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe98e9-cc62-4596-9b2c-dccffd3aa4a7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:24.340148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20eecc7-bd0e-40df-aa98-a17e4ef941e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:24.341228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20eecc7-bd0e-40df-aa98-a17e4ef941e7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:24.341723 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20eecc7-bd0e-40df-aa98-a17e4ef941e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:24.342218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20eecc7-bd0e-40df-aa98-a17e4ef941e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:24.379603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adb8a7-6b79-4f9f-b5f3-ecf930f9228c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:24.407762 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:24.421255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b06ea-ad5b-4df4-8998-70950001e89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:24.421922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b06ea-ad5b-4df4-8998-70950001e89c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:24.422209 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b06ea-ad5b-4df4-8998-70950001e89c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:24.422489 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b06ea-ad5b-4df4-8998-70950001e89c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:24.432787 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20eecc7-bd0e-40df-aa98-a17e4ef941e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:24.434908 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20eecc7-bd0e-40df-aa98-a17e4ef941e7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:24.482576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:24.503216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b06ea-ad5b-4df4-8998-70950001e89c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:24.504807 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b06ea-ad5b-4df4-8998-70950001e89c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:24.560456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 48/92] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:52:24.567102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20eecc7-bd0e-40df-aa98-a17e4ef941e7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:24.615845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 45/93] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:52:24.621529 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b06ea-ad5b-4df4-8998-70950001e89c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:24.665148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:24.687920 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20eecc7-bd0e-40df-aa98-a17e4ef941e7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:24.716328 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:24.726083 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ec0f6-21f5-46ea-a7db-e3ebc88e1c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:24.727215 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec0f6-21f5-46ea-a7db-e3ebc88e1c3f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:24.727422 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b06ea-ad5b-4df4-8998-70950001e89c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:24.727895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec0f6-21f5-46ea-a7db-e3ebc88e1c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:24.728356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec0f6-21f5-46ea-a7db-e3ebc88e1c3f None admin] PATH_INFO: `/v3/projects/643ca5fbb2934697b50ad436797589e4` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:24.729757 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ec0f6-21f5-46ea-a7db-e3ebc88e1c3f None admin] RBAC: Authorizing `identity:get_project(project_id=643ca5fbb2934697b50ad436797589e4)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:24.731476 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ec0f6-21f5-46ea-a7db-e3ebc88e1c3f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:24.733461 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 49/94] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:24 2022] GET /identity/v3/projects/643ca5fbb2934697b50ad436797589e4 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:24.744808 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ec0f6-21f5-46ea-a7db-e3ebc88e1c3f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:24.771856 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96ecfd-bf5d-409c-ace0-6063d2c99878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:24.771856 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96ecfd-bf5d-409c-ace0-6063d2c99878 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:24.771856 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96ecfd-bf5d-409c-ace0-6063d2c99878 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:24.773942 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96ecfd-bf5d-409c-ace0-6063d2c99878 None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:24.775030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96ecfd-bf5d-409c-ace0-6063d2c99878 None admin] RBAC: Authorizing `identity:get_project(project_id=3bc1541c2b5e4bde81670004fdd58f45)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:24.776683 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96ecfd-bf5d-409c-ace0-6063d2c99878 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:24.778490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 46/95] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:24 2022] GET /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:24.785742 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96ecfd-bf5d-409c-ace0-6063d2c99878 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:24.932402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96ecfd-bf5d-409c-ace0-6063d2c99878 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:24.954526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ec0f6-21f5-46ea-a7db-e3ebc88e1c3f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:24.969580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf28cf-d37e-4b95-9a4c-d6eb219801d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:24.970242 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf28cf-d37e-4b95-9a4c-d6eb219801d0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:24.970529 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf28cf-d37e-4b95-9a4c-d6eb219801d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:24.970807 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf28cf-d37e-4b95-9a4c-d6eb219801d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:24.971651 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf28cf-d37e-4b95-9a4c-d6eb219801d0 None admin] RBAC: Adding query filter params (role.id=d50989dd2d24440f9724d5d7975df7cf, scope.project.id=3bc1541c2b5e4bde81670004fdd58f45, user.id=025f07f81f754e028089307575d89269) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:24.971997 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf28cf-d37e-4b95-9a4c-d6eb219801d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:24.973510 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf28cf-d37e-4b95-9a4c-d6eb219801d0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:24.979449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 47/96] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:52:24 2022] GET /identity/v3/role_assignments?user.id=025f07f81f754e028089307575d89269&scope.project.id=3bc1541c2b5e4bde81670004fdd58f45&role.id=d50989dd2d24440f9724d5d7975df7cf => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:25.030093 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd0f54-00e5-425d-9003-3815820be55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:25.031242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd0f54-00e5-425d-9003-3815820be55b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:25.031741 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd0f54-00e5-425d-9003-3815820be55b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:25.032792 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd0f54-00e5-425d-9003-3815820be55b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:25.033981 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd0f54-00e5-425d-9003-3815820be55b None admin] RBAC: Adding query filter params (role.id=5674314ace5445ccbca611d8cfdc25f1, scope.project.id=643ca5fbb2934697b50ad436797589e4, user.id=025f07f81f754e028089307575d89269) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:25.034525 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd0f54-00e5-425d-9003-3815820be55b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:25.036292 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd0f54-00e5-425d-9003-3815820be55b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:25.042961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 50/97] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:52:24 2022] GET /identity/v3/role_assignments?user.id=025f07f81f754e028089307575d89269&scope.project.id=643ca5fbb2934697b50ad436797589e4&role.id=5674314ace5445ccbca611d8cfdc25f1 => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:25.883206 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe3285-55f3-482b-8cf7-9fc1830a5c54 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:25.883496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe3285-55f3-482b-8cf7-9fc1830a5c54 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:25.884082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe3285-55f3-482b-8cf7-9fc1830a5c54 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:25.885701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 48/98] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:25.891726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fda5eb-8b7b-412d-8115-a73677c71701 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:25.892438 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fda5eb-8b7b-412d-8115-a73677c71701 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:25.892951 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fda5eb-8b7b-412d-8115-a73677c71701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:25.916216 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-65fda5eb-8b7b-412d-8115-a73677c71701 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:25.917786 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-65fda5eb-8b7b-412d-8115-a73677c71701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:25.932252 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:26.010837 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 51/99] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:26.045789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe3285-55f3-482b-8cf7-9fc1830a5c54 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:26.074150 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:26.190744 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe3285-55f3-482b-8cf7-9fc1830a5c54 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:26.209810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8653a10-9a0e-4bcd-8429-8a423e42037f None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:26.210103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8653a10-9a0e-4bcd-8429-8a423e42037f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:26.210552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8653a10-9a0e-4bcd-8429-8a423e42037f None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:26.215885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 52/100] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:52:26.217287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b3ea8-f96b-40e0-89b3-0feabbc3cec7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:26.217807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b3ea8-f96b-40e0-89b3-0feabbc3cec7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:26.218289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b3ea8-f96b-40e0-89b3-0feabbc3cec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:26.249022 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-355b3ea8-f96b-40e0-89b3-0feabbc3cec7 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:26.250621 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e709d47-a5e9-4660-b180-fa5b899f22e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:26.251641 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-355b3ea8-f96b-40e0-89b3-0feabbc3cec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:26.252327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e709d47-a5e9-4660-b180-fa5b899f22e0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:26.252619 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e709d47-a5e9-4660-b180-fa5b899f22e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:26.252905 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e709d47-a5e9-4660-b180-fa5b899f22e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:26.303155 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e709d47-a5e9-4660-b180-fa5b899f22e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:26.308375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-2e709d47-a5e9-4660-b180-fa5b899f22e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:52:26.308375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:26.308375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:26.308375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:26.308375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:26.308375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:26.308375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:26.308375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:26.308375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:26.308375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:26.308375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:26.308375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:26.308375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:26.308375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:26.308375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:26.308375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:26.309219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:26.309219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:26.309219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:26.309219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:26.309219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:26.309219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:26.309219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:26.309219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:26.309219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:26.309219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:26.309219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:26.309219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:26.309219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:26.309219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:26.309219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:26.309219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:26.309988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:26.309988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:26.309988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:26.309988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:26.309988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:26.309988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:26.309988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:26.309988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:26.309988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:26.309988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:26.309988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:52:26.309988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:26.309988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 49/101] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:26.317476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e709d47-a5e9-4660-b180-fa5b899f22e0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:26.366212 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 53/102] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:26.413355 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b3ea8-f96b-40e0-89b3-0feabbc3cec7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:26.470549 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:26.484406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e709d47-a5e9-4660-b180-fa5b899f22e0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:26.535843 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:26.566487 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e9048-0114-441c-b07e-c49632213a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:26.566942 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e9048-0114-441c-b07e-c49632213a3b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:26.567242 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e9048-0114-441c-b07e-c49632213a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:26.567531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e9048-0114-441c-b07e-c49632213a3b None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:26.568344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e9048-0114-441c-b07e-c49632213a3b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:26.568663 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e9048-0114-441c-b07e-c49632213a3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:26.570068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e9048-0114-441c-b07e-c49632213a3b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:26.570861 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b3ea8-f96b-40e0-89b3-0feabbc3cec7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:26.585541 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 50/103] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:26.592812 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e9048-0114-441c-b07e-c49632213a3b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:26.608328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591603b1-2257-4c67-98c1-6a492e4fca88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:26.609497 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591603b1-2257-4c67-98c1-6a492e4fca88 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:26.610057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591603b1-2257-4c67-98c1-6a492e4fca88 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:26.610565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591603b1-2257-4c67-98c1-6a492e4fca88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:26.611966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591603b1-2257-4c67-98c1-6a492e4fca88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:26.613628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591603b1-2257-4c67-98c1-6a492e4fca88 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:26.615782 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 54/104] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:52:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:26.624787 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591603b1-2257-4c67-98c1-6a492e4fca88 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:26.819923 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e9048-0114-441c-b07e-c49632213a3b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:26.859664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591603b1-2257-4c67-98c1-6a492e4fca88 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:26.881529 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bad7f5-0c1e-4132-bbee-ba571b6f5c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:26.882429 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bad7f5-0c1e-4132-bbee-ba571b6f5c46 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:26.882723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bad7f5-0c1e-4132-bbee-ba571b6f5c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:26.883005 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bad7f5-0c1e-4132-bbee-ba571b6f5c46 None admin] PATH_INFO: `/v3/users/df9631f77cd144dfbab0a3fa3534ba93` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:26.896214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:26.908537 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bad7f5-0c1e-4132-bbee-ba571b6f5c46 None admin] RBAC: Authorizing `identity:get_user(user_id=df9631f77cd144dfbab0a3fa3534ba93)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:26.910050 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bad7f5-0c1e-4132-bbee-ba571b6f5c46 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:26.911803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 51/105] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:26 2022] GET /identity/v3/users/df9631f77cd144dfbab0a3fa3534ba93 => generated 289 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:26.917125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bad7f5-0c1e-4132-bbee-ba571b6f5c46 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:26.938463 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca964aa-2f66-4ce7-878f-e439fe76bdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:26.939147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca964aa-2f66-4ce7-878f-e439fe76bdc1 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:26.939440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca964aa-2f66-4ce7-878f-e439fe76bdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:26.939728 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca964aa-2f66-4ce7-878f-e439fe76bdc1 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:26.940609 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca964aa-2f66-4ce7-878f-e439fe76bdc1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:26.942071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca964aa-2f66-4ce7-878f-e439fe76bdc1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:26.969820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:27.013591 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 55/106] 10.222.0.41 () {60 vars in 1141 bytes} [Mon May 30 11:52:26 2022] POST /identity/v3/projects => generated 302 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:52:27.057922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bad7f5-0c1e-4132-bbee-ba571b6f5c46 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:27.097074 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546967d-9349-4a9c-873c-89fdb24d0828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:27.097665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546967d-9349-4a9c-873c-89fdb24d0828 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:27.097954 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546967d-9349-4a9c-873c-89fdb24d0828 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:27.098235 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546967d-9349-4a9c-873c-89fdb24d0828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:27.166762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:27.180180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546967d-9349-4a9c-873c-89fdb24d0828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:27.184072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546967d-9349-4a9c-873c-89fdb24d0828 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:27.314904 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 52/107] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 30 11:52:27.320551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca964aa-2f66-4ce7-878f-e439fe76bdc1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:27.513168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca964aa-2f66-4ce7-878f-e439fe76bdc1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:27.567033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd273fb-36e4-4424-8f6d-b179ec71c779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:27.568330 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd273fb-36e4-4424-8f6d-b179ec71c779 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:27.568826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd273fb-36e4-4424-8f6d-b179ec71c779 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:27.569358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd273fb-36e4-4424-8f6d-b179ec71c779 None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:27.576975 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd273fb-36e4-4424-8f6d-b179ec71c779 None admin] RBAC: Authorizing `identity:get_project(project_id=3bc1541c2b5e4bde81670004fdd58f45)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:27.578928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd273fb-36e4-4424-8f6d-b179ec71c779 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:27.581457 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 56/108] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:27 2022] GET /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:27.589551 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546967d-9349-4a9c-873c-89fdb24d0828 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:27.702677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:27.713820 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546967d-9349-4a9c-873c-89fdb24d0828 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:27.754622 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417d99c-f94e-4e97-9a90-9609d60c03ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:27.755297 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417d99c-f94e-4e97-9a90-9609d60c03ea None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:27.755593 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417d99c-f94e-4e97-9a90-9609d60c03ea None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:27.755902 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417d99c-f94e-4e97-9a90-9609d60c03ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:27.756766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417d99c-f94e-4e97-9a90-9609d60c03ea None admin] RBAC: Adding query filter params (role.id=9742d46a027d4a4a8066c058e5ee5316, scope.project.id=3bc1541c2b5e4bde81670004fdd58f45, user.id=df9631f77cd144dfbab0a3fa3534ba93) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:27.757090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417d99c-f94e-4e97-9a90-9609d60c03ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:27.758551 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417d99c-f94e-4e97-9a90-9609d60c03ea None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:27.764755 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 53/109] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:52:27 2022] GET /identity/v3/role_assignments?user.id=df9631f77cd144dfbab0a3fa3534ba93&scope.project.id=3bc1541c2b5e4bde81670004fdd58f45&role.id=9742d46a027d4a4a8066c058e5ee5316 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:27.918868 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222d33b-24c4-4295-bd2e-aebddba53e15 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:27.918868 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222d33b-24c4-4295-bd2e-aebddba53e15 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:27.918868 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222d33b-24c4-4295-bd2e-aebddba53e15 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:27.918868 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 57/110] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:27.925204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef262a-47d8-40bb-9a42-ff26f54c7f93 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:27.925507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef262a-47d8-40bb-9a42-ff26f54c7f93 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:27.925799 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef262a-47d8-40bb-9a42-ff26f54c7f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:27.951715 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2fef262a-47d8-40bb-9a42-ff26f54c7f93 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:27.953032 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2fef262a-47d8-40bb-9a42-ff26f54c7f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:27.965982 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43902701-dba8-4cf0-8dd4-d658c57e6f15 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:27.966599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43902701-dba8-4cf0-8dd4-d658c57e6f15 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:27.967107 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43902701-dba8-4cf0-8dd4-d658c57e6f15 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:27.968755 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 58/111] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:52:27.975302 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dda528-a395-4df2-be60-a9da78ae2751 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:27.975989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dda528-a395-4df2-be60-a9da78ae2751 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:27.976491 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dda528-a395-4df2-be60-a9da78ae2751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:28.011900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b4dda528-a395-4df2-be60-a9da78ae2751 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:28.013491 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b4dda528-a395-4df2-be60-a9da78ae2751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:28.054642 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 54/112] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:28.090644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef262a-47d8-40bb-9a42-ff26f54c7f93 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:28.118864 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:28.135158 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 59/113] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:28.173756 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dda528-a395-4df2-be60-a9da78ae2751 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:28.246028 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:28.259413 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef262a-47d8-40bb-9a42-ff26f54c7f93 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:28.302378 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a39ee-fe2c-4a28-b0b7-3a4aee333c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:28.304068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a39ee-fe2c-4a28-b0b7-3a4aee333c14 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:28.304572 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a39ee-fe2c-4a28-b0b7-3a4aee333c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:28.305095 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a39ee-fe2c-4a28-b0b7-3a4aee333c14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:28.319698 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a39ee-fe2c-4a28-b0b7-3a4aee333c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:28.330326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-c61a39ee-fe2c-4a28-b0b7-3a4aee333c14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:52:28.330326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:28.330326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:28.330326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:28.330326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:28.330326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:28.330326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:28.330326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:28.330326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:28.330326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:28.330326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:28.330326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:28.330326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:28.330326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:28.330326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:28.330326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:28.331176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:28.331176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:28.331176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:28.331176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:28.331176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:28.331176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:28.331176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:28.331176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:28.331176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:28.331176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:28.331176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:28.331176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:28.331176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:28.331176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:28.331176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:28.331176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:28.331970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:28.331970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:28.331970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:28.331970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:28.331970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:28.331970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:28.331970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:28.331970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:28.331970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:28.331970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:28.331970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:52:28.331970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:28.339417 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 55/114] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:52:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:28.341476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080360df-86db-4813-941e-4116c3ec54f3 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:28.342103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080360df-86db-4813-941e-4116c3ec54f3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:28.342595 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080360df-86db-4813-941e-4116c3ec54f3 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:28.344168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 56/115] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:28.345612 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080360df-86db-4813-941e-4116c3ec54f3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:28.375019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dda528-a395-4df2-be60-a9da78ae2751 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:28.460673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cef9b-03c2-431a-8159-73ef62948517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:28.461782 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cef9b-03c2-431a-8159-73ef62948517 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:28.462354 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cef9b-03c2-431a-8159-73ef62948517 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:28.462822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cef9b-03c2-431a-8159-73ef62948517 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:28.467937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080360df-86db-4813-941e-4116c3ec54f3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:28.474169 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cef9b-03c2-431a-8159-73ef62948517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:28.482244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d36cef9b-03c2-431a-8159-73ef62948517 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:52:28.482244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:28.482244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:28.482244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:28.482244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:28.482244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:28.482244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:28.482244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:28.482244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:28.482244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:28.482244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:28.482244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:28.482244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:28.482244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:28.482244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:28.482244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:28.483075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:28.483075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:28.483075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:28.483075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:28.483075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:28.483075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:28.483075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:28.483075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:28.483075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:28.483075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:28.483075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:28.483075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:28.483075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:28.483075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:28.483075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:28.483075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:28.484218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:28.484218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:28.484218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:28.484218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:28.484218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:28.484218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:28.484218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:28.484218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:28.484218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:28.484218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:28.484218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:52:28.484218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:28.486832 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 60/116] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:52:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:52:28.488368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29bfd6-deb6-40b0-8af8-67c666b4096d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:28.488882 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29bfd6-deb6-40b0-8af8-67c666b4096d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:28.489359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29bfd6-deb6-40b0-8af8-67c666b4096d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:28.506199 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcac4d5-b0ce-4521-a1cd-ef980d207c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:28.506884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcac4d5-b0ce-4521-a1cd-ef980d207c87 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:28.507172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcac4d5-b0ce-4521-a1cd-ef980d207c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:28.507455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcac4d5-b0ce-4521-a1cd-ef980d207c87 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:28.508257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcac4d5-b0ce-4521-a1cd-ef980d207c87 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:28.508576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcac4d5-b0ce-4521-a1cd-ef980d207c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:28.509977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcac4d5-b0ce-4521-a1cd-ef980d207c87 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:28.517456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6f29bfd6-deb6-40b0-8af8-67c666b4096d None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:28.518907 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 57/117] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:52:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:28.519131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6f29bfd6-deb6-40b0-8af8-67c666b4096d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:28.524432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcac4d5-b0ce-4521-a1cd-ef980d207c87 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:28.541516 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:28.572461 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:28.593987 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 61/118] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:28.595755 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9c512-b757-45b7-b76e-48727973b78b None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:28.596278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9c512-b757-45b7-b76e-48727973b78b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:28.596758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9c512-b757-45b7-b76e-48727973b78b None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:28.598302 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 62/119] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:28.599212 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9c512-b757-45b7-b76e-48727973b78b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:28.639500 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcac4d5-b0ce-4521-a1cd-ef980d207c87 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:28.677746 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fe01e-269e-4275-bbe2-a9b1a290496a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:28.678716 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fe01e-269e-4275-bbe2-a9b1a290496a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:28.679207 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fe01e-269e-4275-bbe2-a9b1a290496a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:28.679671 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fe01e-269e-4275-bbe2-a9b1a290496a None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:28.680617 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fe01e-269e-4275-bbe2-a9b1a290496a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:28.681152 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fe01e-269e-4275-bbe2-a9b1a290496a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:28.682833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fe01e-269e-4275-bbe2-a9b1a290496a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:28.692066 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 58/120] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:28.693779 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1779a6a-cc56-4ff9-b006-381d15e5cc46 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:28.694360 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1779a6a-cc56-4ff9-b006-381d15e5cc46 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:28.694919 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1779a6a-cc56-4ff9-b006-381d15e5cc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:28.712829 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c1779a6a-cc56-4ff9-b006-381d15e5cc46 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:28.714296 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c1779a6a-cc56-4ff9-b006-381d15e5cc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:28.714774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9c512-b757-45b7-b76e-48727973b78b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:28.751890 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b5083-2d7c-48bf-9520-a3e122ddd279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:28.752900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b5083-2d7c-48bf-9520-a3e122ddd279 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:28.753352 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b5083-2d7c-48bf-9520-a3e122ddd279 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:28.753809 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b5083-2d7c-48bf-9520-a3e122ddd279 None admin] PATH_INFO: `/v3/users/025f07f81f754e028089307575d89269` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:28.755219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b5083-2d7c-48bf-9520-a3e122ddd279 None admin] RBAC: Authorizing `identity:get_user(user_id=025f07f81f754e028089307575d89269)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:28.757052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b5083-2d7c-48bf-9520-a3e122ddd279 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:28.759256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 63/121] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:28 2022] GET /identity/v3/users/025f07f81f754e028089307575d89269 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:28.760275 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b5083-2d7c-48bf-9520-a3e122ddd279 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:28.794565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 59/122] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:28.795604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1779a6a-cc56-4ff9-b006-381d15e5cc46 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:28.799511 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:28.816130 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:28.868794 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b5083-2d7c-48bf-9520-a3e122ddd279 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:28.905765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaa71c-1979-4f96-8641-77ccb24b0465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:28.906942 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaa71c-1979-4f96-8641-77ccb24b0465 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:28.907411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaa71c-1979-4f96-8641-77ccb24b0465 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:28.907892 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaa71c-1979-4f96-8641-77ccb24b0465 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:28.908058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1779a6a-cc56-4ff9-b006-381d15e5cc46 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:28.919705 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aaa71c-1979-4f96-8641-77ccb24b0465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:28.928343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-66aaa71c-1979-4f96-8641-77ccb24b0465 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:28.928343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:28.928343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:28.928343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:28.928343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:28.928343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:28.928343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:28.928343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:28.928343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:28.928343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:28.928343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:28.928343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:28.928343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:28.928343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:28.928343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:28.928343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:28.929197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:28.929197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:28.929197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:28.929197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:28.929197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:28.929197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:28.929197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:28.929197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:28.929197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:28.929197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:28.929197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:28.929197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:28.929197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:28.929197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:28.929197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:28.929197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:28.929948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:28.929948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:28.929948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:28.929948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:28.929948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:28.929948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:28.929948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:28.929948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:28.929948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:28.929948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:28.929948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:28.929948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:28.932508 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 64/123] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:28.938888 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaa71c-1979-4f96-8641-77ccb24b0465 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:28.945019 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c9e8e-34c8-4ea2-b045-92399334f0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:28.946018 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c9e8e-34c8-4ea2-b045-92399334f0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:28.946401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c9e8e-34c8-4ea2-b045-92399334f0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:28.946753 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c9e8e-34c8-4ea2-b045-92399334f0e7 None admin] PATH_INFO: `/v3/users/6a1c89e7dfbe47f0b169c936907738b0` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:28.948225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c9e8e-34c8-4ea2-b045-92399334f0e7 None admin] RBAC: Authorizing `identity:get_user(user_id=6a1c89e7dfbe47f0b169c936907738b0)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:28.949813 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c9e8e-34c8-4ea2-b045-92399334f0e7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:28.952159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 60/124] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:28 2022] GET /identity/v3/users/6a1c89e7dfbe47f0b169c936907738b0 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:28.953132 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c9e8e-34c8-4ea2-b045-92399334f0e7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:29.029595 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:29.061783 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaa71c-1979-4f96-8641-77ccb24b0465 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:29.062375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c9e8e-34c8-4ea2-b045-92399334f0e7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:29.075461 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:29.102504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bd8d5-648e-4971-9bb6-3b9f177f1778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:29.103420 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bd8d5-648e-4971-9bb6-3b9f177f1778 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:29.103768 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bd8d5-648e-4971-9bb6-3b9f177f1778 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:29.104162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bd8d5-648e-4971-9bb6-3b9f177f1778 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:29.107576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb9eb9-5850-46bd-962e-4c785dd54856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:29.108681 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb9eb9-5850-46bd-962e-4c785dd54856 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:29.109160 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb9eb9-5850-46bd-962e-4c785dd54856 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:29.109880 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb9eb9-5850-46bd-962e-4c785dd54856 None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:29.112369 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb9eb9-5850-46bd-962e-4c785dd54856 None admin] RBAC: Authorizing `identity:get_project(project_id=3bc1541c2b5e4bde81670004fdd58f45)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:29.114424 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb9eb9-5850-46bd-962e-4c785dd54856 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:29.116078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bd8d5-648e-4971-9bb6-3b9f177f1778 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:29.116858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 65/125] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:28 2022] GET /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:29.117807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb9eb9-5850-46bd-962e-4c785dd54856 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:29.130111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ff7bd8d5-648e-4971-9bb6-3b9f177f1778 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:29.130111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:29.130111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:29.130111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:29.130111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:29.130111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:29.130111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:29.130111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:29.130111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:29.130111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:29.130111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:29.130111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:29.130111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:29.130111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:29.130111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:29.130111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:29.130981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:29.130981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:29.130981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:29.130981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:29.130981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:29.130981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:29.130981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:29.130981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:29.130981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:29.130981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:29.130981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:29.130981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:29.130981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:29.130981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:29.130981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:29.130981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:29.131730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:29.131730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:29.131730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:29.131730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:29.131730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:29.131730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:29.131730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:29.131730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:29.131730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:29.131730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:29.131730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:29.131730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:29.131730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 61/126] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:29.132492 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bd8d5-648e-4971-9bb6-3b9f177f1778 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:29.240086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bd8d5-648e-4971-9bb6-3b9f177f1778 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:29.257696 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb9eb9-5850-46bd-962e-4c785dd54856 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:29.272969 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:29.279554 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c984e6b-2e34-42c1-9fc4-57374275c629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:29.281189 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c984e6b-2e34-42c1-9fc4-57374275c629 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:29.281725 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c984e6b-2e34-42c1-9fc4-57374275c629 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:29.282456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c984e6b-2e34-42c1-9fc4-57374275c629 None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:29.283899 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c984e6b-2e34-42c1-9fc4-57374275c629 None admin] RBAC: Authorizing `identity:get_project(project_id=3bc1541c2b5e4bde81670004fdd58f45)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:29.285591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c984e6b-2e34-42c1-9fc4-57374275c629 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:29.287733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 62/127] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:29 2022] GET /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:29.288554 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c984e6b-2e34-42c1-9fc4-57374275c629 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:29.309337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4d5a0-8c9b-4e25-a269-a73ecd68398c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:29.310646 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4d5a0-8c9b-4e25-a269-a73ecd68398c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:29.311113 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4d5a0-8c9b-4e25-a269-a73ecd68398c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:29.311588 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4d5a0-8c9b-4e25-a269-a73ecd68398c None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:29.312567 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4d5a0-8c9b-4e25-a269-a73ecd68398c None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:29.313666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4d5a0-8c9b-4e25-a269-a73ecd68398c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:29.316028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4d5a0-8c9b-4e25-a269-a73ecd68398c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:29.326476 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 66/128] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:29.327331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4d5a0-8c9b-4e25-a269-a73ecd68398c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:29.387887 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:29.411424 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c984e6b-2e34-42c1-9fc4-57374275c629 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:29.449310 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21e99f-51fd-48e1-9503-59348ff6777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:29.450242 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e99f-51fd-48e1-9503-59348ff6777c None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:29.450534 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e99f-51fd-48e1-9503-59348ff6777c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:29.450812 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e99f-51fd-48e1-9503-59348ff6777c None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45/users/025f07f81f754e028089307575d89269/roles/d50989dd2d24440f9724d5d7975df7cf` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:29.453488 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21e99f-51fd-48e1-9503-59348ff6777c None admin] RBAC: Authorizing `identity:create_grant(project_id=3bc1541c2b5e4bde81670004fdd58f45, user_id=025f07f81f754e028089307575d89269, role_id=d50989dd2d24440f9724d5d7975df7cf)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:29.455246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21e99f-51fd-48e1-9503-59348ff6777c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:29.471960 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 63/129] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:52:29 2022] PUT /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45/users/025f07f81f754e028089307575d89269/roles/d50989dd2d24440f9724d5d7975df7cf => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:52:29.472799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4d5a0-8c9b-4e25-a269-a73ecd68398c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:29.481490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21e99f-51fd-48e1-9503-59348ff6777c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:29.521026 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7706e-9585-4786-beba-4764dcec9388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:29.521733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7706e-9585-4786-beba-4764dcec9388 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:29.522026 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7706e-9585-4786-beba-4764dcec9388 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:29.522308 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7706e-9585-4786-beba-4764dcec9388 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:29.523081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7706e-9585-4786-beba-4764dcec9388 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:29.523453 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7706e-9585-4786-beba-4764dcec9388 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:29.525018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7706e-9585-4786-beba-4764dcec9388 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:29.542886 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 67/130] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:29.543763 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7706e-9585-4786-beba-4764dcec9388 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:29.561304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:29.614173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21e99f-51fd-48e1-9503-59348ff6777c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:29.653379 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26266c9a-241b-44d8-b8f0-c0abf8d6c4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:29.654321 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26266c9a-241b-44d8-b8f0-c0abf8d6c4b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:29.654610 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26266c9a-241b-44d8-b8f0-c0abf8d6c4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:29.654954 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26266c9a-241b-44d8-b8f0-c0abf8d6c4b9 None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45/users/6a1c89e7dfbe47f0b169c936907738b0/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:29.657751 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26266c9a-241b-44d8-b8f0-c0abf8d6c4b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bc1541c2b5e4bde81670004fdd58f45, user_id=6a1c89e7dfbe47f0b169c936907738b0, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:29.659339 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26266c9a-241b-44d8-b8f0-c0abf8d6c4b9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:29.691879 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 64/131] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:52:29 2022] PUT /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45/users/6a1c89e7dfbe47f0b169c936907738b0/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:52:29.692549 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26266c9a-241b-44d8-b8f0-c0abf8d6c4b9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:29.735550 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7706e-9585-4786-beba-4764dcec9388 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:29.738389 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:29.792817 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b6775-d7ad-474f-a89a-b685c9cde29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:29.793743 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b6775-d7ad-474f-a89a-b685c9cde29f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:29.794039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b6775-d7ad-474f-a89a-b685c9cde29f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:29.794330 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b6775-d7ad-474f-a89a-b685c9cde29f None admin] PATH_INFO: `/v3/users/025f07f81f754e028089307575d89269` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:29.795701 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b6775-d7ad-474f-a89a-b685c9cde29f None admin] RBAC: Authorizing `identity:get_user(user_id=025f07f81f754e028089307575d89269)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:29.797218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b6775-d7ad-474f-a89a-b685c9cde29f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:29.799239 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 68/132] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:29 2022] GET /identity/v3/users/025f07f81f754e028089307575d89269 => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:29.806342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b6775-d7ad-474f-a89a-b685c9cde29f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:29.955086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b6775-d7ad-474f-a89a-b685c9cde29f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:29.958225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26266c9a-241b-44d8-b8f0-c0abf8d6c4b9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:30.002487 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ac791-61d0-4a98-b921-ed7cb7e498b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:30.003387 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ac791-61d0-4a98-b921-ed7cb7e498b8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:30.003677 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ac791-61d0-4a98-b921-ed7cb7e498b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:30.003986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ac791-61d0-4a98-b921-ed7cb7e498b8 None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:30.008506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ac791-61d0-4a98-b921-ed7cb7e498b8 None admin] RBAC: Authorizing `identity:get_project(project_id=3bc1541c2b5e4bde81670004fdd58f45)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:30.010130 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ac791-61d0-4a98-b921-ed7cb7e498b8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:30.011867 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 69/133] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:29 2022] GET /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:30.018051 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:30.032905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ac791-61d0-4a98-b921-ed7cb7e498b8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:30.050311 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b351d-d054-48dd-8c91-66eefcf575f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:30.051213 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b351d-d054-48dd-8c91-66eefcf575f1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:30.051607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b351d-d054-48dd-8c91-66eefcf575f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:30.051919 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b351d-d054-48dd-8c91-66eefcf575f1 None admin] PATH_INFO: `/v3/users/025f07f81f754e028089307575d89269` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:30.056210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b351d-d054-48dd-8c91-66eefcf575f1 None admin] RBAC: Authorizing `identity:get_user(user_id=025f07f81f754e028089307575d89269)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:30.059078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b351d-d054-48dd-8c91-66eefcf575f1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:30.060876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 65/134] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:29 2022] GET /identity/v3/users/025f07f81f754e028089307575d89269 => generated 275 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:30.069800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b351d-d054-48dd-8c91-66eefcf575f1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:30.114197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:30.243924 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ac791-61d0-4a98-b921-ed7cb7e498b8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:30.259132 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b351d-d054-48dd-8c91-66eefcf575f1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:30.315488 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d2a36-5e26-4a9d-a005-0bee73d1850b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:30.316420 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d2a36-5e26-4a9d-a005-0bee73d1850b None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:30.316713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d2a36-5e26-4a9d-a005-0bee73d1850b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:30.316998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d2a36-5e26-4a9d-a005-0bee73d1850b None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45/users/025f07f81f754e028089307575d89269/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:30.320597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d2a36-5e26-4a9d-a005-0bee73d1850b None admin] RBAC: Authorizing `identity:create_grant(project_id=3bc1541c2b5e4bde81670004fdd58f45, user_id=025f07f81f754e028089307575d89269, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:30.322270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d2a36-5e26-4a9d-a005-0bee73d1850b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:30.333265 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070cb50-afb1-4aa2-b605-3b804eddd3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:30.334147 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070cb50-afb1-4aa2-b605-3b804eddd3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:30.334438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070cb50-afb1-4aa2-b605-3b804eddd3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:30.334724 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070cb50-afb1-4aa2-b605-3b804eddd3f1 None admin] PATH_INFO: `/v3/projects/643ca5fbb2934697b50ad436797589e4` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:30.336039 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070cb50-afb1-4aa2-b605-3b804eddd3f1 None admin] RBAC: Authorizing `identity:get_project(project_id=643ca5fbb2934697b50ad436797589e4)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:30.337486 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070cb50-afb1-4aa2-b605-3b804eddd3f1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:30.340512 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 66/135] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:30 2022] GET /identity/v3/projects/643ca5fbb2934697b50ad436797589e4 => generated 312 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:30.342031 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42aed4-8e3c-4295-b144-bd67e448bab4 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:30.342442 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42aed4-8e3c-4295-b144-bd67e448bab4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:30.342791 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42aed4-8e3c-4295-b144-bd67e448bab4 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:30.345111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 67/136] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:30.349948 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42aed4-8e3c-4295-b144-bd67e448bab4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:30.361004 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 70/137] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:52:30 2022] PUT /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45/users/025f07f81f754e028089307575d89269/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 11:52:30.362335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae249bb9-7f84-4cee-91d1-2d572e034e4b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:30.362704 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae249bb9-7f84-4cee-91d1-2d572e034e4b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:30.363008 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae249bb9-7f84-4cee-91d1-2d572e034e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:30.392943 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ae249bb9-7f84-4cee-91d1-2d572e034e4b None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:30.394166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ae249bb9-7f84-4cee-91d1-2d572e034e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:30.488874 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:30.565473 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 71/138] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:30.577059 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42aed4-8e3c-4295-b144-bd67e448bab4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:30.601631 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae249bb9-7f84-4cee-91d1-2d572e034e4b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:30.629511 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20068fc9-5983-4bf4-9504-2bc0b9c57692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:30.630438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20068fc9-5983-4bf4-9504-2bc0b9c57692 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:30.630728 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20068fc9-5983-4bf4-9504-2bc0b9c57692 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:30.631012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20068fc9-5983-4bf4-9504-2bc0b9c57692 None admin] PATH_INFO: `/v3/projects/643ca5fbb2934697b50ad436797589e4/users/025f07f81f754e028089307575d89269/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:30.634931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20068fc9-5983-4bf4-9504-2bc0b9c57692 None admin] RBAC: Authorizing `identity:create_grant(project_id=643ca5fbb2934697b50ad436797589e4, user_id=025f07f81f754e028089307575d89269, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:30.636442 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20068fc9-5983-4bf4-9504-2bc0b9c57692 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:30.656367 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:30.666371 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 68/139] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:52:30 2022] PUT /identity/v3/projects/643ca5fbb2934697b50ad436797589e4/users/025f07f81f754e028089307575d89269/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:52:30.667838 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92c673-172b-495e-8ee6-3593ef8ed00e None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:30.668140 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92c673-172b-495e-8ee6-3593ef8ed00e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:30.668432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92c673-172b-495e-8ee6-3593ef8ed00e None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:30.673851 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 69/140] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:30.678202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fa6b7-93ae-4a26-935c-2a4fc2b1bacb None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:30.678493 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fa6b7-93ae-4a26-935c-2a4fc2b1bacb None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:30.678782 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fa6b7-93ae-4a26-935c-2a4fc2b1bacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:30.713018 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-922fa6b7-93ae-4a26-935c-2a4fc2b1bacb None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:30.714247 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-922fa6b7-93ae-4a26-935c-2a4fc2b1bacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:30.785219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae249bb9-7f84-4cee-91d1-2d572e034e4b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:30.810105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 70/141] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:52:30.826760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53153f47-8479-49e9-9ad9-69c95bb5fa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:30.827501 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53153f47-8479-49e9-9ad9-69c95bb5fa22 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:30.827791 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53153f47-8479-49e9-9ad9-69c95bb5fa22 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:30.828120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53153f47-8479-49e9-9ad9-69c95bb5fa22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:30.829998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53153f47-8479-49e9-9ad9-69c95bb5fa22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:30.831726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53153f47-8479-49e9-9ad9-69c95bb5fa22 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:30.833867 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 72/142] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:52:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:30.839525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fa6b7-93ae-4a26-935c-2a4fc2b1bacb None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:30.842479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53153f47-8479-49e9-9ad9-69c95bb5fa22 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:30.961234 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:31.053804 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:31.064626 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53153f47-8479-49e9-9ad9-69c95bb5fa22 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:31.076231 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fa6b7-93ae-4a26-935c-2a4fc2b1bacb None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:31.144555 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e6c2b-14a8-4d1d-9ed8-869e27499421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:31.145382 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e6c2b-14a8-4d1d-9ed8-869e27499421 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:31.145675 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e6c2b-14a8-4d1d-9ed8-869e27499421 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:31.145966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e6c2b-14a8-4d1d-9ed8-869e27499421 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:31.150882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bc682-da2d-4969-91e3-b064d38438dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:31.151799 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bc682-da2d-4969-91e3-b064d38438dc None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:31.152309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bc682-da2d-4969-91e3-b064d38438dc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:31.152807 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bc682-da2d-4969-91e3-b064d38438dc None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:31.153765 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bc682-da2d-4969-91e3-b064d38438dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:31.155719 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bc682-da2d-4969-91e3-b064d38438dc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:31.166883 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e6c2b-14a8-4d1d-9ed8-869e27499421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:31.175353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-430e6c2b-14a8-4d1d-9ed8-869e27499421 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:52:31.175353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:31.175353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:31.175353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:31.175353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:31.175353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:31.175353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:31.175353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:31.175353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:31.175353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:31.175353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:31.175353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:31.175353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:31.175353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:31.175353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:31.175353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:31.176321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:31.176321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:31.176321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:31.176321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:31.176321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:31.176321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:31.176321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:31.176321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:31.176321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:31.176321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:31.176321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:31.176321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:31.176321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:31.176321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:31.176321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:31.176321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:31.177080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:31.177080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:31.177080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:31.177080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:31.177080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:31.177080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:31.177080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:31.177080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:31.177080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:31.177080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:31.177080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:52:31.177080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:31.180857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 73/143] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:31.190009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e6c2b-14a8-4d1d-9ed8-869e27499421 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:31.226351 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 71/144] 10.222.0.41 () {60 vars in 1132 bytes} [Mon May 30 11:52:30 2022] POST /identity/v3/users => generated 283 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:52:31.338476 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e6c2b-14a8-4d1d-9ed8-869e27499421 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:31.387245 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8ad9c-1283-459c-b163-f2138fe3f63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:31.388010 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8ad9c-1283-459c-b163-f2138fe3f63c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:31.388299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8ad9c-1283-459c-b163-f2138fe3f63c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:31.388577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8ad9c-1283-459c-b163-f2138fe3f63c None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:31.389345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8ad9c-1283-459c-b163-f2138fe3f63c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:31.389749 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8ad9c-1283-459c-b163-f2138fe3f63c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:31.391177 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8ad9c-1283-459c-b163-f2138fe3f63c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:31.400504 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 74/145] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:31.407001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bc682-da2d-4969-91e3-b064d38438dc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:31.561779 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bc682-da2d-4969-91e3-b064d38438dc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:31.570578 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:31.612430 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c410e-d697-41f0-b2b3-2283270bc547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:31.613893 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c410e-d697-41f0-b2b3-2283270bc547 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:31.614744 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c410e-d697-41f0-b2b3-2283270bc547 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:31.615031 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c410e-d697-41f0-b2b3-2283270bc547 None admin] PATH_INFO: `/v3/users/df9631f77cd144dfbab0a3fa3534ba93` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:31.616319 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c410e-d697-41f0-b2b3-2283270bc547 None admin] RBAC: Authorizing `identity:get_user(user_id=df9631f77cd144dfbab0a3fa3534ba93)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:31.617798 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c410e-d697-41f0-b2b3-2283270bc547 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:31.619626 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 72/146] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:31 2022] GET /identity/v3/users/df9631f77cd144dfbab0a3fa3534ba93 => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:31.625464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8ad9c-1283-459c-b163-f2138fe3f63c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:31.658090 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:31.760542 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8ad9c-1283-459c-b163-f2138fe3f63c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:31.797386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b3a17-7d18-4d90-ac01-4553a3854587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:31.798380 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b3a17-7d18-4d90-ac01-4553a3854587 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:31.798676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b3a17-7d18-4d90-ac01-4553a3854587 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:31.798958 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b3a17-7d18-4d90-ac01-4553a3854587 None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:31.800389 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b3a17-7d18-4d90-ac01-4553a3854587 None admin] RBAC: Authorizing `identity:get_project(project_id=3bc1541c2b5e4bde81670004fdd58f45)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:31.801851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b3a17-7d18-4d90-ac01-4553a3854587 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:31.807931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 75/147] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:31 2022] GET /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:31.809613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c410e-d697-41f0-b2b3-2283270bc547 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:31.924040 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c410e-d697-41f0-b2b3-2283270bc547 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:31.970865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489e690-8c5e-4d19-94fb-06609c7cdcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:31.971836 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489e690-8c5e-4d19-94fb-06609c7cdcdf None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:31.972161 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489e690-8c5e-4d19-94fb-06609c7cdcdf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:31.972448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489e690-8c5e-4d19-94fb-06609c7cdcdf None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45/users/df9631f77cd144dfbab0a3fa3534ba93/roles/9742d46a027d4a4a8066c058e5ee5316` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:31.976426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489e690-8c5e-4d19-94fb-06609c7cdcdf None admin] RBAC: Authorizing `identity:create_grant(project_id=3bc1541c2b5e4bde81670004fdd58f45, user_id=df9631f77cd144dfbab0a3fa3534ba93, role_id=9742d46a027d4a4a8066c058e5ee5316)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:31.977895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489e690-8c5e-4d19-94fb-06609c7cdcdf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:32.008542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 73/148] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:52:31 2022] PUT /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45/users/df9631f77cd144dfbab0a3fa3534ba93/roles/9742d46a027d4a4a8066c058e5ee5316 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:52:33.251079 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8208923-54a1-4d46-b7ec-9608f64c63c0 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:33.252226 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8208923-54a1-4d46-b7ec-9608f64c63c0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:33.252226 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8208923-54a1-4d46-b7ec-9608f64c63c0 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:33.253418 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 76/149] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:33.258803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbb733-e4e8-40ec-94d3-b1b14bf8d576 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:33.259203 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbb733-e4e8-40ec-94d3-b1b14bf8d576 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:33.259364 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbb733-e4e8-40ec-94d3-b1b14bf8d576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:33.280879 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-55cbb733-e4e8-40ec-94d3-b1b14bf8d576 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:33.282672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-55cbb733-e4e8-40ec-94d3-b1b14bf8d576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:33.313566 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:33.372031 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 74/150] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:33.409054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8208923-54a1-4d46-b7ec-9608f64c63c0 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:33.506403 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:33.522504 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8208923-54a1-4d46-b7ec-9608f64c63c0 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:33.546377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739e700-d6e5-4f95-8e3e-9ef5c535cf2a None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:33.546664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739e700-d6e5-4f95-8e3e-9ef5c535cf2a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:33.546937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739e700-d6e5-4f95-8e3e-9ef5c535cf2a None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:33.549011 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 75/151] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:52:33.566200 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87f9d-14b4-4418-ba0a-1a1f3c9cb699 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:33.566549 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87f9d-14b4-4418-ba0a-1a1f3c9cb699 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:33.566834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87f9d-14b4-4418-ba0a-1a1f3c9cb699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:33.588148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa26166-4e9c-456b-8e3e-fc73f109e3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:33.588988 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa26166-4e9c-456b-8e3e-fc73f109e3dc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:33.589278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa26166-4e9c-456b-8e3e-fc73f109e3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:33.589562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa26166-4e9c-456b-8e3e-fc73f109e3dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:33.591191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-11f87f9d-14b4-4418-ba0a-1a1f3c9cb699 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:33.592429 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-11f87f9d-14b4-4418-ba0a-1a1f3c9cb699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:33.609761 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa26166-4e9c-456b-8e3e-fc73f109e3dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:33.628057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-6fa26166-4e9c-456b-8e3e-fc73f109e3dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:52:33.628057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:33.628057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:33.628057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:33.628057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:33.628057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:33.628057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:33.628057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:33.628057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:33.628057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:33.628057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:33.628057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:33.628057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:33.628057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:33.628057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:33.628057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:33.630086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:33.630086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:33.630086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:33.630086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:33.630086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:33.630086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:33.630086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:33.630086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:33.630086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:33.630086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:33.630086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:33.630086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:33.630086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:33.630086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:33.630086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:33.630086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:33.631966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:33.631966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:33.631966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:33.631966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:33.631966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:33.631966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:33.631966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:33.631966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:33.631966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:33.631966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:33.631966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:52:33.631966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:33.636360 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 77/152] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:52:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:52:33.642796 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa26166-4e9c-456b-8e3e-fc73f109e3dc None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:33.711861 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 76/153] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:52:33.809455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87f9d-14b4-4418-ba0a-1a1f3c9cb699 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:33.811157 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa26166-4e9c-456b-8e3e-fc73f109e3dc None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:33.860134 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8547abe-a8bd-4377-ae93-adbc0514ce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:33.860928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8547abe-a8bd-4377-ae93-adbc0514ce60 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:33.861223 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8547abe-a8bd-4377-ae93-adbc0514ce60 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:33.861507 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8547abe-a8bd-4377-ae93-adbc0514ce60 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:33.862275 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8547abe-a8bd-4377-ae93-adbc0514ce60 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:33.862592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8547abe-a8bd-4377-ae93-adbc0514ce60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:33.864041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8547abe-a8bd-4377-ae93-adbc0514ce60 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:33.879969 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 78/154] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:52:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:33.885435 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8547abe-a8bd-4377-ae93-adbc0514ce60 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:33.904201 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:34.023328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8547abe-a8bd-4377-ae93-adbc0514ce60 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:34.077616 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:34.080876 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ccc03-5d7c-436d-a5ff-89f431ceab92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:34.081769 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ccc03-5d7c-436d-a5ff-89f431ceab92 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:34.082053 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ccc03-5d7c-436d-a5ff-89f431ceab92 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:34.082330 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ccc03-5d7c-436d-a5ff-89f431ceab92 None admin] PATH_INFO: `/v3/users/025f07f81f754e028089307575d89269` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:34.088559 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ccc03-5d7c-436d-a5ff-89f431ceab92 None admin] RBAC: Authorizing `identity:get_user(user_id=025f07f81f754e028089307575d89269)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:34.090064 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ccc03-5d7c-436d-a5ff-89f431ceab92 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:34.091734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 79/155] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:33 2022] GET /identity/v3/users/025f07f81f754e028089307575d89269 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:34.097838 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ccc03-5d7c-436d-a5ff-89f431ceab92 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:34.101918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87f9d-14b4-4418-ba0a-1a1f3c9cb699 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:34.212526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2f7f6-f5af-40c1-b226-ea4313f38cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:34.213715 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2f7f6-f5af-40c1-b226-ea4313f38cad None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:34.214196 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2f7f6-f5af-40c1-b226-ea4313f38cad None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:34.214684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2f7f6-f5af-40c1-b226-ea4313f38cad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:34.217219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:34.240739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2f7f6-f5af-40c1-b226-ea4313f38cad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:34.247103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ccc03-5d7c-436d-a5ff-89f431ceab92 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:34.253398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-9da2f7f6-f5af-40c1-b226-ea4313f38cad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:52:34.253398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:34.253398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:34.253398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:34.253398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:34.253398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:34.253398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:34.253398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:34.253398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:34.253398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:34.253398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:34.253398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:34.253398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:34.253398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:34.253398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:34.253398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:34.254432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:34.254432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:34.254432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:34.254432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:34.254432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:34.254432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:34.254432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:34.254432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:34.254432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:34.254432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:34.254432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:34.254432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:34.254432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:34.254432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:34.254432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:34.254432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:34.255295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:34.255295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:34.255295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:34.255295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:34.255295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:34.255295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:34.255295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:34.255295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:34.255295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:34.255295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:34.255295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:52:34.255295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:34.258082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 77/156] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:52:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 449 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:34.272220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2f7f6-f5af-40c1-b226-ea4313f38cad None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:34.312632 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd9299-0504-4546-8cfa-494f4df89f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:34.314326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd9299-0504-4546-8cfa-494f4df89f05 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:34.314326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd9299-0504-4546-8cfa-494f4df89f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:34.314496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd9299-0504-4546-8cfa-494f4df89f05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:34.411976 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd9299-0504-4546-8cfa-494f4df89f05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:34.413479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd9299-0504-4546-8cfa-494f4df89f05 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:34.525165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2f7f6-f5af-40c1-b226-ea4313f38cad None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:34.528516 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:34.575929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 80/157] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 30 11:52:34.575929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb37c10-7c13-4e53-aaf7-94abe9ec1973 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:34.575929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb37c10-7c13-4e53-aaf7-94abe9ec1973 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:34.575929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb37c10-7c13-4e53-aaf7-94abe9ec1973 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:34.575929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 81/158] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:34.575929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564a8fb-88ec-45a0-8cf2-ab343269341c None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:34.575929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564a8fb-88ec-45a0-8cf2-ab343269341c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:34.576405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564a8fb-88ec-45a0-8cf2-ab343269341c None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:34.576690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 82/159] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:34.577401 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564a8fb-88ec-45a0-8cf2-ab343269341c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:34.585463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d76cc-bca1-4a02-9e3b-be874c17285d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:34.586469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d76cc-bca1-4a02-9e3b-be874c17285d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:34.586945 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d76cc-bca1-4a02-9e3b-be874c17285d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:34.587438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d76cc-bca1-4a02-9e3b-be874c17285d None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:34.588416 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d76cc-bca1-4a02-9e3b-be874c17285d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:34.588916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d76cc-bca1-4a02-9e3b-be874c17285d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:34.590495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d76cc-bca1-4a02-9e3b-be874c17285d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:34.608706 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 78/160] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:34.611304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27530c-dda8-4cd8-9ed7-68b4a6e6e230 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:34.611798 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27530c-dda8-4cd8-9ed7-68b4a6e6e230 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:34.612299 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27530c-dda8-4cd8-9ed7-68b4a6e6e230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:34.643528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ab27530c-dda8-4cd8-9ed7-68b4a6e6e230 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:34.645078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ab27530c-dda8-4cd8-9ed7-68b4a6e6e230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:34.653253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:34.764507 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564a8fb-88ec-45a0-8cf2-ab343269341c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:34.806397 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 79/161] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:34.807883 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab1f6f-fb2c-493b-acf7-c8d7faa2f21e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:34.808179 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab1f6f-fb2c-493b-acf7-c8d7faa2f21e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:34.808461 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab1f6f-fb2c-493b-acf7-c8d7faa2f21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:34.833603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2938ac-c95e-4a7a-9a1c-6185640218cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:34.834407 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2938ac-c95e-4a7a-9a1c-6185640218cf None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:34.834697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2938ac-c95e-4a7a-9a1c-6185640218cf None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:34.834974 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2938ac-c95e-4a7a-9a1c-6185640218cf None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:34.840572 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2938ac-c95e-4a7a-9a1c-6185640218cf None admin] RBAC: Authorizing `identity:get_project(project_id=3bc1541c2b5e4bde81670004fdd58f45)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:34.842055 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2938ac-c95e-4a7a-9a1c-6185640218cf None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:34.843701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a2ab1f6f-fb2c-493b-acf7-c8d7faa2f21e None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:34.843811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 83/162] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:34 2022] GET /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:34.844968 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2938ac-c95e-4a7a-9a1c-6185640218cf None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:34.845345 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a2ab1f6f-fb2c-493b-acf7-c8d7faa2f21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:34.924885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:35.013507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 80/163] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:35.014374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab1f6f-fb2c-493b-acf7-c8d7faa2f21e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:35.020102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2938ac-c95e-4a7a-9a1c-6185640218cf None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:35.087149 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbbacc-ae1e-4f08-8735-5a4c6b24d349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:35.087984 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbbacc-ae1e-4f08-8735-5a4c6b24d349 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:35.088272 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbbacc-ae1e-4f08-8735-5a4c6b24d349 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:35.088550 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbbacc-ae1e-4f08-8735-5a4c6b24d349 None admin] PATH_INFO: `/v3/users/6a1c89e7dfbe47f0b169c936907738b0` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:35.091562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbbacc-ae1e-4f08-8735-5a4c6b24d349 None admin] RBAC: Authorizing `identity:get_user(user_id=6a1c89e7dfbe47f0b169c936907738b0)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:35.093113 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbbacc-ae1e-4f08-8735-5a4c6b24d349 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:35.096625 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 84/164] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:34 2022] GET /identity/v3/users/6a1c89e7dfbe47f0b169c936907738b0 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:35.097462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbbacc-ae1e-4f08-8735-5a4c6b24d349 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:35.148193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:35.202418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab1f6f-fb2c-493b-acf7-c8d7faa2f21e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:35.258611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444969bb-2f0a-42f1-a840-8b0b80402835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:35.259331 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444969bb-2f0a-42f1-a840-8b0b80402835 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:35.259715 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444969bb-2f0a-42f1-a840-8b0b80402835 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:35.260087 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444969bb-2f0a-42f1-a840-8b0b80402835 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:35.260949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444969bb-2f0a-42f1-a840-8b0b80402835 None admin] RBAC: Adding query filter params (role.id=d50989dd2d24440f9724d5d7975df7cf, scope.project.id=3bc1541c2b5e4bde81670004fdd58f45, user.id=025f07f81f754e028089307575d89269) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:35.261271 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444969bb-2f0a-42f1-a840-8b0b80402835 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:35.262849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444969bb-2f0a-42f1-a840-8b0b80402835 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:35.269553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 81/165] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:52:35 2022] GET /identity/v3/role_assignments?user.id=025f07f81f754e028089307575d89269&scope.project.id=3bc1541c2b5e4bde81670004fdd58f45&role.id=d50989dd2d24440f9724d5d7975df7cf => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:35.270450 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444969bb-2f0a-42f1-a840-8b0b80402835 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:35.287759 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbbacc-ae1e-4f08-8735-5a4c6b24d349 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:35.306870 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:35.333437 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a452128-d9be-46b9-9c5a-08305517ab65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:35.334287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a452128-d9be-46b9-9c5a-08305517ab65 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:35.334577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a452128-d9be-46b9-9c5a-08305517ab65 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:35.334853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a452128-d9be-46b9-9c5a-08305517ab65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:35.348649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a452128-d9be-46b9-9c5a-08305517ab65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:35.356740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7a452128-d9be-46b9-9c5a-08305517ab65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:35.356740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:35.356740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:35.356740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:35.356740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:35.356740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:35.356740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:35.356740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:35.356740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:35.356740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:35.356740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:35.356740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:35.356740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:35.356740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:35.356740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:35.356740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:35.357673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:35.357673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:35.357673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:35.357673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:35.357673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:35.357673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:35.357673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:35.357673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:35.357673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:35.357673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:35.357673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:35.357673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:35.357673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:35.357673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:35.357673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:35.357673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:35.358587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:35.358587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:35.358587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:35.358587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:35.358587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:35.358587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:35.358587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:35.358587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:35.358587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:35.358587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:35.358587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:35.358587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:35.358587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 85/166] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:35.359359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a452128-d9be-46b9-9c5a-08305517ab65 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:35.474080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a452128-d9be-46b9-9c5a-08305517ab65 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:35.515281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d65511-a184-49ad-a14e-16588699b0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:35.516426 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d65511-a184-49ad-a14e-16588699b0ba None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:35.517041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d65511-a184-49ad-a14e-16588699b0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:35.517344 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d65511-a184-49ad-a14e-16588699b0ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:35.534383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444969bb-2f0a-42f1-a840-8b0b80402835 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:35.564111 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:35.595032 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d65511-a184-49ad-a14e-16588699b0ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:35.596799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d65511-a184-49ad-a14e-16588699b0ba None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:35.605689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af5d19-d321-479b-ae80-c0eb4ee17635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:35.606427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af5d19-d321-479b-ae80-c0eb4ee17635 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:35.606706 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af5d19-d321-479b-ae80-c0eb4ee17635 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:35.606980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af5d19-d321-479b-ae80-c0eb4ee17635 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:35.620500 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:35.632066 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af5d19-d321-479b-ae80-c0eb4ee17635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:35.639789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-06af5d19-d321-479b-ae80-c0eb4ee17635 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:35.639789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:35.639789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:35.639789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:35.639789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:35.639789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:35.639789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:35.639789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:35.639789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:35.639789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:35.639789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:35.639789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:35.639789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:35.639789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:35.639789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:35.639789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:35.640695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:35.640695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:35.640695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:35.640695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:35.640695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:35.640695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:35.640695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:35.640695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:35.640695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:35.640695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:35.640695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:35.640695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:35.640695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:35.640695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:35.640695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:35.640695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:35.641539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:35.641539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:35.641539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:35.641539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:35.641539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:35.641539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:35.641539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:35.641539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:35.641539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:35.641539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:35.641539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:35.641539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:35.641539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 82/167] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:35.642653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af5d19-d321-479b-ae80-c0eb4ee17635 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:35.711849 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 86/168] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:52:35.712817 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d65511-a184-49ad-a14e-16588699b0ba None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:35.821167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d65511-a184-49ad-a14e-16588699b0ba None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:35.824192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:35.863032 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca45c8-9387-4ef6-b893-54b6e6e676a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:35.863637 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca45c8-9387-4ef6-b893-54b6e6e676a9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:35.865694 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca45c8-9387-4ef6-b893-54b6e6e676a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:35.865989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca45c8-9387-4ef6-b893-54b6e6e676a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:35.866753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca45c8-9387-4ef6-b893-54b6e6e676a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:35.867065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca45c8-9387-4ef6-b893-54b6e6e676a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:35.869750 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca45c8-9387-4ef6-b893-54b6e6e676a9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:35.890035 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 87/169] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:35.893533 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca45c8-9387-4ef6-b893-54b6e6e676a9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:35.898705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af5d19-d321-479b-ae80-c0eb4ee17635 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:35.997078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3be6f-8350-42f8-ba51-42c9ba7d675c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:35.998373 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3be6f-8350-42f8-ba51-42c9ba7d675c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:35.998875 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3be6f-8350-42f8-ba51-42c9ba7d675c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:35.999350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3be6f-8350-42f8-ba51-42c9ba7d675c None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:36.000334 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3be6f-8350-42f8-ba51-42c9ba7d675c None admin] RBAC: Adding query filter params (name=member) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:36.001590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3be6f-8350-42f8-ba51-42c9ba7d675c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:36.003198 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3be6f-8350-42f8-ba51-42c9ba7d675c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:36.026356 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 83/170] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:36.028051 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc713-a84d-49f5-990c-768ca405f84e None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:36.028522 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca45c8-9387-4ef6-b893-54b6e6e676a9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:36.028731 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc713-a84d-49f5-990c-768ca405f84e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:36.029191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc713-a84d-49f5-990c-768ca405f84e None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:36.030619 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 84/171] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:36.031521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fc713-a84d-49f5-990c-768ca405f84e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:36.068301 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89aa85-f4da-4af6-bd5e-a0b83c2de83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:36.068504 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89aa85-f4da-4af6-bd5e-a0b83c2de83e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:36.069121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89aa85-f4da-4af6-bd5e-a0b83c2de83e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:36.069121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89aa85-f4da-4af6-bd5e-a0b83c2de83e None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:36.070278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89aa85-f4da-4af6-bd5e-a0b83c2de83e None admin] RBAC: Authorizing `identity:get_project(project_id=3bc1541c2b5e4bde81670004fdd58f45)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:36.071800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89aa85-f4da-4af6-bd5e-a0b83c2de83e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:36.073871 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 88/172] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:35 2022] GET /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:36.074774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89aa85-f4da-4af6-bd5e-a0b83c2de83e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:36.078612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:36.173594 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:36.181743 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89aa85-f4da-4af6-bd5e-a0b83c2de83e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:36.219728 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c103d-db50-43ba-92eb-ac371b2582dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:36.220761 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c103d-db50-43ba-92eb-ac371b2582dc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:36.221101 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c103d-db50-43ba-92eb-ac371b2582dc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:36.221381 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c103d-db50-43ba-92eb-ac371b2582dc None admin] PATH_INFO: `/v3/users/025f07f81f754e028089307575d89269` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:36.222659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c103d-db50-43ba-92eb-ac371b2582dc None admin] RBAC: Authorizing `identity:get_user(user_id=025f07f81f754e028089307575d89269)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:36.224167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c103d-db50-43ba-92eb-ac371b2582dc None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:36.225983 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 89/173] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:36 2022] GET /identity/v3/users/025f07f81f754e028089307575d89269 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:36.227217 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d8663-969d-4ede-bd0f-96530fa49685 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:36.227515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d8663-969d-4ede-bd0f-96530fa49685 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:36.227793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d8663-969d-4ede-bd0f-96530fa49685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:36.246662 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ed4d8663-969d-4ede-bd0f-96530fa49685 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:36.248334 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ed4d8663-969d-4ede-bd0f-96530fa49685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:36.324207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:36.328996 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 90/174] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:36.330379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d8663-969d-4ede-bd0f-96530fa49685 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:36.349086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fc713-a84d-49f5-990c-768ca405f84e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:36.409054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0269ecc-3f1d-48f6-909c-9e1d4e309877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:36.410251 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0269ecc-3f1d-48f6-909c-9e1d4e309877 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:36.410715 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0269ecc-3f1d-48f6-909c-9e1d4e309877 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:36.411135 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0269ecc-3f1d-48f6-909c-9e1d4e309877 None admin] PATH_INFO: `/v3/users/025f07f81f754e028089307575d89269` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:36.412512 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0269ecc-3f1d-48f6-909c-9e1d4e309877 None admin] RBAC: Authorizing `identity:get_user(user_id=025f07f81f754e028089307575d89269)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:36.414109 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0269ecc-3f1d-48f6-909c-9e1d4e309877 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:36.415939 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 85/175] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:36 2022] GET /identity/v3/users/025f07f81f754e028089307575d89269 => generated 275 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:36.420949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0269ecc-3f1d-48f6-909c-9e1d4e309877 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:36.450163 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d8663-969d-4ede-bd0f-96530fa49685 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:36.489432 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ada41-e58a-416f-a382-75c9db95e83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:36.490214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ada41-e58a-416f-a382-75c9db95e83e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:36.490503 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ada41-e58a-416f-a382-75c9db95e83e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:36.490783 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ada41-e58a-416f-a382-75c9db95e83e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:36.491753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ada41-e58a-416f-a382-75c9db95e83e None admin] RBAC: Adding query filter params (role.id=8196ef570097443bac15d3cf39878486, scope.project.id=3bc1541c2b5e4bde81670004fdd58f45, user.id=6a1c89e7dfbe47f0b169c936907738b0) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:36.492105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ada41-e58a-416f-a382-75c9db95e83e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:36.493619 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ada41-e58a-416f-a382-75c9db95e83e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:36.501215 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 91/176] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:52:36 2022] GET /identity/v3/role_assignments?user.id=6a1c89e7dfbe47f0b169c936907738b0&scope.project.id=3bc1541c2b5e4bde81670004fdd58f45&role.id=8196ef570097443bac15d3cf39878486 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:36.501951 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ada41-e58a-416f-a382-75c9db95e83e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:36.576471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0269ecc-3f1d-48f6-909c-9e1d4e309877 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:36.614835 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:36.634371 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:36.656101 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b38b1-3168-418b-8ff2-a95d5bfcb652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:36.657259 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b38b1-3168-418b-8ff2-a95d5bfcb652 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:36.657737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b38b1-3168-418b-8ff2-a95d5bfcb652 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:36.658190 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b38b1-3168-418b-8ff2-a95d5bfcb652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:36.701069 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ada41-e58a-416f-a382-75c9db95e83e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:36.752814 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848d96b-f805-49d7-a5fa-9317718f58a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:36.753273 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848d96b-f805-49d7-a5fa-9317718f58a7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:36.753566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848d96b-f805-49d7-a5fa-9317718f58a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:36.753840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848d96b-f805-49d7-a5fa-9317718f58a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:36.770156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b38b1-3168-418b-8ff2-a95d5bfcb652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:36.771599 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b38b1-3168-418b-8ff2-a95d5bfcb652 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:36.779016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848d96b-f805-49d7-a5fa-9317718f58a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:36.787659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-8848d96b-f805-49d7-a5fa-9317718f58a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:52:36.787659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:36.787659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:36.787659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:36.787659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:36.787659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:36.787659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:36.787659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:36.787659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:36.787659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:36.787659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:36.787659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:36.787659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:36.787659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:36.787659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:36.787659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:36.788576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:36.788576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:36.788576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:36.788576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:36.788576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:36.788576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:36.788576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:36.788576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:36.788576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:36.788576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:36.788576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:36.788576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:36.788576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:36.788576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:36.788576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:36.788576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:36.789346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:36.789346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:36.789346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:36.789346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:36.789346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:36.789346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:36.789346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:36.789346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:36.789346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:36.789346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:36.789346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:52:36.789346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:36.789346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 92/177] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:52:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:36.790496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3f189-873c-45ca-9ae3-9c3ca12d588e None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:36.790770 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3f189-873c-45ca-9ae3-9c3ca12d588e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:36.791048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3f189-873c-45ca-9ae3-9c3ca12d588e None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:36.792530 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 93/178] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:36.797081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3f189-873c-45ca-9ae3-9c3ca12d588e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:36.898298 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 86/179] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:52:36.901223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343809a-1adb-420d-96ab-72d8d3fab310 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:36.901663 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343809a-1adb-420d-96ab-72d8d3fab310 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:36.902086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343809a-1adb-420d-96ab-72d8d3fab310 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:36.903657 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 87/180] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:36.904638 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343809a-1adb-420d-96ab-72d8d3fab310 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:36.919294 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3f189-873c-45ca-9ae3-9c3ca12d588e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:36.934484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:36.947358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:36.959639 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042393e-df22-4a1e-9991-5ea2eda75e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:36.960258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042393e-df22-4a1e-9991-5ea2eda75e5e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:36.960544 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042393e-df22-4a1e-9991-5ea2eda75e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:36.960826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042393e-df22-4a1e-9991-5ea2eda75e5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:37.013637 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343809a-1adb-420d-96ab-72d8d3fab310 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:37.027560 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042393e-df22-4a1e-9991-5ea2eda75e5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:37.029068 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042393e-df22-4a1e-9991-5ea2eda75e5e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:37.049193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4070e-82a3-41a1-813e-1dbb785e0295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:37.049856 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4070e-82a3-41a1-813e-1dbb785e0295 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:37.050148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4070e-82a3-41a1-813e-1dbb785e0295 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:37.050423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4070e-82a3-41a1-813e-1dbb785e0295 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:37.051167 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4070e-82a3-41a1-813e-1dbb785e0295 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:37.051475 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4070e-82a3-41a1-813e-1dbb785e0295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:37.052864 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4070e-82a3-41a1-813e-1dbb785e0295 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:37.060939 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 88/181] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:37.062180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237411ac-c138-435e-8003-e75a5bdf30ee None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:37.062471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237411ac-c138-435e-8003-e75a5bdf30ee None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:37.062748 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237411ac-c138-435e-8003-e75a5bdf30ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:37.079186 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-237411ac-c138-435e-8003-e75a5bdf30ee None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:37.080402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-237411ac-c138-435e-8003-e75a5bdf30ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:37.130341 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 94/182] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:52:37.131176 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042393e-df22-4a1e-9991-5ea2eda75e5e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:37.146781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 89/183] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:37.148202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f60e3d-a81e-4356-82a8-ed42e6e297fc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:37.148490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f60e3d-a81e-4356-82a8-ed42e6e297fc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:37.148766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f60e3d-a81e-4356-82a8-ed42e6e297fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:37.164712 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:37.165979 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-10f60e3d-a81e-4356-82a8-ed42e6e297fc None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:37.167196 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-10f60e3d-a81e-4356-82a8-ed42e6e297fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:37.181244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:37.234698 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 90/184] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:37.236668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b034e07-6ef0-44db-aa73-c6735c952e2e None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:37.236965 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b034e07-6ef0-44db-aa73-c6735c952e2e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:37.237249 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b034e07-6ef0-44db-aa73-c6735c952e2e None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:37.240177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 91/185] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:37.240177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b034e07-6ef0-44db-aa73-c6735c952e2e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:37.245941 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042393e-df22-4a1e-9991-5ea2eda75e5e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:37.280266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e0789-06f0-456c-97e3-2c562400ed2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:37.281125 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e0789-06f0-456c-97e3-2c562400ed2c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:37.281408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e0789-06f0-456c-97e3-2c562400ed2c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:37.282266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e0789-06f0-456c-97e3-2c562400ed2c None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:37.283536 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e0789-06f0-456c-97e3-2c562400ed2c None admin] RBAC: Authorizing `identity:get_project(project_id=3bc1541c2b5e4bde81670004fdd58f45)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:37.285033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e0789-06f0-456c-97e3-2c562400ed2c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:37.286716 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 95/186] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:37 2022] GET /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:37.287475 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e0789-06f0-456c-97e3-2c562400ed2c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:37.347007 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b034e07-6ef0-44db-aa73-c6735c952e2e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:37.379408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:37.381469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0618b5-cf59-46ee-bb12-92af407fc589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:37.382340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0618b5-cf59-46ee-bb12-92af407fc589 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:37.382624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0618b5-cf59-46ee-bb12-92af407fc589 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:37.382904 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0618b5-cf59-46ee-bb12-92af407fc589 None admin] PATH_INFO: `/v3/users/1aadc2d442dd4654a94d5a2ee00a5e61` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:37.388852 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e0789-06f0-456c-97e3-2c562400ed2c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:37.396160 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0618b5-cf59-46ee-bb12-92af407fc589 None admin] RBAC: Authorizing `identity:get_user(user_id=1aadc2d442dd4654a94d5a2ee00a5e61)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:37.397634 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0618b5-cf59-46ee-bb12-92af407fc589 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:37.399281 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 92/187] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:37 2022] GET /identity/v3/users/1aadc2d442dd4654a94d5a2ee00a5e61 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:37.400062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0618b5-cf59-46ee-bb12-92af407fc589 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:37.408246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:37.425774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be243f-15c5-4f85-8d69-ec414859c718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:37.426638 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be243f-15c5-4f85-8d69-ec414859c718 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:37.426949 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be243f-15c5-4f85-8d69-ec414859c718 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:37.427236 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be243f-15c5-4f85-8d69-ec414859c718 None admin] PATH_INFO: `/v3/projects/643ca5fbb2934697b50ad436797589e4` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:37.428452 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be243f-15c5-4f85-8d69-ec414859c718 None admin] RBAC: Authorizing `identity:get_project(project_id=643ca5fbb2934697b50ad436797589e4)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:37.429907 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be243f-15c5-4f85-8d69-ec414859c718 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:37.431598 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 96/188] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:37 2022] GET /identity/v3/projects/643ca5fbb2934697b50ad436797589e4 => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:37.436120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bf09d-4a82-4f6a-8ff0-dc2f038098ae None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:37.436412 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bf09d-4a82-4f6a-8ff0-dc2f038098ae None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:37.436691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bf09d-4a82-4f6a-8ff0-dc2f038098ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:37.454103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9b7bf09d-4a82-4f6a-8ff0-dc2f038098ae None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:37.455294 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9b7bf09d-4a82-4f6a-8ff0-dc2f038098ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:37.499606 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0618b5-cf59-46ee-bb12-92af407fc589 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:37.521688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 97/189] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:37.522746 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bf09d-4a82-4f6a-8ff0-dc2f038098ae None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:37.535305 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acab16-d2e8-44ee-b7bc-05eb55e083cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:37.536521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acab16-d2e8-44ee-b7bc-05eb55e083cb None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:37.536804 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acab16-d2e8-44ee-b7bc-05eb55e083cb None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:37.537078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acab16-d2e8-44ee-b7bc-05eb55e083cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:37.548476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acab16-d2e8-44ee-b7bc-05eb55e083cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:37.556131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-93acab16-d2e8-44ee-b7bc-05eb55e083cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:52:37.556131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:37.556131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:37.556131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:37.556131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:37.556131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:37.556131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:37.556131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:37.556131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:37.556131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:37.556131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:37.556131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:37.556131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:37.556131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:37.556131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:37.556131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:37.557191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:37.557191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:37.557191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:37.557191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:37.557191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:37.557191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:37.557191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:37.557191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:37.557191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:37.557191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:37.557191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:37.557191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:37.557191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:37.557191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:37.557191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:37.557191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:37.558491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:37.558491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:37.558491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:37.558491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:37.558491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:37.558491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:37.558491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:37.558491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:37.558491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:37.558491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:37.558491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:52:37.558491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:37.558491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 93/190] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:37.558491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acab16-d2e8-44ee-b7bc-05eb55e083cb None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:37.617041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:37.624853 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:37.627408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bf09d-4a82-4f6a-8ff0-dc2f038098ae None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:37.660770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acab16-d2e8-44ee-b7bc-05eb55e083cb None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:37.661525 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa663c-0fcd-484c-81fc-22ace4fc1218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:37.662340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa663c-0fcd-484c-81fc-22ace4fc1218 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:37.662624 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa663c-0fcd-484c-81fc-22ace4fc1218 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:37.662910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa663c-0fcd-484c-81fc-22ace4fc1218 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:37.673306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa663c-0fcd-484c-81fc-22ace4fc1218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:37.681372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-e1fa663c-0fcd-484c-81fc-22ace4fc1218 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:52:37.681372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:37.681372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:37.681372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:37.681372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:37.681372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:37.681372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:37.681372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:37.681372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:37.681372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:37.681372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:37.681372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:37.681372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:37.681372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:37.681372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:37.681372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:37.682227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:37.682227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:37.682227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:37.682227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:37.682227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:37.682227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:37.682227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:37.682227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:37.682227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:37.682227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:37.682227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:37.682227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:37.682227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:37.682227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:37.682227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:37.682227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:37.683011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:37.683011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:37.683011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:37.683011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:37.683011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:37.683011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:37.683011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:37.683011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:37.683011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:37.683011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:37.683011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:52:37.683011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:37.683011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 98/191] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:52:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:37.683654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa663c-0fcd-484c-81fc-22ace4fc1218 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:37.696908 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ed47d-0830-45d9-a1a3-c75078dfd5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:37.697566 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ed47d-0830-45d9-a1a3-c75078dfd5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:37.697860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ed47d-0830-45d9-a1a3-c75078dfd5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:37.698143 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ed47d-0830-45d9-a1a3-c75078dfd5b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:37.698990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ed47d-0830-45d9-a1a3-c75078dfd5b9 None admin] RBAC: Adding query filter params (role.id=5674314ace5445ccbca611d8cfdc25f1, scope.project.id=3bc1541c2b5e4bde81670004fdd58f45, user.id=025f07f81f754e028089307575d89269) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:37.699309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ed47d-0830-45d9-a1a3-c75078dfd5b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:37.700785 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ed47d-0830-45d9-a1a3-c75078dfd5b9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:37.706897 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 94/192] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:52:37 2022] GET /identity/v3/role_assignments?user.id=025f07f81f754e028089307575d89269&scope.project.id=3bc1541c2b5e4bde81670004fdd58f45&role.id=5674314ace5445ccbca611d8cfdc25f1 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:37.707660 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ed47d-0830-45d9-a1a3-c75078dfd5b9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:37.795125 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa663c-0fcd-484c-81fc-22ace4fc1218 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:37.833877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ed47d-0830-45d9-a1a3-c75078dfd5b9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:37.834659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f6f43-9ed6-45bd-849d-2b01f57a5452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:37.835494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f6f43-9ed6-45bd-849d-2b01f57a5452 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:37.835786 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f6f43-9ed6-45bd-849d-2b01f57a5452 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:37.836082 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f6f43-9ed6-45bd-849d-2b01f57a5452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:37.858153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:37.868715 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:37.877388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b793b8-6ede-4a3d-9500-5ed263a391ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:37.878250 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b793b8-6ede-4a3d-9500-5ed263a391ba None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:37.878642 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b793b8-6ede-4a3d-9500-5ed263a391ba None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:37.879039 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b793b8-6ede-4a3d-9500-5ed263a391ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:37.880042 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b793b8-6ede-4a3d-9500-5ed263a391ba None admin] RBAC: Adding query filter params (role.id=5674314ace5445ccbca611d8cfdc25f1, scope.project.id=643ca5fbb2934697b50ad436797589e4, user.id=025f07f81f754e028089307575d89269) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:37.880467 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b793b8-6ede-4a3d-9500-5ed263a391ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:37.882052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b793b8-6ede-4a3d-9500-5ed263a391ba None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:37.888860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 95/193] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:52:37 2022] GET /identity/v3/role_assignments?user.id=025f07f81f754e028089307575d89269&scope.project.id=643ca5fbb2934697b50ad436797589e4&role.id=5674314ace5445ccbca611d8cfdc25f1 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:37.889908 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b793b8-6ede-4a3d-9500-5ed263a391ba None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:37.916233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f6f43-9ed6-45bd-849d-2b01f57a5452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:37.917743 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f6f43-9ed6-45bd-849d-2b01f57a5452 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:38.033819 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b793b8-6ede-4a3d-9500-5ed263a391ba None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:38.056046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 99/194] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:52:38.058993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f6f43-9ed6-45bd-849d-2b01f57a5452 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:38.072768 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a376d4-915d-4a51-a057-9d796e9ea0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:38.073594 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a376d4-915d-4a51-a057-9d796e9ea0ff None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:38.073882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a376d4-915d-4a51-a057-9d796e9ea0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:38.074162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a376d4-915d-4a51-a057-9d796e9ea0ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:38.075433 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a376d4-915d-4a51-a057-9d796e9ea0ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:38.076961 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a376d4-915d-4a51-a057-9d796e9ea0ff None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:38.083861 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 96/195] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:52:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:38.083861 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a376d4-915d-4a51-a057-9d796e9ea0ff None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:38.121246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:38.157865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:38.178935 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f6f43-9ed6-45bd-849d-2b01f57a5452 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:38.201680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a376d4-915d-4a51-a057-9d796e9ea0ff None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:38.216281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f9dfb-1211-4c69-a2a1-0df242f1a2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:38.216959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f9dfb-1211-4c69-a2a1-0df242f1a2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:38.217243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f9dfb-1211-4c69-a2a1-0df242f1a2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:38.217524 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f9dfb-1211-4c69-a2a1-0df242f1a2e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:38.218277 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f9dfb-1211-4c69-a2a1-0df242f1a2e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:38.218588 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f9dfb-1211-4c69-a2a1-0df242f1a2e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:38.220448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f9dfb-1211-4c69-a2a1-0df242f1a2e0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:38.228490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 100/196] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:38.229178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f9dfb-1211-4c69-a2a1-0df242f1a2e0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:38.235511 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968303d2-029f-4af6-a9c4-8818a922f37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:38.236209 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968303d2-029f-4af6-a9c4-8818a922f37a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:38.236498 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968303d2-029f-4af6-a9c4-8818a922f37a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:38.236774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968303d2-029f-4af6-a9c4-8818a922f37a None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:38.237531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968303d2-029f-4af6-a9c4-8818a922f37a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:38.237841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968303d2-029f-4af6-a9c4-8818a922f37a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:38.239228 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968303d2-029f-4af6-a9c4-8818a922f37a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:38.247604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 97/197] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:52:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:38.248415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968303d2-029f-4af6-a9c4-8818a922f37a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:38.332100 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f9dfb-1211-4c69-a2a1-0df242f1a2e0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:38.344339 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:38.346820 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968303d2-029f-4af6-a9c4-8818a922f37a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:38.365635 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ce0d4-57f5-496f-ab9e-ac47fab3bb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:38.366496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ce0d4-57f5-496f-ab9e-ac47fab3bb38 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:38.366781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ce0d4-57f5-496f-ab9e-ac47fab3bb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:38.367052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ce0d4-57f5-496f-ab9e-ac47fab3bb38 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:38.368264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ce0d4-57f5-496f-ab9e-ac47fab3bb38 None admin] RBAC: Authorizing `identity:get_project(project_id=138b20881cbe45999d64699abc79c48d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:38.369715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ce0d4-57f5-496f-ab9e-ac47fab3bb38 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:38.370120 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:38.371390 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 101/198] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:38 2022] GET /identity/v3/projects/138b20881cbe45999d64699abc79c48d => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:38.372425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ce0d4-57f5-496f-ab9e-ac47fab3bb38 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:38.381645 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066f637-6475-4be4-ba27-1abec313224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:38.382318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066f637-6475-4be4-ba27-1abec313224f None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:38.382603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066f637-6475-4be4-ba27-1abec313224f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:38.382881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066f637-6475-4be4-ba27-1abec313224f None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:38.383602 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066f637-6475-4be4-ba27-1abec313224f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:38.385076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066f637-6475-4be4-ba27-1abec313224f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:38.405764 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 98/199] 10.222.0.41 () {60 vars in 1132 bytes} [Mon May 30 11:52:38 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:52:38.406981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066f637-6475-4be4-ba27-1abec313224f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:38.502081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ce0d4-57f5-496f-ab9e-ac47fab3bb38 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:38.522317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066f637-6475-4be4-ba27-1abec313224f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:38.545292 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1e526-0ad5-4cd7-bec8-9ec6ad600ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:38.546236 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1e526-0ad5-4cd7-bec8-9ec6ad600ffe None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:38.546519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1e526-0ad5-4cd7-bec8-9ec6ad600ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:38.546791 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1e526-0ad5-4cd7-bec8-9ec6ad600ffe None admin] PATH_INFO: `/v3/users/df9631f77cd144dfbab0a3fa3534ba93` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:38.549133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1e526-0ad5-4cd7-bec8-9ec6ad600ffe None admin] RBAC: Authorizing `identity:get_user(user_id=df9631f77cd144dfbab0a3fa3534ba93)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:38.550818 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1e526-0ad5-4cd7-bec8-9ec6ad600ffe None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:38.552731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 102/200] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:38 2022] GET /identity/v3/users/df9631f77cd144dfbab0a3fa3534ba93 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:38.553527 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1e526-0ad5-4cd7-bec8-9ec6ad600ffe None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:38.569764 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246451fe-a4b2-4883-8584-f53d6d40ceb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:38.570662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246451fe-a4b2-4883-8584-f53d6d40ceb7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:38.570953 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246451fe-a4b2-4883-8584-f53d6d40ceb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:38.571240 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246451fe-a4b2-4883-8584-f53d6d40ceb7 None admin] PATH_INFO: `/v3/users/1aadc2d442dd4654a94d5a2ee00a5e61` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:38.572516 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246451fe-a4b2-4883-8584-f53d6d40ceb7 None admin] RBAC: Authorizing `identity:get_user(user_id=1aadc2d442dd4654a94d5a2ee00a5e61)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:38.574030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246451fe-a4b2-4883-8584-f53d6d40ceb7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:38.580895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 99/201] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:38 2022] GET /identity/v3/users/1aadc2d442dd4654a94d5a2ee00a5e61 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:38.580895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246451fe-a4b2-4883-8584-f53d6d40ceb7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:38.617264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:38.639702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:38.680396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1e526-0ad5-4cd7-bec8-9ec6ad600ffe None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:38.709726 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246451fe-a4b2-4883-8584-f53d6d40ceb7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:38.728488 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2080e-0096-4b09-b395-1a977302e439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:38.729166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2080e-0096-4b09-b395-1a977302e439 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:38.729517 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2080e-0096-4b09-b395-1a977302e439 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:38.729797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2080e-0096-4b09-b395-1a977302e439 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:38.730652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2080e-0096-4b09-b395-1a977302e439 None admin] RBAC: Adding query filter params (role.id=8196ef570097443bac15d3cf39878486, scope.project.id=138b20881cbe45999d64699abc79c48d, user.id=1aadc2d442dd4654a94d5a2ee00a5e61) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:38.730975 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2080e-0096-4b09-b395-1a977302e439 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:38.732544 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2080e-0096-4b09-b395-1a977302e439 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:38.741790 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 103/202] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:52:38 2022] GET /identity/v3/role_assignments?user.id=1aadc2d442dd4654a94d5a2ee00a5e61&scope.project.id=138b20881cbe45999d64699abc79c48d&role.id=8196ef570097443bac15d3cf39878486 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:38.742668 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2080e-0096-4b09-b395-1a977302e439 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:38.755395 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d93fb2-b37b-43fd-8d88-c8bc73a4e077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:38.756091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d93fb2-b37b-43fd-8d88-c8bc73a4e077 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:38.756380 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d93fb2-b37b-43fd-8d88-c8bc73a4e077 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:38.756661 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d93fb2-b37b-43fd-8d88-c8bc73a4e077 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:38.860760 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d93fb2-b37b-43fd-8d88-c8bc73a4e077 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:38.862562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d93fb2-b37b-43fd-8d88-c8bc73a4e077 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:38.890172 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2080e-0096-4b09-b395-1a977302e439 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:38.906461 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:38.916456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:38.935022 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee542e-6ef0-4ab2-9212-0cf55c0c7e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:38.936181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee542e-6ef0-4ab2-9212-0cf55c0c7e63 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:38.936696 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee542e-6ef0-4ab2-9212-0cf55c0c7e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:38.937192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee542e-6ef0-4ab2-9212-0cf55c0c7e63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:38.975808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 100/203] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:52:38.982278 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d93fb2-b37b-43fd-8d88-c8bc73a4e077 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:39.020094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee542e-6ef0-4ab2-9212-0cf55c0c7e63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:39.021725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee542e-6ef0-4ab2-9212-0cf55c0c7e63 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:39.090362 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d93fb2-b37b-43fd-8d88-c8bc73a4e077 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:39.126032 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c3131-55c5-4b4a-aaf3-28efddd623be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:39.127848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c3131-55c5-4b4a-aaf3-28efddd623be None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:39.127848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c3131-55c5-4b4a-aaf3-28efddd623be None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:39.127848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c3131-55c5-4b4a-aaf3-28efddd623be None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:39.129142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c3131-55c5-4b4a-aaf3-28efddd623be None admin] RBAC: Authorizing `identity:get_project(project_id=3bc1541c2b5e4bde81670004fdd58f45)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:39.130746 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c3131-55c5-4b4a-aaf3-28efddd623be None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:39.132583 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 101/204] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:38 2022] GET /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:39.138381 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c3131-55c5-4b4a-aaf3-28efddd623be None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:39.157938 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:39.168564 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 104/205] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:52:39.174326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee542e-6ef0-4ab2-9212-0cf55c0c7e63 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:39.206001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:39.244433 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c3131-55c5-4b4a-aaf3-28efddd623be None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:39.283864 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1639f01-4694-4a65-8385-d4a758cff71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:39.284684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1639f01-4694-4a65-8385-d4a758cff71f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:39.285063 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1639f01-4694-4a65-8385-d4a758cff71f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:39.286654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1639f01-4694-4a65-8385-d4a758cff71f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:39.287609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1639f01-4694-4a65-8385-d4a758cff71f None admin] RBAC: Adding query filter params (role.id=9742d46a027d4a4a8066c058e5ee5316, scope.project.id=3bc1541c2b5e4bde81670004fdd58f45, user.id=df9631f77cd144dfbab0a3fa3534ba93) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:39.288728 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1639f01-4694-4a65-8385-d4a758cff71f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:39.290542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1639f01-4694-4a65-8385-d4a758cff71f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:39.304913 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 102/206] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:52:39 2022] GET /identity/v3/role_assignments?user.id=df9631f77cd144dfbab0a3fa3534ba93&scope.project.id=3bc1541c2b5e4bde81670004fdd58f45&role.id=9742d46a027d4a4a8066c058e5ee5316 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:39.362282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee542e-6ef0-4ab2-9212-0cf55c0c7e63 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:39.413667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1895313-8c89-4bae-9af8-eab8c3381151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:39.414465 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1895313-8c89-4bae-9af8-eab8c3381151 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:39.414747 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1895313-8c89-4bae-9af8-eab8c3381151 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:39.415027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1895313-8c89-4bae-9af8-eab8c3381151 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:39.418930 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1895313-8c89-4bae-9af8-eab8c3381151 None admin] RBAC: Authorizing `identity:get_project(project_id=138b20881cbe45999d64699abc79c48d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:39.420523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1895313-8c89-4bae-9af8-eab8c3381151 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:39.422832 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 105/207] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:39 2022] GET /identity/v3/projects/138b20881cbe45999d64699abc79c48d => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:39.428823 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1639f01-4694-4a65-8385-d4a758cff71f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:39.541093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:39.565188 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1639f01-4694-4a65-8385-d4a758cff71f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:39.618076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb81daf-580a-42bf-b325-5b65e2d8d13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:39.618756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb81daf-580a-42bf-b325-5b65e2d8d13b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:39.619045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb81daf-580a-42bf-b325-5b65e2d8d13b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:39.619326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb81daf-580a-42bf-b325-5b65e2d8d13b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:39.620221 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb81daf-580a-42bf-b325-5b65e2d8d13b None admin] RBAC: Adding query filter params (role.id=d50989dd2d24440f9724d5d7975df7cf, scope.project.id=138b20881cbe45999d64699abc79c48d, user.id=1aadc2d442dd4654a94d5a2ee00a5e61) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:39.620542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb81daf-580a-42bf-b325-5b65e2d8d13b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:39.621998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb81daf-580a-42bf-b325-5b65e2d8d13b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:39.631387 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 103/208] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:52:39 2022] GET /identity/v3/role_assignments?user.id=1aadc2d442dd4654a94d5a2ee00a5e61&scope.project.id=138b20881cbe45999d64699abc79c48d&role.id=d50989dd2d24440f9724d5d7975df7cf => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:40.994330 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee025116-5b81-43ca-9855-637d961e2f3f None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:40.994861 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee025116-5b81-43ca-9855-637d961e2f3f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:40.994861 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee025116-5b81-43ca-9855-637d961e2f3f None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:40.996264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 106/209] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:41.002417 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee92fb6-df37-4f9c-9fef-000c5914842c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:41.002811 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee92fb6-df37-4f9c-9fef-000c5914842c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:41.003009 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee92fb6-df37-4f9c-9fef-000c5914842c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:41.019848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-aee92fb6-df37-4f9c-9fef-000c5914842c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:41.021050 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-aee92fb6-df37-4f9c-9fef-000c5914842c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:41.090540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 104/210] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:41.114206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee025116-5b81-43ca-9855-637d961e2f3f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:41.199753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:41.220013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee025116-5b81-43ca-9855-637d961e2f3f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:41.255533 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcef134-f3cd-42a9-81de-914e57b2968a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:41.255728 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6849c-85db-46ab-a0fa-7f715f8f06f2 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:41.255853 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6849c-85db-46ab-a0fa-7f715f8f06f2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:41.256145 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6849c-85db-46ab-a0fa-7f715f8f06f2 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:41.256359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef134-f3cd-42a9-81de-914e57b2968a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:41.256692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef134-f3cd-42a9-81de-914e57b2968a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:41.256967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef134-f3cd-42a9-81de-914e57b2968a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:41.257524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 105/211] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:52:41.262458 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258a3ef-c8ac-40d0-a015-62509157860c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:41.262744 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258a3ef-c8ac-40d0-a015-62509157860c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:41.263022 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258a3ef-c8ac-40d0-a015-62509157860c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:41.271086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcef134-f3cd-42a9-81de-914e57b2968a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:41.280473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1258a3ef-c8ac-40d0-a015-62509157860c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:41.281829 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1258a3ef-c8ac-40d0-a015-62509157860c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:41.283183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-8fcef134-f3cd-42a9-81de-914e57b2968a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:41.283183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:41.283183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:41.283183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:41.283183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:41.283183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:41.283183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:41.283183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:41.283183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:41.283183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:41.283183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:41.283183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:41.283183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:41.283183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:41.283183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:41.283183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:41.284081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:41.284081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:41.284081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:41.284081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:41.284081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:41.284081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:41.284081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:41.284081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:41.284081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:41.284081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:41.284081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:41.284081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:41.284081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:41.284081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:41.284081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:41.284081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:41.284857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:41.284857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:41.284857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:41.284857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:41.284857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:41.284857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:41.284857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:41.284857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:41.284857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:41.284857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:41.284857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:41.284857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:41.285440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 107/212] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:41.290328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcef134-f3cd-42a9-81de-914e57b2968a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:41.362695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 106/213] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:52:41.363986 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46614515-212b-49f8-b67d-ad630dcfdced None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:41.364243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46614515-212b-49f8-b67d-ad630dcfdced None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:41.364592 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46614515-212b-49f8-b67d-ad630dcfdced None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:41.366062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 107/214] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:41.371289 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368ad55-4fea-4c92-9f3d-f600ae22dd4f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:41.371656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368ad55-4fea-4c92-9f3d-f600ae22dd4f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:41.372274 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368ad55-4fea-4c92-9f3d-f600ae22dd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:41.386102 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:41.390334 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e368ad55-4fea-4c92-9f3d-f600ae22dd4f None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:41.392275 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e368ad55-4fea-4c92-9f3d-f600ae22dd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:41.404196 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcef134-f3cd-42a9-81de-914e57b2968a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:41.441032 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9de28-fe48-4e40-9c7b-610320fbf585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:41.441985 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9de28-fe48-4e40-9c7b-610320fbf585 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:41.442507 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9de28-fe48-4e40-9c7b-610320fbf585 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:41.442965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9de28-fe48-4e40-9c7b-610320fbf585 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:41.443926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9de28-fe48-4e40-9c7b-610320fbf585 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:41.444440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9de28-fe48-4e40-9c7b-610320fbf585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:41.446000 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9de28-fe48-4e40-9c7b-610320fbf585 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:41.455810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 108/215] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:41.456971 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9de28-fe48-4e40-9c7b-610320fbf585 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:41.462243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:41.467334 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 108/216] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:52:41.476805 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368ad55-4fea-4c92-9f3d-f600ae22dd4f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:41.571097 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9de28-fe48-4e40-9c7b-610320fbf585 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:41.593415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368ad55-4fea-4c92-9f3d-f600ae22dd4f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:41.607674 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477bb73-c092-45a6-8439-99cd0b2e4cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:41.608531 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477bb73-c092-45a6-8439-99cd0b2e4cbd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:41.609040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477bb73-c092-45a6-8439-99cd0b2e4cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:41.609146 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477bb73-c092-45a6-8439-99cd0b2e4cbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:41.621014 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477bb73-c092-45a6-8439-99cd0b2e4cbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:41.629358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-8477bb73-c092-45a6-8439-99cd0b2e4cbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:52:41.629358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:41.629358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:41.629358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:41.629358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:41.629358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:41.629358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:41.629358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:41.629358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:41.629358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:41.629358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:41.629358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:41.629358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:41.629358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:41.629358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:41.629358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:41.630278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:41.630278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:41.630278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:41.630278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:41.630278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:41.630278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:41.630278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:41.630278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:41.630278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:41.630278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:41.630278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:41.630278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:41.630278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:41.630278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:41.630278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:41.630278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:41.631051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:41.631051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:41.631051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:41.631051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:41.631051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:41.631051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:41.631051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:41.631051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:41.631051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:41.631051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:41.631051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:52:41.631051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:41.631051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 109/217] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:52:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:41.631678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477bb73-c092-45a6-8439-99cd0b2e4cbd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:41.637607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730787d-30cc-49b0-986b-36c8e7fc49ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:41.637607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730787d-30cc-49b0-986b-36c8e7fc49ac None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:41.637607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730787d-30cc-49b0-986b-36c8e7fc49ac None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:41.637607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730787d-30cc-49b0-986b-36c8e7fc49ac None admin] PATH_INFO: `/v3/users/e8b3e104e7334abdbf9dcedcf68b1ab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:41.638105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:41.654325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730787d-30cc-49b0-986b-36c8e7fc49ac None admin] RBAC: Authorizing `identity:get_user(user_id=e8b3e104e7334abdbf9dcedcf68b1ab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:41.655845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730787d-30cc-49b0-986b-36c8e7fc49ac None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:41.658995 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 109/218] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:41 2022] GET /identity/v3/users/e8b3e104e7334abdbf9dcedcf68b1ab3 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:41.659652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730787d-30cc-49b0-986b-36c8e7fc49ac None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:41.712293 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:41.756086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477bb73-c092-45a6-8439-99cd0b2e4cbd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:41.773851 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730787d-30cc-49b0-986b-36c8e7fc49ac None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:41.793604 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852bf89-42d5-42f3-994c-3d83a2182383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:41.794402 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852bf89-42d5-42f3-994c-3d83a2182383 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:41.794688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852bf89-42d5-42f3-994c-3d83a2182383 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:41.794964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852bf89-42d5-42f3-994c-3d83a2182383 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:41.796166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852bf89-42d5-42f3-994c-3d83a2182383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:41.797682 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852bf89-42d5-42f3-994c-3d83a2182383 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:41.799476 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 110/219] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:52:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:41.804464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852bf89-42d5-42f3-994c-3d83a2182383 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:41.809603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f5d10-7d63-479e-9bc9-dc1d900751ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:41.810282 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f5d10-7d63-479e-9bc9-dc1d900751ca None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:41.810570 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f5d10-7d63-479e-9bc9-dc1d900751ca None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:41.810850 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f5d10-7d63-479e-9bc9-dc1d900751ca None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:41.811609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f5d10-7d63-479e-9bc9-dc1d900751ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:41.811953 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f5d10-7d63-479e-9bc9-dc1d900751ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:41.814103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f5d10-7d63-479e-9bc9-dc1d900751ca None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:41.823419 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 110/220] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:41.824081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f5d10-7d63-479e-9bc9-dc1d900751ca None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:41.886287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:41.924634 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852bf89-42d5-42f3-994c-3d83a2182383 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:41.933071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f5d10-7d63-479e-9bc9-dc1d900751ca None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:41.956074 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:41.963725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec593b3-9419-42e4-b8bd-785fe6b22b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:41.964620 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec593b3-9419-42e4-b8bd-785fe6b22b01 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:41.964972 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec593b3-9419-42e4-b8bd-785fe6b22b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:41.965347 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec593b3-9419-42e4-b8bd-785fe6b22b01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:41.967046 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0983c36-cffc-4303-bfce-8f5821667cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:41.967723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0983c36-cffc-4303-bfce-8f5821667cea None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:41.968035 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0983c36-cffc-4303-bfce-8f5821667cea None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:41.968321 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0983c36-cffc-4303-bfce-8f5821667cea None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:41.969150 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0983c36-cffc-4303-bfce-8f5821667cea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:41.970691 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0983c36-cffc-4303-bfce-8f5821667cea None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:41.990988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 111/221] 10.222.0.41 () {60 vars in 1132 bytes} [Mon May 30 11:52:41 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:52:41.992803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0983c36-cffc-4303-bfce-8f5821667cea None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:42.052551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec593b3-9419-42e4-b8bd-785fe6b22b01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:42.054758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec593b3-9419-42e4-b8bd-785fe6b22b01 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:42.115564 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0983c36-cffc-4303-bfce-8f5821667cea None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:42.128103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:42.160832 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986abc5-e337-4f38-987d-962cc3a1a391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:42.161732 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986abc5-e337-4f38-987d-962cc3a1a391 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:42.162020 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986abc5-e337-4f38-987d-962cc3a1a391 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:42.162547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986abc5-e337-4f38-987d-962cc3a1a391 None admin] PATH_INFO: `/v3/users/1aadc2d442dd4654a94d5a2ee00a5e61` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:42.163565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986abc5-e337-4f38-987d-962cc3a1a391 None admin] RBAC: Authorizing `identity:get_user(user_id=1aadc2d442dd4654a94d5a2ee00a5e61)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:42.165099 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986abc5-e337-4f38-987d-962cc3a1a391 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:42.166777 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 112/222] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:41 2022] GET /identity/v3/users/1aadc2d442dd4654a94d5a2ee00a5e61 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:42.171894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca537a7c-b811-478f-86f4-a3f560dbf26a None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:42.171894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca537a7c-b811-478f-86f4-a3f560dbf26a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:42.171894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca537a7c-b811-478f-86f4-a3f560dbf26a None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:42.171894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 113/223] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:42.172423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca537a7c-b811-478f-86f4-a3f560dbf26a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:42.186169 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 111/224] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:52:42.188384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dad9f-4c4f-44ac-a846-4a34450b8b77 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:42.188765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dad9f-4c4f-44ac-a846-4a34450b8b77 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:42.189117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dad9f-4c4f-44ac-a846-4a34450b8b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:42.208566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-699dad9f-4c4f-44ac-a846-4a34450b8b77 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:42.209048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-699dad9f-4c4f-44ac-a846-4a34450b8b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:42.239040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:42.293398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 112/225] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:42.294218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699dad9f-4c4f-44ac-a846-4a34450b8b77 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:42.306925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca537a7c-b811-478f-86f4-a3f560dbf26a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:42.345886 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054ed1c-565a-48b1-9fa1-67dbb8ede208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:42.347003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054ed1c-565a-48b1-9fa1-67dbb8ede208 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:42.347291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054ed1c-565a-48b1-9fa1-67dbb8ede208 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:42.347572 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054ed1c-565a-48b1-9fa1-67dbb8ede208 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:42.348964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054ed1c-565a-48b1-9fa1-67dbb8ede208 None admin] RBAC: Authorizing `identity:get_project(project_id=138b20881cbe45999d64699abc79c48d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:42.351371 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054ed1c-565a-48b1-9fa1-67dbb8ede208 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:42.354412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 114/226] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:42 2022] GET /identity/v3/projects/138b20881cbe45999d64699abc79c48d => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:42.355403 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054ed1c-565a-48b1-9fa1-67dbb8ede208 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:42.413156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:42.430074 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699dad9f-4c4f-44ac-a846-4a34450b8b77 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:42.471931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b5d94-4760-4660-a9e4-9b42963a8ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:42.473404 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b5d94-4760-4660-a9e4-9b42963a8ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:42.473751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b5d94-4760-4660-a9e4-9b42963a8ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:42.474092 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b5d94-4760-4660-a9e4-9b42963a8ed4 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:42.475484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b5d94-4760-4660-a9e4-9b42963a8ed4 None admin] RBAC: Authorizing `identity:get_project(project_id=138b20881cbe45999d64699abc79c48d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:42.477266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b5d94-4760-4660-a9e4-9b42963a8ed4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:42.479109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 113/227] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:42 2022] GET /identity/v3/projects/138b20881cbe45999d64699abc79c48d => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:42.483063 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054ed1c-565a-48b1-9fa1-67dbb8ede208 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:42.485822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b5d94-4760-4660-a9e4-9b42963a8ed4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:42.517967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:42.530004 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c165d70-dadc-4104-a799-4c0aa5ffabad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:42.531102 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c165d70-dadc-4104-a799-4c0aa5ffabad None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:42.532133 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c165d70-dadc-4104-a799-4c0aa5ffabad None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:42.532585 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c165d70-dadc-4104-a799-4c0aa5ffabad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:42.548802 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c165d70-dadc-4104-a799-4c0aa5ffabad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:42.560918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-6c165d70-dadc-4104-a799-4c0aa5ffabad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:52:42.560918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:42.560918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:42.560918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:42.560918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:42.560918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:42.560918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:42.560918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:42.560918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:42.560918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:42.560918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:42.560918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:42.560918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:42.560918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:42.560918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:42.560918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:42.561770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:42.561770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:42.561770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:42.561770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:42.561770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:42.561770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:42.561770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:42.561770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:42.561770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:42.561770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:42.561770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:42.561770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:42.561770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:42.561770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:42.561770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:42.561770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:42.562539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:42.562539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:42.562539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:42.562539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:42.562539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:42.562539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:42.562539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:42.562539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:42.562539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:42.562539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:42.562539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:52:42.562539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:42.565994 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 115/228] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:52:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:42.566978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c165d70-dadc-4104-a799-4c0aa5ffabad None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:42.606665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b5d94-4760-4660-a9e4-9b42963a8ed4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:42.650392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683c5f7-4cae-42a2-8933-5308249e19f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:42.651483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683c5f7-4cae-42a2-8933-5308249e19f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:42.651859 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683c5f7-4cae-42a2-8933-5308249e19f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:42.652223 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683c5f7-4cae-42a2-8933-5308249e19f1 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d/users/1aadc2d442dd4654a94d5a2ee00a5e61/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:42.654485 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683c5f7-4cae-42a2-8933-5308249e19f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=138b20881cbe45999d64699abc79c48d, user_id=1aadc2d442dd4654a94d5a2ee00a5e61, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:42.656231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683c5f7-4cae-42a2-8933-5308249e19f1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:42.678482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 114/229] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:52:42 2022] PUT /identity/v3/projects/138b20881cbe45999d64699abc79c48d/users/1aadc2d442dd4654a94d5a2ee00a5e61/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:52:42.679386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683c5f7-4cae-42a2-8933-5308249e19f1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:42.710986 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c165d70-dadc-4104-a799-4c0aa5ffabad None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:42.720735 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:42.759376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1f393-df45-47ba-a314-822196409200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:42.760513 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1f393-df45-47ba-a314-822196409200 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:42.761216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1f393-df45-47ba-a314-822196409200 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:42.761693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1f393-df45-47ba-a314-822196409200 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:42.763046 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1f393-df45-47ba-a314-822196409200 None admin] RBAC: Adding query filter params (role.id=5674314ace5445ccbca611d8cfdc25f1, scope.project.id=138b20881cbe45999d64699abc79c48d, user.id=e8b3e104e7334abdbf9dcedcf68b1ab3) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:42.763571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1f393-df45-47ba-a314-822196409200 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:42.771436 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1f393-df45-47ba-a314-822196409200 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:42.778960 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 116/230] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:52:42 2022] GET /identity/v3/role_assignments?user.id=e8b3e104e7334abdbf9dcedcf68b1ab3&scope.project.id=138b20881cbe45999d64699abc79c48d&role.id=5674314ace5445ccbca611d8cfdc25f1 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:42.841679 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:42.857953 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683c5f7-4cae-42a2-8933-5308249e19f1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:42.911584 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ad811-a9df-40c6-bb54-858324740cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:42.912308 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ad811-a9df-40c6-bb54-858324740cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:42.912597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ad811-a9df-40c6-bb54-858324740cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:42.912886 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ad811-a9df-40c6-bb54-858324740cf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:42.913661 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ad811-a9df-40c6-bb54-858324740cf5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:42.913974 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ad811-a9df-40c6-bb54-858324740cf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:42.915402 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ad811-a9df-40c6-bb54-858324740cf5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:42.929731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 115/231] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:52:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:42.935323 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1f393-df45-47ba-a314-822196409200 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:43.068340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1f393-df45-47ba-a314-822196409200 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:43.113229 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588a434-0242-4bd8-8dfb-0ed6027eb626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:43.114134 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588a434-0242-4bd8-8dfb-0ed6027eb626 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:43.114420 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588a434-0242-4bd8-8dfb-0ed6027eb626 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:43.114699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588a434-0242-4bd8-8dfb-0ed6027eb626 None admin] PATH_INFO: `/v3/users/1aadc2d442dd4654a94d5a2ee00a5e61` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:43.115972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588a434-0242-4bd8-8dfb-0ed6027eb626 None admin] RBAC: Authorizing `identity:get_user(user_id=1aadc2d442dd4654a94d5a2ee00a5e61)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:43.117447 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588a434-0242-4bd8-8dfb-0ed6027eb626 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:43.119283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 117/232] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:42 2022] GET /identity/v3/users/1aadc2d442dd4654a94d5a2ee00a5e61 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:43.126083 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ad811-a9df-40c6-bb54-858324740cf5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:43.242790 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ad811-a9df-40c6-bb54-858324740cf5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:43.285535 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca40a2-7b28-43f9-b4b2-e56e8b485ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:43.286616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca40a2-7b28-43f9-b4b2-e56e8b485ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:43.286792 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca40a2-7b28-43f9-b4b2-e56e8b485ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:43.287039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca40a2-7b28-43f9-b4b2-e56e8b485ce4 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:43.288305 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca40a2-7b28-43f9-b4b2-e56e8b485ce4 None admin] RBAC: Authorizing `identity:get_project(project_id=138b20881cbe45999d64699abc79c48d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:43.289834 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca40a2-7b28-43f9-b4b2-e56e8b485ce4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:43.291610 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 116/233] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:43 2022] GET /identity/v3/projects/138b20881cbe45999d64699abc79c48d => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:43.298096 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588a434-0242-4bd8-8dfb-0ed6027eb626 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:43.382577 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:43.463052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588a434-0242-4bd8-8dfb-0ed6027eb626 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:43.499504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd368e1-a371-4222-bba5-68ad077e43d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:43.500941 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd368e1-a371-4222-bba5-68ad077e43d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:43.501231 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd368e1-a371-4222-bba5-68ad077e43d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:43.501517 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd368e1-a371-4222-bba5-68ad077e43d3 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d/users/1aadc2d442dd4654a94d5a2ee00a5e61/roles/d50989dd2d24440f9724d5d7975df7cf` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:43.503787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd368e1-a371-4222-bba5-68ad077e43d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=138b20881cbe45999d64699abc79c48d, user_id=1aadc2d442dd4654a94d5a2ee00a5e61, role_id=d50989dd2d24440f9724d5d7975df7cf)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:43.505274 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd368e1-a371-4222-bba5-68ad077e43d3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:43.528387 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 118/234] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:52:43 2022] PUT /identity/v3/projects/138b20881cbe45999d64699abc79c48d/users/1aadc2d442dd4654a94d5a2ee00a5e61/roles/d50989dd2d24440f9724d5d7975df7cf => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:52:44.654917 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bad694-287d-4785-844c-4366f870ccfb None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:44.655631 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bad694-287d-4785-844c-4366f870ccfb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:44.655631 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bad694-287d-4785-844c-4366f870ccfb None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:44.657566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 117/235] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:44.676392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f3815-0bca-42d4-a2c0-eeea810f196a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:44.676951 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f3815-0bca-42d4-a2c0-eeea810f196a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:44.676951 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f3815-0bca-42d4-a2c0-eeea810f196a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:44.694916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e97f3815-0bca-42d4-a2c0-eeea810f196a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:44.696441 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e97f3815-0bca-42d4-a2c0-eeea810f196a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:44.810148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 119/236] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:44.865602 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bad694-287d-4785-844c-4366f870ccfb None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:44.892746 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:44.922567 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d1246-b484-4303-a247-963c9a874291 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:44.923190 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d1246-b484-4303-a247-963c9a874291 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:44.923670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d1246-b484-4303-a247-963c9a874291 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:44.925278 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 120/237] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:52:44.939083 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acb08f-d9fb-4f3e-9d4e-258d8f5b112e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:44.940088 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acb08f-d9fb-4f3e-9d4e-258d8f5b112e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:44.940595 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acb08f-d9fb-4f3e-9d4e-258d8f5b112e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:44.973770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e7acb08f-d9fb-4f3e-9d4e-258d8f5b112e None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:44.974305 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e7acb08f-d9fb-4f3e-9d4e-258d8f5b112e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:45.032263 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:45.034806 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bad694-287d-4785-844c-4366f870ccfb None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:45.092574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23181f43-9f4e-4c79-969e-ba93314d6f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:45.093526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23181f43-9f4e-4c79-969e-ba93314d6f93 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:45.093852 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23181f43-9f4e-4c79-969e-ba93314d6f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:45.099872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23181f43-9f4e-4c79-969e-ba93314d6f93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:45.112060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 121/238] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:45.118400 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23181f43-9f4e-4c79-969e-ba93314d6f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:45.133432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acb08f-d9fb-4f3e-9d4e-258d8f5b112e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:45.134803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-23181f43-9f4e-4c79-969e-ba93314d6f93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:52:45.134803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:45.134803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:45.134803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:45.134803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:45.134803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:45.134803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:45.134803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:45.134803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:45.134803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:45.134803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:45.134803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:45.134803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:45.134803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:45.134803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:45.134803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:45.135659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:45.135659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:45.135659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:45.135659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:45.135659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:45.135659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:45.135659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:45.135659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:45.135659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:45.135659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:45.135659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:45.135659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:45.135659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:45.135659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:45.135659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:45.135659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:45.136727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:45.136727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:45.136727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:45.136727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:45.136727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:45.136727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:45.136727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:45.136727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:45.136727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:45.136727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:45.136727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:52:45.136727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:45.136727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 118/239] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:45.142530 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23181f43-9f4e-4c79-969e-ba93314d6f93 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:45.240184 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:45.266541 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23181f43-9f4e-4c79-969e-ba93314d6f93 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:45.300816 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acb08f-d9fb-4f3e-9d4e-258d8f5b112e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:45.315720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03770a-c174-4e94-83ca-af609e8131d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:45.316433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03770a-c174-4e94-83ca-af609e8131d1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:45.316719 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03770a-c174-4e94-83ca-af609e8131d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:45.317000 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03770a-c174-4e94-83ca-af609e8131d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:45.317767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03770a-c174-4e94-83ca-af609e8131d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:45.318078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03770a-c174-4e94-83ca-af609e8131d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:45.319495 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03770a-c174-4e94-83ca-af609e8131d1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:45.339654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 119/240] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:45.345928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03770a-c174-4e94-83ca-af609e8131d1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:45.372670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1dad1-329b-484e-86b3-d427e04471ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:45.372670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1dad1-329b-484e-86b3-d427e04471ef None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:45.372670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1dad1-329b-484e-86b3-d427e04471ef None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:45.372670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1dad1-329b-484e-86b3-d427e04471ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:45.373418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1dad1-329b-484e-86b3-d427e04471ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:45.374154 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1dad1-329b-484e-86b3-d427e04471ef None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:45.376412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 122/241] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:52:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:45.382079 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1dad1-329b-484e-86b3-d427e04471ef None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:45.440963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:45.582953 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03770a-c174-4e94-83ca-af609e8131d1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:45.586523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1dad1-329b-484e-86b3-d427e04471ef None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:45.627298 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dfda5-3221-4315-99bb-aad5d75cb5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:45.628276 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dfda5-3221-4315-99bb-aad5d75cb5ca None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:45.628567 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dfda5-3221-4315-99bb-aad5d75cb5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:45.628844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dfda5-3221-4315-99bb-aad5d75cb5ca None admin] PATH_INFO: `/v3/users/db89ea8a71fe49ae84c6cc8b905b13e5` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:45.630361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b43d4-2f85-4af5-9e52-c14349d6a3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:45.631517 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b43d4-2f85-4af5-9e52-c14349d6a3f3 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:45.632648 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b43d4-2f85-4af5-9e52-c14349d6a3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:45.632933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b43d4-2f85-4af5-9e52-c14349d6a3f3 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:45.633676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b43d4-2f85-4af5-9e52-c14349d6a3f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:45.635130 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b43d4-2f85-4af5-9e52-c14349d6a3f3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:45.644326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:45.649424 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7dfda5-3221-4315-99bb-aad5d75cb5ca None admin] RBAC: Authorizing `identity:get_user(user_id=db89ea8a71fe49ae84c6cc8b905b13e5)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:45.651945 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7dfda5-3221-4315-99bb-aad5d75cb5ca None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:45.658651 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 123/242] 10.222.0.41 () {60 vars in 1132 bytes} [Mon May 30 11:52:45 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:52:45.659324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 120/243] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:45 2022] GET /identity/v3/users/db89ea8a71fe49ae84c6cc8b905b13e5 => generated 297 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:45.660428 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4210ccd-f493-466e-a837-b3a53ab367c4 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:45.660428 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4210ccd-f493-466e-a837-b3a53ab367c4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:45.660626 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4210ccd-f493-466e-a837-b3a53ab367c4 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:45.661780 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dfda5-3221-4315-99bb-aad5d75cb5ca None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:45.664066 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 124/244] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:45.669080 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6930b-b801-4470-b513-ff0b68e805ae None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:45.669409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6930b-b801-4470-b513-ff0b68e805ae None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:45.669646 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6930b-b801-4470-b513-ff0b68e805ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:45.692913 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ead6930b-b801-4470-b513-ff0b68e805ae None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:45.695277 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ead6930b-b801-4470-b513-ff0b68e805ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:45.799072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 125/245] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:52:45.808784 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dfda5-3221-4315-99bb-aad5d75cb5ca None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:45.868097 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a290d-73df-4b69-b0af-b763428599b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:45.869122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a290d-73df-4b69-b0af-b763428599b2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:45.869610 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a290d-73df-4b69-b0af-b763428599b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:45.870120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a290d-73df-4b69-b0af-b763428599b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:45.891244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6930b-b801-4470-b513-ff0b68e805ae None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:45.920693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:45.958609 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:45.963208 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a290d-73df-4b69-b0af-b763428599b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:45.964907 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a290d-73df-4b69-b0af-b763428599b2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:46.067339 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6930b-b801-4470-b513-ff0b68e805ae None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:46.088654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 121/246] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:52:46.090255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3e662-626d-4ac6-987a-73b1dbad1c64 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:46.090690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3e662-626d-4ac6-987a-73b1dbad1c64 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:46.091173 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3e662-626d-4ac6-987a-73b1dbad1c64 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:46.092692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 122/247] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:46.096359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3e662-626d-4ac6-987a-73b1dbad1c64 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:46.116473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30334d8-7be7-42c5-ab7d-5dd2270e968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:46.117197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30334d8-7be7-42c5-ab7d-5dd2270e968b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:46.117488 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30334d8-7be7-42c5-ab7d-5dd2270e968b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:46.117771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30334d8-7be7-42c5-ab7d-5dd2270e968b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:46.133339 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30334d8-7be7-42c5-ab7d-5dd2270e968b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:46.143618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b30334d8-7be7-42c5-ab7d-5dd2270e968b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:52:46.143618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:46.143618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:46.143618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:46.143618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:46.143618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:46.143618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:46.143618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:46.143618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:46.143618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:46.143618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:46.143618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:46.143618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:46.143618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:46.143618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:46.143618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:46.144978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:46.144978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:46.144978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:46.144978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:46.144978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:46.144978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:46.144978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:46.144978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:46.144978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:46.144978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:46.144978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:46.144978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:46.144978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:46.144978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:46.144978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:46.144978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:46.146142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:46.146142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:46.146142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:46.146142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:46.146142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:46.146142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:46.146142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:46.146142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:46.146142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:46.146142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:46.146142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:52:46.146142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:46.146142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 126/248] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:52:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:46.151606 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f0cc9-3a6d-44c2-8306-917e76b7703c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:46.151973 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f0cc9-3a6d-44c2-8306-917e76b7703c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:46.152206 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f0cc9-3a6d-44c2-8306-917e76b7703c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:46.171020 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-4e8f0cc9-3a6d-44c2-8306-917e76b7703c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:46.172368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4e8f0cc9-3a6d-44c2-8306-917e76b7703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:46.226742 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:46.235900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3e662-626d-4ac6-987a-73b1dbad1c64 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:46.262461 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 127/249] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:46.263649 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f0cc9-3a6d-44c2-8306-917e76b7703c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:46.266968 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:46.286762 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d6e7b-3af9-4ed8-b5d4-8ad243332236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:46.287633 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d6e7b-3af9-4ed8-b5d4-8ad243332236 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:46.287952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d6e7b-3af9-4ed8-b5d4-8ad243332236 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:46.288234 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d6e7b-3af9-4ed8-b5d4-8ad243332236 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:46.289444 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d6e7b-3af9-4ed8-b5d4-8ad243332236 None admin] RBAC: Authorizing `identity:get_project(project_id=138b20881cbe45999d64699abc79c48d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:46.291497 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d6e7b-3af9-4ed8-b5d4-8ad243332236 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:46.295549 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 123/250] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:46 2022] GET /identity/v3/projects/138b20881cbe45999d64699abc79c48d => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:46.299530 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d6e7b-3af9-4ed8-b5d4-8ad243332236 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:46.393992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f0cc9-3a6d-44c2-8306-917e76b7703c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:46.430194 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d6e7b-3af9-4ed8-b5d4-8ad243332236 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:46.456463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46c948-a7bc-4e97-8289-9056a3291ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:46.457623 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46c948-a7bc-4e97-8289-9056a3291ebb None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:46.458108 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46c948-a7bc-4e97-8289-9056a3291ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:46.458614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46c948-a7bc-4e97-8289-9056a3291ebb None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:46.459576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46c948-a7bc-4e97-8289-9056a3291ebb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:46.464136 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46c948-a7bc-4e97-8289-9056a3291ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:46.465954 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46c948-a7bc-4e97-8289-9056a3291ebb None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:46.471205 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303a12c-d0af-4dc3-931e-717e5244d099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:46.473164 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303a12c-d0af-4dc3-931e-717e5244d099 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:46.476683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303a12c-d0af-4dc3-931e-717e5244d099 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:46.478170 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303a12c-d0af-4dc3-931e-717e5244d099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:46.479589 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303a12c-d0af-4dc3-931e-717e5244d099 None admin] RBAC: Adding query filter params (role.id=9742d46a027d4a4a8066c058e5ee5316, scope.project.id=138b20881cbe45999d64699abc79c48d, user.id=db89ea8a71fe49ae84c6cc8b905b13e5) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:46.480525 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303a12c-d0af-4dc3-931e-717e5244d099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:46.484123 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 128/251] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:46.485072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303a12c-d0af-4dc3-931e-717e5244d099 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:46.487755 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46c948-a7bc-4e97-8289-9056a3291ebb None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:46.495898 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 124/252] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:52:46 2022] GET /identity/v3/role_assignments?user.id=db89ea8a71fe49ae84c6cc8b905b13e5&scope.project.id=138b20881cbe45999d64699abc79c48d&role.id=9742d46a027d4a4a8066c058e5ee5316 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:46.499531 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303a12c-d0af-4dc3-931e-717e5244d099 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:46.573982 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:46.629601 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:46.675933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46c948-a7bc-4e97-8289-9056a3291ebb None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:46.735767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303a12c-d0af-4dc3-931e-717e5244d099 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:46.744460 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dca698-4529-40b1-a3b9-18a53e78167a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:46.745277 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dca698-4529-40b1-a3b9-18a53e78167a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:46.745567 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dca698-4529-40b1-a3b9-18a53e78167a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:46.745874 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dca698-4529-40b1-a3b9-18a53e78167a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:46.758523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dca698-4529-40b1-a3b9-18a53e78167a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:46.767565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-d4dca698-4529-40b1-a3b9-18a53e78167a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:46.767565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:46.767565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:46.767565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:46.767565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:46.767565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:46.767565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:46.767565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:46.767565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:46.767565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:46.767565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:46.767565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:46.767565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:46.767565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:46.767565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:46.767565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:46.768524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:46.768524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:46.768524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:46.768524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:46.768524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:46.768524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:46.768524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:46.768524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:46.768524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:46.768524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:46.768524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:46.768524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:46.768524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:46.768524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:46.768524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:46.768524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:46.769294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:46.769294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:46.769294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:46.769294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:46.769294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:46.769294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:46.769294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:46.769294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:46.769294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:46.769294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:46.769294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:46.769294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:46.769294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 129/253] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:46.769928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede9720-fe6a-4919-8aeb-7c895d942396 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:46.770217 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede9720-fe6a-4919-8aeb-7c895d942396 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:46.770465 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede9720-fe6a-4919-8aeb-7c895d942396 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:46.773432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 130/254] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:46.778100 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392604c1-3641-4c9c-9222-bb9891c9e54a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:46.778844 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392604c1-3641-4c9c-9222-bb9891c9e54a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:46.780223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392604c1-3641-4c9c-9222-bb9891c9e54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:46.801475 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-392604c1-3641-4c9c-9222-bb9891c9e54a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:46.803010 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-392604c1-3641-4c9c-9222-bb9891c9e54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:46.833036 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b106f6-546f-4f6b-ba34-77d1aafae9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:46.837023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b106f6-546f-4f6b-ba34-77d1aafae9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:46.837556 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b106f6-546f-4f6b-ba34-77d1aafae9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:46.838034 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b106f6-546f-4f6b-ba34-77d1aafae9d3 None admin] PATH_INFO: `/v3/users/1aadc2d442dd4654a94d5a2ee00a5e61` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:46.840467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b106f6-546f-4f6b-ba34-77d1aafae9d3 None admin] RBAC: Authorizing `identity:get_user(user_id=1aadc2d442dd4654a94d5a2ee00a5e61)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:46.842168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b106f6-546f-4f6b-ba34-77d1aafae9d3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:46.844324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 125/255] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:46 2022] GET /identity/v3/users/1aadc2d442dd4654a94d5a2ee00a5e61 => generated 283 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:46.846621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b106f6-546f-4f6b-ba34-77d1aafae9d3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:46.935318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 131/256] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:46.936512 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392604c1-3641-4c9c-9222-bb9891c9e54a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:47.002934 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:47.007627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b106f6-546f-4f6b-ba34-77d1aafae9d3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:47.050538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578d5d1-cd24-482a-bfed-1c184901a805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:47.051547 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578d5d1-cd24-482a-bfed-1c184901a805 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:47.052034 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578d5d1-cd24-482a-bfed-1c184901a805 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:47.052488 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578d5d1-cd24-482a-bfed-1c184901a805 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:47.054830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578d5d1-cd24-482a-bfed-1c184901a805 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:47.055327 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578d5d1-cd24-482a-bfed-1c184901a805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:47.056939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578d5d1-cd24-482a-bfed-1c184901a805 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:47.066496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 126/257] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:47.067662 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578d5d1-cd24-482a-bfed-1c184901a805 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:47.073183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:47.147502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392604c1-3641-4c9c-9222-bb9891c9e54a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:47.191174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567133b5-2697-4270-9216-b92e56975f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:47.192236 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567133b5-2697-4270-9216-b92e56975f26 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:47.193824 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567133b5-2697-4270-9216-b92e56975f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:47.194306 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567133b5-2697-4270-9216-b92e56975f26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:47.256136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578d5d1-cd24-482a-bfed-1c184901a805 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:47.302242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ff130-6a18-478a-9bb5-be4bc49f3039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:47.303060 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ff130-6a18-478a-9bb5-be4bc49f3039 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:47.303343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ff130-6a18-478a-9bb5-be4bc49f3039 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:47.303619 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ff130-6a18-478a-9bb5-be4bc49f3039 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:47.324635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567133b5-2697-4270-9216-b92e56975f26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:47.325855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ff130-6a18-478a-9bb5-be4bc49f3039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:47.331305 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567133b5-2697-4270-9216-b92e56975f26 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:47.337820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b74ff130-6a18-478a-9bb5-be4bc49f3039 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:52:47.337820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:47.337820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:47.337820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:47.337820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:47.337820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:47.337820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:47.337820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:47.337820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:47.337820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:47.337820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:47.337820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:47.337820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:47.337820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:47.337820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:47.337820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:47.338773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:47.338773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:47.338773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:47.338773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:47.338773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:47.338773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:47.338773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:47.338773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:47.338773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:47.338773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:47.338773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:47.338773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:47.338773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:47.338773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:47.338773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:47.338773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:47.339546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:47.339546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:47.339546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:47.339546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:47.339546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:47.339546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:47.339546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:47.339546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:47.339546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:47.339546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:47.339546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:52:47.339546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:47.339546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 127/258] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:52:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:47.340731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ff130-6a18-478a-9bb5-be4bc49f3039 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:47.365621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:47.453192 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:47.517405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ff130-6a18-478a-9bb5-be4bc49f3039 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:47.551441 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 132/259] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:52:47.552330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567133b5-2697-4270-9216-b92e56975f26 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:47.594615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78986b12-0948-4feb-bbd4-51ecb55497b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:47.595493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78986b12-0948-4feb-bbd4-51ecb55497b2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:47.595775 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78986b12-0948-4feb-bbd4-51ecb55497b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:47.596073 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78986b12-0948-4feb-bbd4-51ecb55497b2 None admin] PATH_INFO: `/v3/users/e8b3e104e7334abdbf9dcedcf68b1ab3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:47.600449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78986b12-0948-4feb-bbd4-51ecb55497b2 None admin] RBAC: Authorizing `identity:get_user(user_id=e8b3e104e7334abdbf9dcedcf68b1ab3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:47.601928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78986b12-0948-4feb-bbd4-51ecb55497b2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:47.603745 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 128/260] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:47 2022] GET /identity/v3/users/e8b3e104e7334abdbf9dcedcf68b1ab3 => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:47.604355 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78986b12-0948-4feb-bbd4-51ecb55497b2 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:47.695731 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567133b5-2697-4270-9216-b92e56975f26 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:47.735739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa696c8-2e8d-4bd5-82f1-5324f84004db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:47.736362 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa696c8-2e8d-4bd5-82f1-5324f84004db None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:47.736647 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa696c8-2e8d-4bd5-82f1-5324f84004db None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:47.736925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa696c8-2e8d-4bd5-82f1-5324f84004db None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:47.737679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa696c8-2e8d-4bd5-82f1-5324f84004db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:47.737988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa696c8-2e8d-4bd5-82f1-5324f84004db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:47.739358 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa696c8-2e8d-4bd5-82f1-5324f84004db None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:47.760928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 133/261] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:52:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:47.761594 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa696c8-2e8d-4bd5-82f1-5324f84004db None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:47.790137 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:47.828893 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:47.849214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78986b12-0948-4feb-bbd4-51ecb55497b2 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:47.917318 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e1f9a-2a12-42b1-9b0f-f5515c760caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:47.918189 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e1f9a-2a12-42b1-9b0f-f5515c760caf None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:47.918474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e1f9a-2a12-42b1-9b0f-f5515c760caf None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:47.918754 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e1f9a-2a12-42b1-9b0f-f5515c760caf None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:47.923615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e1f9a-2a12-42b1-9b0f-f5515c760caf None admin] RBAC: Authorizing `identity:get_project(project_id=138b20881cbe45999d64699abc79c48d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:47.925114 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e1f9a-2a12-42b1-9b0f-f5515c760caf None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:47.926834 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 129/262] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:47 2022] GET /identity/v3/projects/138b20881cbe45999d64699abc79c48d => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:47.927604 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e1f9a-2a12-42b1-9b0f-f5515c760caf None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:47.935554 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa696c8-2e8d-4bd5-82f1-5324f84004db None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:47.995542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fba89-52a3-4e49-8105-c21d751044c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:47.996362 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fba89-52a3-4e49-8105-c21d751044c2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:47.996649 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fba89-52a3-4e49-8105-c21d751044c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:47.997174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fba89-52a3-4e49-8105-c21d751044c2 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:47.999060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fba89-52a3-4e49-8105-c21d751044c2 None admin] RBAC: Authorizing `identity:get_project(project_id=138b20881cbe45999d64699abc79c48d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:48.001028 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fba89-52a3-4e49-8105-c21d751044c2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:48.002764 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 134/263] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:47 2022] GET /identity/v3/projects/138b20881cbe45999d64699abc79c48d => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:48.003537 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fba89-52a3-4e49-8105-c21d751044c2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:48.145964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:48.155950 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e1f9a-2a12-42b1-9b0f-f5515c760caf None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:48.164727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fba89-52a3-4e49-8105-c21d751044c2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:48.208860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28ad21-775e-4725-bd75-1a030eb7939b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:48.211203 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28ad21-775e-4725-bd75-1a030eb7939b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:48.211712 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28ad21-775e-4725-bd75-1a030eb7939b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:48.212219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28ad21-775e-4725-bd75-1a030eb7939b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:48.213295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28ad21-775e-4725-bd75-1a030eb7939b None admin] RBAC: Adding query filter params (role.id=8196ef570097443bac15d3cf39878486, scope.project.id=138b20881cbe45999d64699abc79c48d, user.id=1aadc2d442dd4654a94d5a2ee00a5e61) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:48.213815 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28ad21-775e-4725-bd75-1a030eb7939b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:48.215481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28ad21-775e-4725-bd75-1a030eb7939b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:48.226265 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 135/264] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:52:48 2022] GET /identity/v3/role_assignments?user.id=1aadc2d442dd4654a94d5a2ee00a5e61&scope.project.id=138b20881cbe45999d64699abc79c48d&role.id=8196ef570097443bac15d3cf39878486 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:48.229132 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28ad21-775e-4725-bd75-1a030eb7939b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:48.230433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2065e2a-6f8e-407a-8870-ba9d57116845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:48.233162 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2065e2a-6f8e-407a-8870-ba9d57116845 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:48.234890 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2065e2a-6f8e-407a-8870-ba9d57116845 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:48.235408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2065e2a-6f8e-407a-8870-ba9d57116845 None admin] PATH_INFO: `/v3/users/1aadc2d442dd4654a94d5a2ee00a5e61` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:48.237983 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2065e2a-6f8e-407a-8870-ba9d57116845 None admin] RBAC: Authorizing `identity:get_user(user_id=1aadc2d442dd4654a94d5a2ee00a5e61)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:48.244712 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2065e2a-6f8e-407a-8870-ba9d57116845 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:48.246751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 130/265] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:47 2022] GET /identity/v3/users/1aadc2d442dd4654a94d5a2ee00a5e61 => generated 283 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:48.253062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2065e2a-6f8e-407a-8870-ba9d57116845 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:48.305571 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:48.416149 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28ad21-775e-4725-bd75-1a030eb7939b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:48.504336 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2065e2a-6f8e-407a-8870-ba9d57116845 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:48.516774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700cf77-cc78-4468-8e81-775eb53acba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:48.517714 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700cf77-cc78-4468-8e81-775eb53acba9 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:48.517990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700cf77-cc78-4468-8e81-775eb53acba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:48.518274 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700cf77-cc78-4468-8e81-775eb53acba9 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d/users/e8b3e104e7334abdbf9dcedcf68b1ab3/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:48.520443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700cf77-cc78-4468-8e81-775eb53acba9 None admin] RBAC: Authorizing `identity:create_grant(project_id=138b20881cbe45999d64699abc79c48d, user_id=e8b3e104e7334abdbf9dcedcf68b1ab3, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:48.521880 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700cf77-cc78-4468-8e81-775eb53acba9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:48.543171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 136/266] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:52:48 2022] PUT /identity/v3/projects/138b20881cbe45999d64699abc79c48d/users/e8b3e104e7334abdbf9dcedcf68b1ab3/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:52:48.567793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e12610-dd7e-48c6-b2f9-2698f86fc862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:48.568725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e12610-dd7e-48c6-b2f9-2698f86fc862 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:48.569019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e12610-dd7e-48c6-b2f9-2698f86fc862 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:48.569348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e12610-dd7e-48c6-b2f9-2698f86fc862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:48.651356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e12610-dd7e-48c6-b2f9-2698f86fc862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:48.652909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e12610-dd7e-48c6-b2f9-2698f86fc862 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:48.681338 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:48.718101 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5bf0e-11b3-4da8-ab6d-5e5ceb824a9a None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:48.718417 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5bf0e-11b3-4da8-ab6d-5e5ceb824a9a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:48.718689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5bf0e-11b3-4da8-ab6d-5e5ceb824a9a None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:48.720949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 137/267] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:52:48.726289 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4a3cd-5a90-4fb0-a82d-210ae9ac1d4e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:48.726573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4a3cd-5a90-4fb0-a82d-210ae9ac1d4e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:48.726858 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4a3cd-5a90-4fb0-a82d-210ae9ac1d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:48.744879 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-77c4a3cd-5a90-4fb0-a82d-210ae9ac1d4e None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:48.746147 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-77c4a3cd-5a90-4fb0-a82d-210ae9ac1d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:48.751891 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:48.794589 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 131/268] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 30 11:52:48.801259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e12610-dd7e-48c6-b2f9-2698f86fc862 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:48.895292 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 138/269] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:52:48.958032 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4a3cd-5a90-4fb0-a82d-210ae9ac1d4e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:48.973385 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e12610-dd7e-48c6-b2f9-2698f86fc862 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:49.006444 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:49.019392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de863c27-bc56-421a-8fd2-139d536b37a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:49.020342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de863c27-bc56-421a-8fd2-139d536b37a8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:49.020631 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de863c27-bc56-421a-8fd2-139d536b37a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:49.020909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de863c27-bc56-421a-8fd2-139d536b37a8 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:49.022120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de863c27-bc56-421a-8fd2-139d536b37a8 None admin] RBAC: Authorizing `identity:get_project(project_id=138b20881cbe45999d64699abc79c48d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:49.023571 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de863c27-bc56-421a-8fd2-139d536b37a8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:49.025394 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 132/270] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:48 2022] GET /identity/v3/projects/138b20881cbe45999d64699abc79c48d => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:49.026549 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d93c62-802e-4365-967b-3b78cfb9ca4e None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:49.026837 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d93c62-802e-4365-967b-3b78cfb9ca4e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:49.027116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d93c62-802e-4365-967b-3b78cfb9ca4e None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:49.033168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 133/271] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:49.033168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d93c62-802e-4365-967b-3b78cfb9ca4e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:49.104337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4a3cd-5a90-4fb0-a82d-210ae9ac1d4e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:49.144108 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec02b8-0729-4629-85e4-8508cbfa9e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:49.145309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec02b8-0729-4629-85e4-8508cbfa9e61 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:49.145603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec02b8-0729-4629-85e4-8508cbfa9e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:49.145887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec02b8-0729-4629-85e4-8508cbfa9e61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:49.151507 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d93c62-802e-4365-967b-3b78cfb9ca4e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:49.155295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:49.160560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec02b8-0729-4629-85e4-8508cbfa9e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:49.171711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-a9ec02b8-0729-4629-85e4-8508cbfa9e61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:49.171711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:49.171711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:49.171711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:49.171711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:49.171711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:49.171711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:49.171711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:49.171711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:49.171711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:49.171711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:49.171711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:49.171711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:49.171711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:49.171711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:49.171711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:49.172675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:49.172675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:49.172675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:49.172675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:49.172675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:49.172675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:49.172675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:49.172675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:49.172675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:49.172675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:49.172675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:49.172675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:49.172675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:49.172675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:49.172675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:49.172675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:49.173457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:49.173457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:49.173457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:49.173457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:49.173457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:49.173457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:49.173457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:49.173457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:49.173457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:49.173457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:49.173457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:49.173457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:49.175985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 139/272] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:52:49.178022 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66128a67-631f-4316-bd59-0a9e3a374269 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:49.178457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66128a67-631f-4316-bd59-0a9e3a374269 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:49.178894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66128a67-631f-4316-bd59-0a9e3a374269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:49.196820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20e7f0-14e8-437e-a39d-5963d8e93013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:49.197773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20e7f0-14e8-437e-a39d-5963d8e93013 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:49.198162 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20e7f0-14e8-437e-a39d-5963d8e93013 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:49.198541 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20e7f0-14e8-437e-a39d-5963d8e93013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:49.199515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20e7f0-14e8-437e-a39d-5963d8e93013 None admin] RBAC: Adding query filter params (role.id=d50989dd2d24440f9724d5d7975df7cf, scope.project.id=138b20881cbe45999d64699abc79c48d, user.id=1aadc2d442dd4654a94d5a2ee00a5e61) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:49.199982 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20e7f0-14e8-437e-a39d-5963d8e93013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:49.201623 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20e7f0-14e8-437e-a39d-5963d8e93013 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:49.202053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-66128a67-631f-4316-bd59-0a9e3a374269 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:49.203441 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-66128a67-631f-4316-bd59-0a9e3a374269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:49.215321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 134/273] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:52:49 2022] GET /identity/v3/role_assignments?user.id=1aadc2d442dd4654a94d5a2ee00a5e61&scope.project.id=138b20881cbe45999d64699abc79c48d&role.id=d50989dd2d24440f9724d5d7975df7cf => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:49.216394 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20e7f0-14e8-437e-a39d-5963d8e93013 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:49.289931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 140/274] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:49.291545 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba258549-e405-42a1-83ba-b3f31948ff2f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:49.292003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba258549-e405-42a1-83ba-b3f31948ff2f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:49.292383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba258549-e405-42a1-83ba-b3f31948ff2f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:49.293838 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 141/275] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:49.299359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:49.300604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e49496-0fe6-48ae-9399-145683de2cb8 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:49.301011 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e49496-0fe6-48ae-9399-145683de2cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:49.301493 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e49496-0fe6-48ae-9399-145683de2cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:49.325703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e8e49496-0fe6-48ae-9399-145683de2cb8 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:49.327022 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e8e49496-0fe6-48ae-9399-145683de2cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:49.358422 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20e7f0-14e8-437e-a39d-5963d8e93013 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:49.404199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb871c2f-34e8-4acb-ba04-48ea7ed540f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:49.405403 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb871c2f-34e8-4acb-ba04-48ea7ed540f5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:49.405693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb871c2f-34e8-4acb-ba04-48ea7ed540f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:49.405973 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb871c2f-34e8-4acb-ba04-48ea7ed540f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:49.406983 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb871c2f-34e8-4acb-ba04-48ea7ed540f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:49.407453 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb871c2f-34e8-4acb-ba04-48ea7ed540f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:49.409815 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb871c2f-34e8-4acb-ba04-48ea7ed540f5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:49.421380 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 142/277] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:52:49.423099 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e49496-0fe6-48ae-9399-145683de2cb8 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:49.426183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 135/277] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:49.433279 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb871c2f-34e8-4acb-ba04-48ea7ed540f5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:49.501782 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:49.554914 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e49496-0fe6-48ae-9399-145683de2cb8 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:49.576938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb871c2f-34e8-4acb-ba04-48ea7ed540f5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:49.595681 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:49.596885 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e7233-cdc1-477f-b9a8-27a9adf7c508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:49.597688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7233-cdc1-477f-b9a8-27a9adf7c508 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:49.597976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7233-cdc1-477f-b9a8-27a9adf7c508 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:49.598250 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7233-cdc1-477f-b9a8-27a9adf7c508 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:49.599476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e7233-cdc1-477f-b9a8-27a9adf7c508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:49.601088 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e7233-cdc1-477f-b9a8-27a9adf7c508 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:49.603099 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 143/278] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:52:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:49.603919 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e7233-cdc1-477f-b9a8-27a9adf7c508 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:49.615862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848509a-a767-4e70-814d-1188801e4ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:49.617147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848509a-a767-4e70-814d-1188801e4ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:49.617436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848509a-a767-4e70-814d-1188801e4ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:49.617714 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848509a-a767-4e70-814d-1188801e4ae1 None admin] PATH_INFO: `/v3/users/fcf049de428f46939f950aa8259b42f5` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:49.632975 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848509a-a767-4e70-814d-1188801e4ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=fcf049de428f46939f950aa8259b42f5)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:49.634245 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848509a-a767-4e70-814d-1188801e4ae1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:49.640470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 136/279] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:49 2022] GET /identity/v3/users/fcf049de428f46939f950aa8259b42f5 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:49.640470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848509a-a767-4e70-814d-1188801e4ae1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:49.720070 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e7233-cdc1-477f-b9a8-27a9adf7c508 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:49.744070 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848509a-a767-4e70-814d-1188801e4ae1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:49.747879 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:49.758777 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818ccc1-1a75-4c67-aee7-dc8aa1dad19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:49.759574 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818ccc1-1a75-4c67-aee7-dc8aa1dad19a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:49.759885 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818ccc1-1a75-4c67-aee7-dc8aa1dad19a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:49.760167 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818ccc1-1a75-4c67-aee7-dc8aa1dad19a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:49.770658 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818ccc1-1a75-4c67-aee7-dc8aa1dad19a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:49.778426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-5818ccc1-1a75-4c67-aee7-dc8aa1dad19a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:52:49.778426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:49.778426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:49.778426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:49.778426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:49.778426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:49.778426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:49.778426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:49.778426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:49.778426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:49.778426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:49.778426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:49.778426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:49.778426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:49.778426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:49.778426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:49.779464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:49.779464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:49.779464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:49.779464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:49.779464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:49.779464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:49.779464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:49.779464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:49.779464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:49.779464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:49.779464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:49.779464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:49.779464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:49.779464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:49.779464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:49.779464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:49.780453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:49.780453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:49.780453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:49.780453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:49.780453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:49.780453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:49.780453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:49.780453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:49.780453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:49.780453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:49.780453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:52:49.780453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:49.780453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 144/280] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:49.780453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818ccc1-1a75-4c67-aee7-dc8aa1dad19a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:49.797568 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a2710-f0bd-4cea-9578-985b4a505ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:49.798289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a2710-f0bd-4cea-9578-985b4a505ffa None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:49.798639 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a2710-f0bd-4cea-9578-985b4a505ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:49.799065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a2710-f0bd-4cea-9578-985b4a505ffa None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:49.799932 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a2710-f0bd-4cea-9578-985b4a505ffa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:49.801619 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a2710-f0bd-4cea-9578-985b4a505ffa None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:49.831932 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 137/281] 10.222.0.41 () {60 vars in 1132 bytes} [Mon May 30 11:52:49 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:52:49.831932 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a2710-f0bd-4cea-9578-985b4a505ffa None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:49.884056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:49.926584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818ccc1-1a75-4c67-aee7-dc8aa1dad19a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:49.967546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2776a0a-5327-4c4a-8bea-ab59fc8e8e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:49.968393 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2776a0a-5327-4c4a-8bea-ab59fc8e8e99 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:49.969477 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2776a0a-5327-4c4a-8bea-ab59fc8e8e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:49.970177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2776a0a-5327-4c4a-8bea-ab59fc8e8e99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:49.971102 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2776a0a-5327-4c4a-8bea-ab59fc8e8e99 None admin] RBAC: Adding query filter params (role.id=5674314ace5445ccbca611d8cfdc25f1, user.id=fcf049de428f46939f950aa8259b42f5, scope.system=all) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:49.971422 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2776a0a-5327-4c4a-8bea-ab59fc8e8e99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:49.972954 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2776a0a-5327-4c4a-8bea-ab59fc8e8e99 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:49.983853 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 145/282] 10.222.0.41 () {56 vars in 1308 bytes} [Mon May 30 11:52:49 2022] GET /identity/v3/role_assignments?user.id=fcf049de428f46939f950aa8259b42f5&scope.system=all&role.id=5674314ace5445ccbca611d8cfdc25f1 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:49.993295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a2710-f0bd-4cea-9578-985b4a505ffa None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:50.037858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9121f-ebc4-449f-ae63-28d9d649b517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:50.038568 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9121f-ebc4-449f-ae63-28d9d649b517 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:50.038853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9121f-ebc4-449f-ae63-28d9d649b517 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:50.039128 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9121f-ebc4-449f-ae63-28d9d649b517 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:50.039957 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9121f-ebc4-449f-ae63-28d9d649b517 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:50.040273 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9121f-ebc4-449f-ae63-28d9d649b517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:50.041777 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9121f-ebc4-449f-ae63-28d9d649b517 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:50.053327 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 138/283] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:50.059511 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2776a0a-5327-4c4a-8bea-ab59fc8e8e99 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:50.122311 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:50.190025 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2776a0a-5327-4c4a-8bea-ab59fc8e8e99 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:50.227702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462fd2a-3bbc-4acb-80f0-13d1eddb4796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:50.228644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462fd2a-3bbc-4acb-80f0-13d1eddb4796 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:50.228941 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462fd2a-3bbc-4acb-80f0-13d1eddb4796 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:50.229218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462fd2a-3bbc-4acb-80f0-13d1eddb4796 None admin] PATH_INFO: `/v3/users/db89ea8a71fe49ae84c6cc8b905b13e5` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:50.230520 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462fd2a-3bbc-4acb-80f0-13d1eddb4796 None admin] RBAC: Authorizing `identity:get_user(user_id=db89ea8a71fe49ae84c6cc8b905b13e5)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:50.232000 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462fd2a-3bbc-4acb-80f0-13d1eddb4796 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:50.233786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 146/284] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:50 2022] GET /identity/v3/users/db89ea8a71fe49ae84c6cc8b905b13e5 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:50.240359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9121f-ebc4-449f-ae63-28d9d649b517 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:50.357176 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:50.362155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9121f-ebc4-449f-ae63-28d9d649b517 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:50.400101 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebf358-a09e-4467-8058-1458bcb45522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:50.400964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebf358-a09e-4467-8058-1458bcb45522 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:50.401244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebf358-a09e-4467-8058-1458bcb45522 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:50.401518 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebf358-a09e-4467-8058-1458bcb45522 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:50.402706 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebf358-a09e-4467-8058-1458bcb45522 None admin] RBAC: Authorizing `identity:get_project(project_id=138b20881cbe45999d64699abc79c48d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:50.404182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebf358-a09e-4467-8058-1458bcb45522 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:50.405884 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 139/285] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:50 2022] GET /identity/v3/projects/138b20881cbe45999d64699abc79c48d => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:50.412719 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462fd2a-3bbc-4acb-80f0-13d1eddb4796 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:50.523087 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462fd2a-3bbc-4acb-80f0-13d1eddb4796 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:50.541591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:50.568600 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d3846-2236-4e1a-b471-436c68809204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:50.569857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d3846-2236-4e1a-b471-436c68809204 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:50.570363 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d3846-2236-4e1a-b471-436c68809204 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:50.570841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d3846-2236-4e1a-b471-436c68809204 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d/users/db89ea8a71fe49ae84c6cc8b905b13e5/roles/9742d46a027d4a4a8066c058e5ee5316` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:50.577148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d3846-2236-4e1a-b471-436c68809204 None admin] RBAC: Authorizing `identity:create_grant(project_id=138b20881cbe45999d64699abc79c48d, user_id=db89ea8a71fe49ae84c6cc8b905b13e5, role_id=9742d46a027d4a4a8066c058e5ee5316)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:50.579723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d3846-2236-4e1a-b471-436c68809204 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:50.610916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 147/286] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:52:50 2022] PUT /identity/v3/projects/138b20881cbe45999d64699abc79c48d/users/db89ea8a71fe49ae84c6cc8b905b13e5/roles/9742d46a027d4a4a8066c058e5ee5316 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:52:51.341885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335ba98-30b0-484e-b084-438eb478fbf5 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:51.342396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335ba98-30b0-484e-b084-438eb478fbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:51.342502 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335ba98-30b0-484e-b084-438eb478fbf5 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:51.344573 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 140/287] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:51.350067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c489a5-6874-4585-927b-1c5f95a4b759 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:51.350497 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c489a5-6874-4585-927b-1c5f95a4b759 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:51.350672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c489a5-6874-4585-927b-1c5f95a4b759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:51.376803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a9c489a5-6874-4585-927b-1c5f95a4b759 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:51.378005 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a9c489a5-6874-4585-927b-1c5f95a4b759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:51.477171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 148/288] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:51.513295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335ba98-30b0-484e-b084-438eb478fbf5 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:51.638785 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335ba98-30b0-484e-b084-438eb478fbf5 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:51.677218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19770f8-e9e1-45b2-ae90-9d184579ebd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:51.678449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19770f8-e9e1-45b2-ae90-9d184579ebd4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:51.678928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19770f8-e9e1-45b2-ae90-9d184579ebd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:51.679463 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19770f8-e9e1-45b2-ae90-9d184579ebd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:51.691152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19770f8-e9e1-45b2-ae90-9d184579ebd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:51.699204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-c19770f8-e9e1-45b2-ae90-9d184579ebd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:51.699204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:51.699204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:51.699204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:51.699204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:51.699204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:51.699204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:51.699204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:51.699204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:51.699204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:51.699204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:51.699204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:51.699204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:51.699204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:51.699204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:51.699204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:51.700056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:51.700056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:51.700056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:51.700056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:51.700056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:51.700056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:51.700056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:51.700056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:51.700056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:51.700056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:51.700056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:51.700056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:51.700056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:51.700056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:51.700056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:51.700056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:51.700847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:51.700847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:51.700847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:51.700847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:51.700847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:51.700847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:51.700847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:51.700847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:51.700847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:51.700847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:51.700847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:51.700847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:51.707969 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 141/289] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:51.710166 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c489a5-6874-4585-927b-1c5f95a4b759 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:51.838477 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c489a5-6874-4585-927b-1c5f95a4b759 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:51.848609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:51.887196 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c044214-16e3-4eb3-9139-119be4192839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:51.888186 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c044214-16e3-4eb3-9139-119be4192839 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:51.888662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c044214-16e3-4eb3-9139-119be4192839 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:51.889174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c044214-16e3-4eb3-9139-119be4192839 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:51.890123 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c044214-16e3-4eb3-9139-119be4192839 None admin] RBAC: Adding query filter params (name=member) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:51.891625 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c044214-16e3-4eb3-9139-119be4192839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:51.893219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c044214-16e3-4eb3-9139-119be4192839 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:51.902917 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 149/290] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:51.910499 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19770f8-e9e1-45b2-ae90-9d184579ebd4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:51.952547 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:52.033822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19770f8-e9e1-45b2-ae90-9d184579ebd4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:52.069895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d640936-26fc-4fe3-b106-3168cdd0c44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:52.071853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d640936-26fc-4fe3-b106-3168cdd0c44a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:52.072658 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d640936-26fc-4fe3-b106-3168cdd0c44a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:52.073583 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d640936-26fc-4fe3-b106-3168cdd0c44a None admin] PATH_INFO: `/v3/users/e8b3e104e7334abdbf9dcedcf68b1ab3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:52.076040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d640936-26fc-4fe3-b106-3168cdd0c44a None admin] RBAC: Authorizing `identity:get_user(user_id=e8b3e104e7334abdbf9dcedcf68b1ab3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:52.079511 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d640936-26fc-4fe3-b106-3168cdd0c44a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:52.081781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 142/291] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:51 2022] GET /identity/v3/users/e8b3e104e7334abdbf9dcedcf68b1ab3 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:52.087386 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c044214-16e3-4eb3-9139-119be4192839 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:52.223551 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c044214-16e3-4eb3-9139-119be4192839 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:52.273722 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf501f9-774c-4a32-9530-32c3dc83b053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:52.274377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf501f9-774c-4a32-9530-32c3dc83b053 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:52.274663 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf501f9-774c-4a32-9530-32c3dc83b053 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:52.274942 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf501f9-774c-4a32-9530-32c3dc83b053 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:52.335854 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:52.376728 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf501f9-774c-4a32-9530-32c3dc83b053 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:52.379034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf501f9-774c-4a32-9530-32c3dc83b053 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:52.502932 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 150/292] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:52:52.508804 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d640936-26fc-4fe3-b106-3168cdd0c44a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:52.616593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:52.628639 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d640936-26fc-4fe3-b106-3168cdd0c44a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:52.667474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ba417-5f28-43a2-a99e-fb5236994fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:52.668787 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ba417-5f28-43a2-a99e-fb5236994fbc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:52.669279 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ba417-5f28-43a2-a99e-fb5236994fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:52.669779 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ba417-5f28-43a2-a99e-fb5236994fbc None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:52.671277 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ba417-5f28-43a2-a99e-fb5236994fbc None admin] RBAC: Authorizing `identity:get_project(project_id=138b20881cbe45999d64699abc79c48d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:52.673619 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ba417-5f28-43a2-a99e-fb5236994fbc None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:52.675917 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 143/293] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:52 2022] GET /identity/v3/projects/138b20881cbe45999d64699abc79c48d => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:52.682025 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf501f9-774c-4a32-9530-32c3dc83b053 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:52.780196 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:52.813761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf501f9-774c-4a32-9530-32c3dc83b053 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:52.857902 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa2c54-b1c5-40d7-986e-41649c52b799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:52.858563 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa2c54-b1c5-40d7-986e-41649c52b799 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:52.858851 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa2c54-b1c5-40d7-986e-41649c52b799 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:52.859290 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa2c54-b1c5-40d7-986e-41649c52b799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:52.860203 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa2c54-b1c5-40d7-986e-41649c52b799 None admin] RBAC: Adding query filter params (role.id=5674314ace5445ccbca611d8cfdc25f1, scope.project.id=138b20881cbe45999d64699abc79c48d, user.id=e8b3e104e7334abdbf9dcedcf68b1ab3) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:52.860527 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa2c54-b1c5-40d7-986e-41649c52b799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:52.861978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa2c54-b1c5-40d7-986e-41649c52b799 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:52.868462 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 151/294] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:52:52 2022] GET /identity/v3/role_assignments?user.id=e8b3e104e7334abdbf9dcedcf68b1ab3&scope.project.id=138b20881cbe45999d64699abc79c48d&role.id=5674314ace5445ccbca611d8cfdc25f1 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:52.924865 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172d3c4-426d-4b90-8236-0365ba7fbec1 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:52.925238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172d3c4-426d-4b90-8236-0365ba7fbec1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:52.925437 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172d3c4-426d-4b90-8236-0365ba7fbec1 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:52.926811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 144/295] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:52.932564 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b6977-4a0a-4e4e-8193-cb65cfffb59d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:52.932851 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b6977-4a0a-4e4e-8193-cb65cfffb59d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:52.933141 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b6977-4a0a-4e4e-8193-cb65cfffb59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:52.957958 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-494b6977-4a0a-4e4e-8193-cb65cfffb59d None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:52.959198 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-494b6977-4a0a-4e4e-8193-cb65cfffb59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:53.004076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e59d6-3e80-42f0-a263-d76223d03492 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:53.004386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e59d6-3e80-42f0-a263-d76223d03492 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:53.004651 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e59d6-3e80-42f0-a263-d76223d03492 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:53.006373 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 145/296] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:53.012985 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1974dd-62f4-4340-bcbf-b4ed7834b96c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:53.013277 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1974dd-62f4-4340-bcbf-b4ed7834b96c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:53.013556 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1974dd-62f4-4340-bcbf-b4ed7834b96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:53.041632 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8e1974dd-62f4-4340-bcbf-b4ed7834b96c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:53.042777 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8e1974dd-62f4-4340-bcbf-b4ed7834b96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:53.094766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 152/297] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:53.096349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1e4b8-6879-4bb2-9ea2-1fcf230de8f9 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:53.096647 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1e4b8-6879-4bb2-9ea2-1fcf230de8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:53.096933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1e4b8-6879-4bb2-9ea2-1fcf230de8f9 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:53.098365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 153/298] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:53.117633 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c912923-d3d0-4e15-9b52-5d1e9493af5d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:53.117922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c912923-d3d0-4e15-9b52-5d1e9493af5d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:53.118206 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c912923-d3d0-4e15-9b52-5d1e9493af5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:53.139545 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5c912923-d3d0-4e15-9b52-5d1e9493af5d None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:53.141934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5c912923-d3d0-4e15-9b52-5d1e9493af5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:53.149229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 146/299] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:53.150090 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1974dd-62f4-4340-bcbf-b4ed7834b96c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:53.225769 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:53.237766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 154/300] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:53.238613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c912923-d3d0-4e15-9b52-5d1e9493af5d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:53.261706 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:53.274574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1974dd-62f4-4340-bcbf-b4ed7834b96c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:53.319245 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917b598-9af6-4786-b7e5-c7c08f73f998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:53.320018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917b598-9af6-4786-b7e5-c7c08f73f998 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:53.320335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917b598-9af6-4786-b7e5-c7c08f73f998 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:53.320587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917b598-9af6-4786-b7e5-c7c08f73f998 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:53.333515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917b598-9af6-4786-b7e5-c7c08f73f998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:53.341383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7917b598-9af6-4786-b7e5-c7c08f73f998 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:53.341383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:53.341383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:53.341383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:53.341383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:53.341383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:53.341383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:53.341383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:53.341383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:53.341383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:53.341383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:53.341383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:53.341383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:53.341383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:53.341383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:53.341383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:53.342264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:53.342264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:53.342264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:53.342264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:53.342264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:53.342264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:53.342264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:53.342264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:53.342264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:53.342264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:53.342264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:53.342264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:53.342264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:53.342264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:53.342264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:53.342264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:53.343066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:53.343066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:53.343066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:53.343066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:53.343066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:53.343066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:53.343066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:53.343066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:53.343066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:53.343066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:53.343066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:53.343066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:53.343066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 147/301] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:53.343902 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917b598-9af6-4786-b7e5-c7c08f73f998 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:53.353966 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c912923-d3d0-4e15-9b52-5d1e9493af5d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:53.392086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5170d-3b57-447f-85a5-54d5204135e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:53.392892 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5170d-3b57-447f-85a5-54d5204135e9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:53.393182 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5170d-3b57-447f-85a5-54d5204135e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:53.393462 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5170d-3b57-447f-85a5-54d5204135e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:53.404001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5170d-3b57-447f-85a5-54d5204135e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:53.411881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-7ab5170d-3b57-447f-85a5-54d5204135e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:52:53.411881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:53.411881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:53.411881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:53.411881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:53.411881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:53.411881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:53.411881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:53.411881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:53.411881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:53.411881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:53.411881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:53.411881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:53.411881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:53.411881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:53.411881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:53.412781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:53.412781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:53.412781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:53.412781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:53.412781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:53.412781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:53.412781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:53.412781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:53.412781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:53.412781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:53.412781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:53.412781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:53.412781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:53.412781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:53.412781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:53.412781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:53.413542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:53.413542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:53.413542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:53.413542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:53.413542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:53.413542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:53.413542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:53.413542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:53.413542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:53.413542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:53.413542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:52:53.413542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:53.413542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 155/302] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:53.414194 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5170d-3b57-447f-85a5-54d5204135e9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:53.456120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917b598-9af6-4786-b7e5-c7c08f73f998 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:53.481163 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:53.498330 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd38e3-73ff-4bd7-b8cf-68ccfada1408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:53.499411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd38e3-73ff-4bd7-b8cf-68ccfada1408 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:53.499698 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd38e3-73ff-4bd7-b8cf-68ccfada1408 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:53.500155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd38e3-73ff-4bd7-b8cf-68ccfada1408 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:53.504886 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd38e3-73ff-4bd7-b8cf-68ccfada1408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:53.506354 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd38e3-73ff-4bd7-b8cf-68ccfada1408 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:53.508188 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 148/303] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:52:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:53.513365 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd38e3-73ff-4bd7-b8cf-68ccfada1408 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:53.529349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5170d-3b57-447f-85a5-54d5204135e9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:53.533695 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:53.570026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217053d-6efd-4bec-ac56-be04499b2506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:53.570922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217053d-6efd-4bec-ac56-be04499b2506 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:53.571375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217053d-6efd-4bec-ac56-be04499b2506 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:53.571950 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217053d-6efd-4bec-ac56-be04499b2506 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:53.572783 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217053d-6efd-4bec-ac56-be04499b2506 None admin] RBAC: Adding query filter params (name=member) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:53.573099 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217053d-6efd-4bec-ac56-be04499b2506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:53.574714 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217053d-6efd-4bec-ac56-be04499b2506 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:53.584317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 156/304] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:53.584934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217053d-6efd-4bec-ac56-be04499b2506 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:53.628159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd38e3-73ff-4bd7-b8cf-68ccfada1408 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:53.662615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991d211-42e7-4ee8-8f80-77de564d47d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:53.663283 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991d211-42e7-4ee8-8f80-77de564d47d1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:53.663578 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991d211-42e7-4ee8-8f80-77de564d47d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:53.663888 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991d211-42e7-4ee8-8f80-77de564d47d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:53.664644 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991d211-42e7-4ee8-8f80-77de564d47d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:53.664958 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991d211-42e7-4ee8-8f80-77de564d47d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:53.666345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991d211-42e7-4ee8-8f80-77de564d47d1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:53.674653 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 149/305] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:53.679259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991d211-42e7-4ee8-8f80-77de564d47d1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:53.689667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217053d-6efd-4bec-ac56-be04499b2506 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:53.705891 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:53.723678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465b486-3374-4104-a3b5-9ea6ac844062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:53.724368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465b486-3374-4104-a3b5-9ea6ac844062 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:53.724662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465b486-3374-4104-a3b5-9ea6ac844062 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:53.724943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465b486-3374-4104-a3b5-9ea6ac844062 None admin] PATH_INFO: `/v3/groups` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:53.725633 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465b486-3374-4104-a3b5-9ea6ac844062 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:53.727113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465b486-3374-4104-a3b5-9ea6ac844062 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:53.741076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 157/306] 10.222.0.41 () {60 vars in 1134 bytes} [Mon May 30 11:52:53 2022] POST /identity/v3/groups => generated 229 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:52:53.742398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46458d8-151a-4b59-8e52-afc1ac03d4c8 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:53.742699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46458d8-151a-4b59-8e52-afc1ac03d4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:53.742986 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46458d8-151a-4b59-8e52-afc1ac03d4c8 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:53.744264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 158/307] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:53.744982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46458d8-151a-4b59-8e52-afc1ac03d4c8 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:53.771307 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:53.792434 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991d211-42e7-4ee8-8f80-77de564d47d1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:53.833546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed382976-4b38-42c8-9931-ceec6ac0e9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:53.834526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed382976-4b38-42c8-9931-ceec6ac0e9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:53.835167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed382976-4b38-42c8-9931-ceec6ac0e9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:53.835595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed382976-4b38-42c8-9931-ceec6ac0e9d0 None admin] PATH_INFO: `/v3/users/fcf049de428f46939f950aa8259b42f5` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:53.837066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed382976-4b38-42c8-9931-ceec6ac0e9d0 None admin] RBAC: Authorizing `identity:get_user(user_id=fcf049de428f46939f950aa8259b42f5)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:53.838759 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed382976-4b38-42c8-9931-ceec6ac0e9d0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:53.841567 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 150/308] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:53 2022] GET /identity/v3/users/fcf049de428f46939f950aa8259b42f5 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:53.842822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a6130-39f7-475d-a897-4259a6cfdec9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:53.843123 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a6130-39f7-475d-a897-4259a6cfdec9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:53.843405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a6130-39f7-475d-a897-4259a6cfdec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:53.865740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a48a6130-39f7-475d-a897-4259a6cfdec9 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:53.866987 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a48a6130-39f7-475d-a897-4259a6cfdec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:53.880837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46458d8-151a-4b59-8e52-afc1ac03d4c8 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:53.917297 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a279f4-1e1a-43ce-9b73-6be8b2eefe35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:53.918196 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a279f4-1e1a-43ce-9b73-6be8b2eefe35 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:53.918483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a279f4-1e1a-43ce-9b73-6be8b2eefe35 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:53.918763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a279f4-1e1a-43ce-9b73-6be8b2eefe35 None admin] PATH_INFO: `/v3/users/370ad1d42a6947d3ba134ec5336fcf53` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:53.933931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a279f4-1e1a-43ce-9b73-6be8b2eefe35 None admin] RBAC: Authorizing `identity:get_user(user_id=370ad1d42a6947d3ba134ec5336fcf53)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:53.935407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a279f4-1e1a-43ce-9b73-6be8b2eefe35 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:53.937176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 159/309] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:53 2022] GET /identity/v3/users/370ad1d42a6947d3ba134ec5336fcf53 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:53.938314 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a279f4-1e1a-43ce-9b73-6be8b2eefe35 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:53.962198 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 151/310] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:53.962895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a6130-39f7-475d-a897-4259a6cfdec9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:53.978948 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:54.049727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a279f4-1e1a-43ce-9b73-6be8b2eefe35 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:54.063555 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:54.088197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b4d68-746b-43f8-89bd-950e0d49f7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:54.088889 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a6130-39f7-475d-a897-4259a6cfdec9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:54.089009 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b4d68-746b-43f8-89bd-950e0d49f7d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:54.089250 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b4d68-746b-43f8-89bd-950e0d49f7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:54.089521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b4d68-746b-43f8-89bd-950e0d49f7d9 None admin] PATH_INFO: `/v3/system/users/fcf049de428f46939f950aa8259b42f5/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:54.091732 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b4d68-746b-43f8-89bd-950e0d49f7d9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fcf049de428f46939f950aa8259b42f5, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:54.093120 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b4d68-746b-43f8-89bd-950e0d49f7d9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:54.103208 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 160/311] 10.222.0.41 () {58 vars in 1334 bytes} [Mon May 30 11:52:53 2022] PUT /identity/v3/system/users/fcf049de428f46939f950aa8259b42f5/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:52:54.104443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b4d68-746b-43f8-89bd-950e0d49f7d9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:54.146172 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466156e7-22f0-48e5-8758-63988c11c32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:54.146861 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466156e7-22f0-48e5-8758-63988c11c32c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:54.147135 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466156e7-22f0-48e5-8758-63988c11c32c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:54.147413 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466156e7-22f0-48e5-8758-63988c11c32c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:54.148364 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466156e7-22f0-48e5-8758-63988c11c32c None admin] RBAC: Adding query filter params (role.id=9742d46a027d4a4a8066c058e5ee5316, user.id=370ad1d42a6947d3ba134ec5336fcf53, scope.system=all) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:54.148738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466156e7-22f0-48e5-8758-63988c11c32c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:54.150287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466156e7-22f0-48e5-8758-63988c11c32c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:54.156429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 152/312] 10.222.0.41 () {56 vars in 1308 bytes} [Mon May 30 11:52:53 2022] GET /identity/v3/role_assignments?user.id=370ad1d42a6947d3ba134ec5336fcf53&scope.system=all&role.id=9742d46a027d4a4a8066c058e5ee5316 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:54.256961 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:54.260935 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b4d68-746b-43f8-89bd-950e0d49f7d9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:54.303980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8ffed-1264-4c1a-b71f-e695d774bb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:54.304851 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8ffed-1264-4c1a-b71f-e695d774bb33 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:54.305135 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8ffed-1264-4c1a-b71f-e695d774bb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:54.305410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8ffed-1264-4c1a-b71f-e695d774bb33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:54.317885 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8ffed-1264-4c1a-b71f-e695d774bb33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:54.326003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-43f8ffed-1264-4c1a-b71f-e695d774bb33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:52:54.326003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:54.326003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:54.326003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:54.326003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:54.326003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:54.326003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:54.326003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:54.326003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:54.326003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:54.326003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:54.326003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:54.326003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:54.326003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:54.326003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:54.326003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:54.326947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:54.326947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:54.326947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:54.326947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:54.326947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:54.326947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:54.326947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:54.326947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:54.326947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:54.326947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:54.326947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:54.326947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:54.326947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:54.326947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:54.326947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:54.326947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:54.328542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:54.328542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:54.328542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:54.328542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:54.328542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:54.328542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:54.328542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:54.328542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:54.328542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:54.328542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:54.328542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:52:54.328542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:54.328542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 161/313] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:54.334183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466156e7-22f0-48e5-8758-63988c11c32c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:54.446613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466156e7-22f0-48e5-8758-63988c11c32c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:54.482287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924ec96-8892-4dd8-9cb5-52f6447de4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:54.482964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924ec96-8892-4dd8-9cb5-52f6447de4ce None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:54.483245 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924ec96-8892-4dd8-9cb5-52f6447de4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:54.483516 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924ec96-8892-4dd8-9cb5-52f6447de4ce None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:54.484939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924ec96-8892-4dd8-9cb5-52f6447de4ce None admin] RBAC: Adding query filter params (name=reader) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:54.485249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924ec96-8892-4dd8-9cb5-52f6447de4ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:54.486723 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924ec96-8892-4dd8-9cb5-52f6447de4ce None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:54.495468 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 153/314] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:54.501417 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8ffed-1264-4c1a-b71f-e695d774bb33 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:54.604326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8ffed-1264-4c1a-b71f-e695d774bb33 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:54.643130 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6854a-4c30-4b6c-8b75-e7b5dfb4f8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:54.644402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6854a-4c30-4b6c-8b75-e7b5dfb4f8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:54.644925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6854a-4c30-4b6c-8b75-e7b5dfb4f8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:54.645424 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6854a-4c30-4b6c-8b75-e7b5dfb4f8d2 None admin] PATH_INFO: `/v3/users/db89ea8a71fe49ae84c6cc8b905b13e5` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:54.646831 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6854a-4c30-4b6c-8b75-e7b5dfb4f8d2 None admin] RBAC: Authorizing `identity:get_user(user_id=db89ea8a71fe49ae84c6cc8b905b13e5)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:54.648516 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6854a-4c30-4b6c-8b75-e7b5dfb4f8d2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:54.650705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 162/315] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:54 2022] GET /identity/v3/users/db89ea8a71fe49ae84c6cc8b905b13e5 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:54.655897 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924ec96-8892-4dd8-9cb5-52f6447de4ce None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:54.659175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:54.767581 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924ec96-8892-4dd8-9cb5-52f6447de4ce None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:54.801926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc232a4b-5f6f-4708-9657-63bdd9b9a778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:54.802632 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc232a4b-5f6f-4708-9657-63bdd9b9a778 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:54.802914 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc232a4b-5f6f-4708-9657-63bdd9b9a778 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:54.803229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc232a4b-5f6f-4708-9657-63bdd9b9a778 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:54.874493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc232a4b-5f6f-4708-9657-63bdd9b9a778 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:54.876602 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc232a4b-5f6f-4708-9657-63bdd9b9a778 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:54.878415 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:54.981550 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 154/316] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:52:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:52:54.987528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6854a-4c30-4b6c-8b75-e7b5dfb4f8d2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:55.016393 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:55.092575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6854a-4c30-4b6c-8b75-e7b5dfb4f8d2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:55.131147 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffb2c7-daee-4cc6-87aa-713daabe3600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:55.132040 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffb2c7-daee-4cc6-87aa-713daabe3600 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:55.132330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffb2c7-daee-4cc6-87aa-713daabe3600 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:55.132610 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffb2c7-daee-4cc6-87aa-713daabe3600 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:55.133808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffb2c7-daee-4cc6-87aa-713daabe3600 None admin] RBAC: Authorizing `identity:get_project(project_id=138b20881cbe45999d64699abc79c48d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:55.135277 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffb2c7-daee-4cc6-87aa-713daabe3600 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:55.138248 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 163/317] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:52:54 2022] GET /identity/v3/projects/138b20881cbe45999d64699abc79c48d => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:55.143886 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc232a4b-5f6f-4708-9657-63bdd9b9a778 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:55.243152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc232a4b-5f6f-4708-9657-63bdd9b9a778 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:55.244689 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:55.279034 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b21b56-b6b1-47af-866b-118c87c4c7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:55.279698 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b21b56-b6b1-47af-866b-118c87c4c7ed None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:55.280011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b21b56-b6b1-47af-866b-118c87c4c7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:55.280287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b21b56-b6b1-47af-866b-118c87c4c7ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:55.281622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b21b56-b6b1-47af-866b-118c87c4c7ed None admin] RBAC: Adding query filter params (role.id=9742d46a027d4a4a8066c058e5ee5316, scope.project.id=138b20881cbe45999d64699abc79c48d, user.id=db89ea8a71fe49ae84c6cc8b905b13e5) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:55.281937 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b21b56-b6b1-47af-866b-118c87c4c7ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:55.283463 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b21b56-b6b1-47af-866b-118c87c4c7ed None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:55.289683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 155/318] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:52:55 2022] GET /identity/v3/role_assignments?user.id=db89ea8a71fe49ae84c6cc8b905b13e5&scope.project.id=138b20881cbe45999d64699abc79c48d&role.id=9742d46a027d4a4a8066c058e5ee5316 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:56.129654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a95c13-4cfd-4ff0-87a6-e5d0f9a7e6be None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:56.130176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a95c13-4cfd-4ff0-87a6-e5d0f9a7e6be None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:56.130176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a95c13-4cfd-4ff0-87a6-e5d0f9a7e6be None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:56.131477 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 164/319] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:56.136788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4af157-6ce6-43a0-b194-6d669a8fb209 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:56.137176 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4af157-6ce6-43a0-b194-6d669a8fb209 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:56.137338 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4af157-6ce6-43a0-b194-6d669a8fb209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:56.154810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6a4af157-6ce6-43a0-b194-6d669a8fb209 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:56.156933 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6a4af157-6ce6-43a0-b194-6d669a8fb209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:56.238279 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 156/320] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:56.261600 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a95c13-4cfd-4ff0-87a6-e5d0f9a7e6be None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:56.359617 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:56.368570 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a95c13-4cfd-4ff0-87a6-e5d0f9a7e6be None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:56.402546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0b502-62ef-4589-b80c-dda66fa9a0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:56.403345 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0b502-62ef-4589-b80c-dda66fa9a0cb None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:56.403632 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0b502-62ef-4589-b80c-dda66fa9a0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:56.403941 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0b502-62ef-4589-b80c-dda66fa9a0cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:56.405109 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0b502-62ef-4589-b80c-dda66fa9a0cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:56.407205 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0b502-62ef-4589-b80c-dda66fa9a0cb None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:56.409031 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 165/321] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:52:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:56.414601 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4af157-6ce6-43a0-b194-6d669a8fb209 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:56.515836 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:56.523187 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4af157-6ce6-43a0-b194-6d669a8fb209 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:56.527342 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644e460-d961-4fcc-b6ce-2f6a5677970d None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:56.527639 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644e460-d961-4fcc-b6ce-2f6a5677970d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:56.528058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644e460-d961-4fcc-b6ce-2f6a5677970d None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:56.529789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 166/322] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:56.532858 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e144e-b056-4ddb-a9c2-a19d539e5b17 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:56.533152 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e144e-b056-4ddb-a9c2-a19d539e5b17 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:56.533434 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e144e-b056-4ddb-a9c2-a19d539e5b17 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:56.534813 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 167/323] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:56.536026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f662e-cdaf-4763-83ad-fc450a434a73 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:56.536318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f662e-cdaf-4763-83ad-fc450a434a73 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:56.536602 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f662e-cdaf-4763-83ad-fc450a434a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:56.553176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0a8f662e-cdaf-4763-83ad-fc450a434a73 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:56.554382 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0a8f662e-cdaf-4763-83ad-fc450a434a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:56.558427 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac6779-56aa-4d7a-8059-02caac7bca97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:56.559097 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac6779-56aa-4d7a-8059-02caac7bca97 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:56.559382 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac6779-56aa-4d7a-8059-02caac7bca97 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:56.559656 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac6779-56aa-4d7a-8059-02caac7bca97 None admin] PATH_INFO: `/v3/groups` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:56.560372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac6779-56aa-4d7a-8059-02caac7bca97 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:56.561809 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac6779-56aa-4d7a-8059-02caac7bca97 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:56.577331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 157/324] 10.222.0.41 () {60 vars in 1134 bytes} [Mon May 30 11:52:56 2022] POST /identity/v3/groups => generated 226 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:52:56.579572 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b570ad-d6e5-4e58-b905-755ba31ab7db None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:56.579887 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b570ad-d6e5-4e58-b905-755ba31ab7db None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:56.580376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b570ad-d6e5-4e58-b905-755ba31ab7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:56.597928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f4b570ad-d6e5-4e58-b905-755ba31ab7db None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:56.599159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f4b570ad-d6e5-4e58-b905-755ba31ab7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:56.642510 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 168/325] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:56.666489 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f662e-cdaf-4763-83ad-fc450a434a73 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:56.679852 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 158/326] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:56.704451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b570ad-d6e5-4e58-b905-755ba31ab7db None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:56.782098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:56.796367 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f662e-cdaf-4763-83ad-fc450a434a73 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:56.806846 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:56.826039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b570ad-d6e5-4e58-b905-755ba31ab7db None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:56.835043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d09213-4ef0-4798-af2c-7d012fb0c723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:56.836495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d09213-4ef0-4798-af2c-7d012fb0c723 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:56.836495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d09213-4ef0-4798-af2c-7d012fb0c723 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:56.836495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d09213-4ef0-4798-af2c-7d012fb0c723 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:56.847800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d09213-4ef0-4798-af2c-7d012fb0c723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:56.855611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-a8d09213-4ef0-4798-af2c-7d012fb0c723 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:56.855611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:56.855611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:56.855611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:56.855611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:56.855611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:56.855611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:56.855611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:56.855611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:56.855611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:56.855611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:56.855611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:56.855611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:56.855611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:56.855611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:56.855611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:56.856576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:56.856576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:56.856576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:56.856576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:56.856576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:56.856576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:56.856576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:56.856576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:56.856576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:56.856576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:56.856576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:56.856576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:56.856576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:56.856576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:56.856576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:56.856576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:56.857375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:56.857375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:56.857375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:56.857375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:56.857375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:56.857375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:56.857375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:56.857375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:56.857375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:56.857375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:56.857375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:52:56.857375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:56.857375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 169/327] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:52:56.863643 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d09213-4ef0-4798-af2c-7d012fb0c723 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:56.873197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda598a-49b7-4bf3-b3a7-5fcff94f906f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:56.874274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda598a-49b7-4bf3-b3a7-5fcff94f906f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:56.875802 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda598a-49b7-4bf3-b3a7-5fcff94f906f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:56.876344 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda598a-49b7-4bf3-b3a7-5fcff94f906f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:56.889408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda598a-49b7-4bf3-b3a7-5fcff94f906f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:56.899199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-9bda598a-49b7-4bf3-b3a7-5fcff94f906f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:52:56.899199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:56.899199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:56.899199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:56.899199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:56.899199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:56.899199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:56.899199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:56.899199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:56.899199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:56.899199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:56.899199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:56.899199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:56.899199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:56.899199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:56.899199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:56.900126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:56.900126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:56.900126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:56.900126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:56.900126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:56.900126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:56.900126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:56.900126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:56.900126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:56.900126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:56.900126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:56.900126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:52:56.900126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:56.900126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:56.900126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:56.900126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:56.900901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:56.900901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:56.900901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:56.900901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:56.900901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:56.900901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:56.900901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:56.900901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:56.900901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:56.900901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:56.900901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:52:56.900901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:52:56.900901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 159/328] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:52:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:56.908691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda598a-49b7-4bf3-b3a7-5fcff94f906f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:57.005511 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d09213-4ef0-4798-af2c-7d012fb0c723 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:57.039464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda598a-49b7-4bf3-b3a7-5fcff94f906f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:57.046034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8173be2-2778-4c53-9f53-b217a69a7055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:57.048297 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8173be2-2778-4c53-9f53-b217a69a7055 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:57.049253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8173be2-2778-4c53-9f53-b217a69a7055 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:57.049450 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8173be2-2778-4c53-9f53-b217a69a7055 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:57.051760 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8173be2-2778-4c53-9f53-b217a69a7055 None admin] RBAC: Adding query filter params (name=member) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:57.051760 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8173be2-2778-4c53-9f53-b217a69a7055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:57.052816 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8173be2-2778-4c53-9f53-b217a69a7055 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:57.065721 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 170/329] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:57.072533 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8173be2-2778-4c53-9f53-b217a69a7055 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:57.086572 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e346e2-614b-4896-9243-a15780c49d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:57.087373 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e346e2-614b-4896-9243-a15780c49d96 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:57.087661 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e346e2-614b-4896-9243-a15780c49d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:57.087978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e346e2-614b-4896-9243-a15780c49d96 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:57.088749 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e346e2-614b-4896-9243-a15780c49d96 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:57.089066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e346e2-614b-4896-9243-a15780c49d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:57.090620 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e346e2-614b-4896-9243-a15780c49d96 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:57.091312 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:57.102725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 160/330] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:52:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:57.108353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e346e2-614b-4896-9243-a15780c49d96 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:57.120054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:57.199498 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8173be2-2778-4c53-9f53-b217a69a7055 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:57.228656 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e346e2-614b-4896-9243-a15780c49d96 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:57.238552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220d051-825e-424e-b7b0-68a1f70170d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:57.239651 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220d051-825e-424e-b7b0-68a1f70170d1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:57.240210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220d051-825e-424e-b7b0-68a1f70170d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:57.240649 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220d051-825e-424e-b7b0-68a1f70170d1 None admin] PATH_INFO: `/v3/users/fcf049de428f46939f950aa8259b42f5` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:57.242009 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220d051-825e-424e-b7b0-68a1f70170d1 None admin] RBAC: Authorizing `identity:get_user(user_id=fcf049de428f46939f950aa8259b42f5)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:57.243781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220d051-825e-424e-b7b0-68a1f70170d1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:57.245850 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 171/331] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:57 2022] GET /identity/v3/users/fcf049de428f46939f950aa8259b42f5 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:57.255986 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220d051-825e-424e-b7b0-68a1f70170d1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:57.280637 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd051df-ad20-44a8-8f30-0633756643e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:57.282355 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd051df-ad20-44a8-8f30-0633756643e2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:57.282676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd051df-ad20-44a8-8f30-0633756643e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:57.283056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd051df-ad20-44a8-8f30-0633756643e2 None admin] PATH_INFO: `/v3/users/370ad1d42a6947d3ba134ec5336fcf53` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:57.285203 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd051df-ad20-44a8-8f30-0633756643e2 None admin] RBAC: Authorizing `identity:get_user(user_id=370ad1d42a6947d3ba134ec5336fcf53)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:57.286716 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd051df-ad20-44a8-8f30-0633756643e2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:57.288915 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 161/332] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:52:57 2022] GET /identity/v3/users/370ad1d42a6947d3ba134ec5336fcf53 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:52:57.294117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd051df-ad20-44a8-8f30-0633756643e2 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:57.368998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:57.391161 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220d051-825e-424e-b7b0-68a1f70170d1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:57.407797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:57.444485 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780995f-7005-4b2e-b491-706902f08479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:57.445664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780995f-7005-4b2e-b491-706902f08479 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:57.445950 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780995f-7005-4b2e-b491-706902f08479 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:57.446226 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780995f-7005-4b2e-b491-706902f08479 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:57.447075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780995f-7005-4b2e-b491-706902f08479 None admin] RBAC: Adding query filter params (role.id=5674314ace5445ccbca611d8cfdc25f1, user.id=fcf049de428f46939f950aa8259b42f5, scope.system=all) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:52:57.447389 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780995f-7005-4b2e-b491-706902f08479 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:57.448910 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780995f-7005-4b2e-b491-706902f08479 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:57.451050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd051df-ad20-44a8-8f30-0633756643e2 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:57.463493 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 172/333] 10.222.0.41 () {56 vars in 1308 bytes} [Mon May 30 11:52:57 2022] GET /identity/v3/role_assignments?user.id=fcf049de428f46939f950aa8259b42f5&scope.system=all&role.id=5674314ace5445ccbca611d8cfdc25f1 => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:52:57.503164 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5205dc2-d429-469e-9517-861bf551f2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:57.504243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5205dc2-d429-469e-9517-861bf551f2d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:57.504537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5205dc2-d429-469e-9517-861bf551f2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:57.504825 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5205dc2-d429-469e-9517-861bf551f2d1 None admin] PATH_INFO: `/v3/system/users/370ad1d42a6947d3ba134ec5336fcf53/roles/9742d46a027d4a4a8066c058e5ee5316` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:57.507320 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5205dc2-d429-469e-9517-861bf551f2d1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=370ad1d42a6947d3ba134ec5336fcf53, role_id=9742d46a027d4a4a8066c058e5ee5316)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:52:57.508728 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5205dc2-d429-469e-9517-861bf551f2d1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:52:57.531670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 162/334] 10.222.0.41 () {58 vars in 1334 bytes} [Mon May 30 11:52:57 2022] PUT /identity/v3/system/users/370ad1d42a6947d3ba134ec5336fcf53/roles/9742d46a027d4a4a8066c058e5ee5316 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:52:59.357739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3fb3-a300-4b0f-950c-5b5324e43884 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:59.358711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3fb3-a300-4b0f-950c-5b5324e43884 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:59.359725 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3fb3-a300-4b0f-950c-5b5324e43884 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:59.361315 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 173/335] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:59.366949 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fea4a-f3e4-4d56-a029-fb6a6466ab1c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:59.367378 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fea4a-f3e4-4d56-a029-fb6a6466ab1c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:59.367557 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fea4a-f3e4-4d56-a029-fb6a6466ab1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:59.389506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c48fea4a-f3e4-4d56-a029-fb6a6466ab1c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:59.391299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c48fea4a-f3e4-4d56-a029-fb6a6466ab1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:59.489973 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 163/336] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:59.525695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d3fb3-a300-4b0f-950c-5b5324e43884 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:59.661587 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d3fb3-a300-4b0f-950c-5b5324e43884 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:52:59.702941 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4e235-e73b-4c6b-b3a5-216606237f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:52:59.703774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4e235-e73b-4c6b-b3a5-216606237f83 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:59.704092 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4e235-e73b-4c6b-b3a5-216606237f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:59.704377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4e235-e73b-4c6b-b3a5-216606237f83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:59.719472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:59.723984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4e235-e73b-4c6b-b3a5-216606237f83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:52:59.727193 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f3f2f-58a5-4392-8a5b-4b01772b78b2 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:59.727490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f3f2f-58a5-4392-8a5b-4b01772b78b2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:59.727769 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f3f2f-58a5-4392-8a5b-4b01772b78b2 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:59.729299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 164/337] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:52:59.737416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81debc00-ec79-4349-b178-52b372dbe800 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:59.737709 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81debc00-ec79-4349-b178-52b372dbe800 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:59.737995 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81debc00-ec79-4349-b178-52b372dbe800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:59.738761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-32a4e235-e73b-4c6b-b3a5-216606237f83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:52:59.738761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:52:59.738761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:52:59.738761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:52:59.738761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:52:59.738761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:52:59.738761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:52:59.738761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:52:59.738761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:52:59.738761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:52:59.738761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:52:59.738761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:52:59.738761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:52:59.738761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:52:59.738761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:52:59.738761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:52:59.739590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:52:59.739590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:52:59.739590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:52:59.739590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:52:59.739590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:52:59.739590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:52:59.739590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:52:59.739590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:52:59.739590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:52:59.739590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:52:59.739590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:52:59.739590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:52:59.739590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:52:59.739590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:52:59.739590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:52:59.739590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:52:59.740415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:52:59.740415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:52:59.740415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:52:59.740415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:52:59.740415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:52:59.740415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:52:59.740415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:52:59.740415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:52:59.740415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:52:59.740415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:52:59.740415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:52:59.740415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:52:59.743244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 174/338] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:52:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:52:59.748929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4e235-e73b-4c6b-b3a5-216606237f83 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:52:59.784886 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-81debc00-ec79-4349-b178-52b372dbe800 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:52:59.786109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-81debc00-ec79-4349-b178-52b372dbe800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:52:59.945226 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:52:59.951024 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 165/339] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:52:59.952199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54a074-7b6c-4a7e-b612-a3070b3689ec None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:59.952538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54a074-7b6c-4a7e-b612-a3070b3689ec None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:59.952803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54a074-7b6c-4a7e-b612-a3070b3689ec None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:52:59.954394 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 166/340] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:52:59.960269 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8379a4-c29b-4366-a61b-c5c2dd0a4393 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:52:59.960624 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8379a4-c29b-4366-a61b-c5c2dd0a4393 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:52:59.960908 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8379a4-c29b-4366-a61b-c5c2dd0a4393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:00.000930 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ba8379a4-c29b-4366-a61b-c5c2dd0a4393 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:00.002588 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ba8379a4-c29b-4366-a61b-c5c2dd0a4393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:00.004456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4e235-e73b-4c6b-b3a5-216606237f83 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:00.041960 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a20338-7896-424b-801a-a627912fc63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:00.042639 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a20338-7896-424b-801a-a627912fc63e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:00.042930 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a20338-7896-424b-801a-a627912fc63e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:00.043204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a20338-7896-424b-801a-a627912fc63e None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:00.044004 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a20338-7896-424b-801a-a627912fc63e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:00.044319 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a20338-7896-424b-801a-a627912fc63e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:00.045778 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a20338-7896-424b-801a-a627912fc63e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:00.057625 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 175/341] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:52:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:00.058275 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a20338-7896-424b-801a-a627912fc63e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:00.114196 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 167/342] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 30 11:53:00.115482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8379a4-c29b-4366-a61b-c5c2dd0a4393 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:00.136783 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:00.251170 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8379a4-c29b-4366-a61b-c5c2dd0a4393 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:00.262028 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a20338-7896-424b-801a-a627912fc63e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:00.289246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:00.295327 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d40ce-8996-45c7-b75a-13dd0f89e303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:00.296018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d40ce-8996-45c7-b75a-13dd0f89e303 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:00.296306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d40ce-8996-45c7-b75a-13dd0f89e303 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:00.296899 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d40ce-8996-45c7-b75a-13dd0f89e303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:00.362058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd638fc6-ecd6-423f-ae7a-879ea5d680ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:00.362869 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd638fc6-ecd6-423f-ae7a-879ea5d680ec None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:00.363156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd638fc6-ecd6-423f-ae7a-879ea5d680ec None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:00.363436 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd638fc6-ecd6-423f-ae7a-879ea5d680ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:00.386193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd638fc6-ecd6-423f-ae7a-879ea5d680ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:00.387776 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d40ce-8996-45c7-b75a-13dd0f89e303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:00.389825 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d40ce-8996-45c7-b75a-13dd0f89e303 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:00.395857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-fd638fc6-ecd6-423f-ae7a-879ea5d680ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:53:00.395857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:00.395857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:00.395857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:00.395857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:00.395857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:00.395857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:00.395857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:00.395857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:00.395857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:00.395857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:00.395857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:00.395857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:00.395857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:00.395857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:00.395857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:00.396739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:00.396739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:00.396739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:00.396739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:00.396739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:00.396739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:00.396739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:00.396739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:00.396739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:00.396739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:00.396739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:00.396739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:00.396739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:00.396739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:00.396739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:00.396739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:00.397531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:00.397531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:00.397531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:00.397531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:00.397531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:00.397531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:00.397531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:00.397531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:00.397531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:00.397531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:00.397531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:53:00.397531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:00.397531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 176/343] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:00.398160 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd638fc6-ecd6-423f-ae7a-879ea5d680ec None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:00.513133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 168/344] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:00.514329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d40ce-8996-45c7-b75a-13dd0f89e303 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:00.524392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd638fc6-ecd6-423f-ae7a-879ea5d680ec None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:00.546681 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:00.548829 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:00.560858 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fed703-9bfe-40e5-af14-99e0dd1213db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:00.561666 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fed703-9bfe-40e5-af14-99e0dd1213db None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:00.561969 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fed703-9bfe-40e5-af14-99e0dd1213db None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:00.562860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fed703-9bfe-40e5-af14-99e0dd1213db None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:00.574450 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fed703-9bfe-40e5-af14-99e0dd1213db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:00.582589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-55fed703-9bfe-40e5-af14-99e0dd1213db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:53:00.582589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:00.582589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:00.582589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:00.582589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:00.582589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:00.582589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:00.582589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:00.582589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:00.582589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:00.582589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:00.582589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:00.582589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:00.582589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:00.582589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:00.582589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:00.583483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:00.583483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:00.583483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:00.583483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:00.583483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:00.583483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:00.583483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:00.583483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:00.583483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:00.583483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:00.583483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:00.583483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:00.583483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:00.583483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:00.583483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:00.583483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:00.584325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:00.584325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:00.584325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:00.584325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:00.584325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:00.584325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:00.584325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:00.584325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:00.584325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:00.584325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:00.584325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:53:00.584325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:00.589459 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 177/345] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:00.590316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fed703-9bfe-40e5-af14-99e0dd1213db None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:00.628337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d40ce-8996-45c7-b75a-13dd0f89e303 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:00.665704 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b3154-b182-4ad1-a9c6-e6e8e1f375c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:00.666752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b3154-b182-4ad1-a9c6-e6e8e1f375c0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:00.667229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b3154-b182-4ad1-a9c6-e6e8e1f375c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:00.667692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b3154-b182-4ad1-a9c6-e6e8e1f375c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:00.668676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b3154-b182-4ad1-a9c6-e6e8e1f375c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:00.669178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b3154-b182-4ad1-a9c6-e6e8e1f375c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:00.670771 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b3154-b182-4ad1-a9c6-e6e8e1f375c0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:00.680313 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 169/346] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:53:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:00.681420 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b3154-b182-4ad1-a9c6-e6e8e1f375c0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:00.704105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fed703-9bfe-40e5-af14-99e0dd1213db None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:00.741171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba9af0-d585-448b-b743-0617614049af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:00.742030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba9af0-d585-448b-b743-0617614049af None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:00.742377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba9af0-d585-448b-b743-0617614049af None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:00.742658 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba9af0-d585-448b-b743-0617614049af None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:00.743946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba9af0-d585-448b-b743-0617614049af None admin] RBAC: Authorizing `identity:get_project(project_id=3bc1541c2b5e4bde81670004fdd58f45)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:00.745470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba9af0-d585-448b-b743-0617614049af None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:00.747497 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 178/347] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:53:00 2022] GET /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:00.753034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba9af0-d585-448b-b743-0617614049af None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:00.795485 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:00.806723 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b3154-b182-4ad1-a9c6-e6e8e1f375c0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:00.809510 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:00.846675 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409f8c8-27ce-43f1-bbd5-012c7bf37db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:00.847721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409f8c8-27ce-43f1-bbd5-012c7bf37db8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:00.848326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409f8c8-27ce-43f1-bbd5-012c7bf37db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:00.848815 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409f8c8-27ce-43f1-bbd5-012c7bf37db8 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:00.849841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409f8c8-27ce-43f1-bbd5-012c7bf37db8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:00.850341 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409f8c8-27ce-43f1-bbd5-012c7bf37db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:00.852060 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409f8c8-27ce-43f1-bbd5-012c7bf37db8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:00.862554 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 170/348] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:53:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:00.863847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409f8c8-27ce-43f1-bbd5-012c7bf37db8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:00.868857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba9af0-d585-448b-b743-0617614049af None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:00.909663 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356d06f-81d8-4914-b022-2e12af2dfbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:00.910636 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356d06f-81d8-4914-b022-2e12af2dfbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:00.911079 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356d06f-81d8-4914-b022-2e12af2dfbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:00.911517 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356d06f-81d8-4914-b022-2e12af2dfbc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:00.976985 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409f8c8-27ce-43f1-bbd5-012c7bf37db8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:00.986443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356d06f-81d8-4914-b022-2e12af2dfbc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:00.988215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356d06f-81d8-4914-b022-2e12af2dfbc8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:01.017122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb99f7-aa63-4c77-92bc-e1ce80dded5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:01.018364 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb99f7-aa63-4c77-92bc-e1ce80dded5c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:01.018883 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb99f7-aa63-4c77-92bc-e1ce80dded5c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:01.019345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb99f7-aa63-4c77-92bc-e1ce80dded5c None admin] PATH_INFO: `/v3/groups/b7f9c9216fee4c55a5f067843421084d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:01.026676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb99f7-aa63-4c77-92bc-e1ce80dded5c None admin] RBAC: Authorizing `identity:get_group(group_id=b7f9c9216fee4c55a5f067843421084d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:01.028473 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb99f7-aa63-4c77-92bc-e1ce80dded5c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:01.030381 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 171/349] 10.222.0.41 () {56 vars in 1180 bytes} [Mon May 30 11:53:00 2022] GET /identity/v3/groups/b7f9c9216fee4c55a5f067843421084d => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:01.032117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb99f7-aa63-4c77-92bc-e1ce80dded5c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:01.050509 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:01.056641 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:01.111305 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 179/350] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:01.112219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356d06f-81d8-4914-b022-2e12af2dfbc8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:01.151558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb99f7-aa63-4c77-92bc-e1ce80dded5c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:01.191133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549974e3-93a5-4c21-954a-0848df926156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:01.192350 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549974e3-93a5-4c21-954a-0848df926156 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:01.192839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549974e3-93a5-4c21-954a-0848df926156 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:01.193341 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549974e3-93a5-4c21-954a-0848df926156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:01.232478 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356d06f-81d8-4914-b022-2e12af2dfbc8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:01.271150 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec9194-6141-4cd1-9808-1b5546856745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:01.272140 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec9194-6141-4cd1-9808-1b5546856745 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:01.272563 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec9194-6141-4cd1-9808-1b5546856745 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:01.273022 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec9194-6141-4cd1-9808-1b5546856745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:01.273203 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549974e3-93a5-4c21-954a-0848df926156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:01.274015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec9194-6141-4cd1-9808-1b5546856745 None admin] RBAC: Adding query filter params (group.id=b7f9c9216fee4c55a5f067843421084d, role.id=d50989dd2d24440f9724d5d7975df7cf, scope.project.id=3bc1541c2b5e4bde81670004fdd58f45) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:01.274490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec9194-6141-4cd1-9808-1b5546856745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:01.275091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549974e3-93a5-4c21-954a-0848df926156 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:01.276089 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec9194-6141-4cd1-9808-1b5546856745 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:01.283106 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 180/351] 10.222.0.41 () {56 vars in 1376 bytes} [Mon May 30 11:53:01 2022] GET /identity/v3/role_assignments?group.id=b7f9c9216fee4c55a5f067843421084d&scope.project.id=3bc1541c2b5e4bde81670004fdd58f45&role.id=d50989dd2d24440f9724d5d7975df7cf => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:01.284291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec9194-6141-4cd1-9808-1b5546856745 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:01.295451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:01.305268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:01.392484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 172/352] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:01.405023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549974e3-93a5-4c21-954a-0848df926156 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:01.411542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec9194-6141-4cd1-9808-1b5546856745 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:01.456322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e7996-f0e3-4cca-9131-4e0b136ca70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:01.457453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e7996-f0e3-4cca-9131-4e0b136ca70f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:01.457889 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e7996-f0e3-4cca-9131-4e0b136ca70f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:01.458347 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e7996-f0e3-4cca-9131-4e0b136ca70f None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:01.459756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e7996-f0e3-4cca-9131-4e0b136ca70f None admin] RBAC: Authorizing `identity:get_project(project_id=3bc1541c2b5e4bde81670004fdd58f45)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:01.461399 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e7996-f0e3-4cca-9131-4e0b136ca70f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:01.463269 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 181/353] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:53:01 2022] GET /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:01.469563 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e7996-f0e3-4cca-9131-4e0b136ca70f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:01.551396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549974e3-93a5-4c21-954a-0848df926156 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:01.572192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:01.608642 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:01.612313 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffcbe0-f490-4b15-a33e-7bebdfc3df9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:01.613514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffcbe0-f490-4b15-a33e-7bebdfc3df9e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:01.614003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffcbe0-f490-4b15-a33e-7bebdfc3df9e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:01.614527 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffcbe0-f490-4b15-a33e-7bebdfc3df9e None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:01.616037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffcbe0-f490-4b15-a33e-7bebdfc3df9e None admin] RBAC: Authorizing `identity:get_project(project_id=138b20881cbe45999d64699abc79c48d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:01.618648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffcbe0-f490-4b15-a33e-7bebdfc3df9e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:01.621149 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 173/354] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:53:01 2022] GET /identity/v3/projects/138b20881cbe45999d64699abc79c48d => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:01.628744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffcbe0-f490-4b15-a33e-7bebdfc3df9e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:01.633177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e7996-f0e3-4cca-9131-4e0b136ca70f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:01.704241 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429620bd-a8f5-4a7e-8e57-7cf156c6524a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:01.705387 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429620bd-a8f5-4a7e-8e57-7cf156c6524a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:01.705891 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429620bd-a8f5-4a7e-8e57-7cf156c6524a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:01.706371 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429620bd-a8f5-4a7e-8e57-7cf156c6524a None admin] PATH_INFO: `/v3/groups/b7f9c9216fee4c55a5f067843421084d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:01.707972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429620bd-a8f5-4a7e-8e57-7cf156c6524a None admin] RBAC: Authorizing `identity:get_group(group_id=b7f9c9216fee4c55a5f067843421084d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:01.709701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429620bd-a8f5-4a7e-8e57-7cf156c6524a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:01.711974 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 182/355] 10.222.0.41 () {56 vars in 1180 bytes} [Mon May 30 11:53:01 2022] GET /identity/v3/groups/b7f9c9216fee4c55a5f067843421084d => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:01.717969 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811621e-71d0-453a-a4f2-c0d06ca8c4ae None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:01.719172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811621e-71d0-453a-a4f2-c0d06ca8c4ae None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:01.719680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811621e-71d0-453a-a4f2-c0d06ca8c4ae None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:01.721538 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 183/356] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:01.722481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811621e-71d0-453a-a4f2-c0d06ca8c4ae None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:01.818997 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffcbe0-f490-4b15-a33e-7bebdfc3df9e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:01.859906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811621e-71d0-453a-a4f2-c0d06ca8c4ae None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:01.866808 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921959a-e46a-4e8e-8d18-76902cb48335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:01.867910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921959a-e46a-4e8e-8d18-76902cb48335 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:01.868358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921959a-e46a-4e8e-8d18-76902cb48335 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:01.868783 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921959a-e46a-4e8e-8d18-76902cb48335 None admin] PATH_INFO: `/v3/groups/b7f9c9216fee4c55a5f067843421084d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:01.870622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921959a-e46a-4e8e-8d18-76902cb48335 None admin] RBAC: Authorizing `identity:get_group(group_id=b7f9c9216fee4c55a5f067843421084d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:01.873016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921959a-e46a-4e8e-8d18-76902cb48335 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:01.876633 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 174/357] 10.222.0.41 () {56 vars in 1180 bytes} [Mon May 30 11:53:01 2022] GET /identity/v3/groups/b7f9c9216fee4c55a5f067843421084d => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:01.878574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359cea3-7cf4-408e-ac6b-ab6e1bf05581 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:01.879034 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359cea3-7cf4-408e-ac6b-ab6e1bf05581 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:01.879705 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359cea3-7cf4-408e-ac6b-ab6e1bf05581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:01.899328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7359cea3-7cf4-408e-ac6b-ab6e1bf05581 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:01.900774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7359cea3-7cf4-408e-ac6b-ab6e1bf05581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:01.902079 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515cce1-1780-4b8e-87fb-1f2d17691697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:01.903046 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515cce1-1780-4b8e-87fb-1f2d17691697 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:01.903422 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515cce1-1780-4b8e-87fb-1f2d17691697 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:01.903882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515cce1-1780-4b8e-87fb-1f2d17691697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:01.904889 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515cce1-1780-4b8e-87fb-1f2d17691697 None admin] RBAC: Adding query filter params (group.id=b7f9c9216fee4c55a5f067843421084d, role.id=5674314ace5445ccbca611d8cfdc25f1, scope.project.id=3bc1541c2b5e4bde81670004fdd58f45) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:01.905427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515cce1-1780-4b8e-87fb-1f2d17691697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:01.907915 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515cce1-1780-4b8e-87fb-1f2d17691697 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:01.914756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 184/358] 10.222.0.41 () {56 vars in 1376 bytes} [Mon May 30 11:53:01 2022] GET /identity/v3/role_assignments?group.id=b7f9c9216fee4c55a5f067843421084d&scope.project.id=3bc1541c2b5e4bde81670004fdd58f45&role.id=5674314ace5445ccbca611d8cfdc25f1 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:01.920513 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b12e0-dee6-442a-89ad-cf1778015726 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:01.921148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b12e0-dee6-442a-89ad-cf1778015726 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:01.921757 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b12e0-dee6-442a-89ad-cf1778015726 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:01.923496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 185/359] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:01.924500 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b12e0-dee6-442a-89ad-cf1778015726 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:01.951861 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:01.961150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:01.985299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 175/360] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:01.986931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd5a33-9589-4198-aa9b-8d441304fd9d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:01.987356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd5a33-9589-4198-aa9b-8d441304fd9d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:01.987797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd5a33-9589-4198-aa9b-8d441304fd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:02.017116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-aabd5a33-9589-4198-aa9b-8d441304fd9d None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:02.018562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-aabd5a33-9589-4198-aa9b-8d441304fd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:02.099581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b12e0-dee6-442a-89ad-cf1778015726 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:02.115367 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 176/361] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:02.116529 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd5a33-9589-4198-aa9b-8d441304fd9d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:02.166793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf91652-76cf-44a8-aa5f-d141d302d094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:02.170599 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf91652-76cf-44a8-aa5f-d141d302d094 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:02.171312 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf91652-76cf-44a8-aa5f-d141d302d094 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:02.171756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf91652-76cf-44a8-aa5f-d141d302d094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:02.172996 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf91652-76cf-44a8-aa5f-d141d302d094 None admin] RBAC: Adding query filter params (group.id=b7f9c9216fee4c55a5f067843421084d, role.id=5674314ace5445ccbca611d8cfdc25f1, scope.project.id=138b20881cbe45999d64699abc79c48d) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:02.173471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf91652-76cf-44a8-aa5f-d141d302d094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:02.175154 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf91652-76cf-44a8-aa5f-d141d302d094 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:02.185970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 186/362] 10.222.0.41 () {56 vars in 1376 bytes} [Mon May 30 11:53:01 2022] GET /identity/v3/role_assignments?group.id=b7f9c9216fee4c55a5f067843421084d&scope.project.id=138b20881cbe45999d64699abc79c48d&role.id=5674314ace5445ccbca611d8cfdc25f1 => generated 260 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:02.187901 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2090821-bef3-426f-b5e7-ebb6b02ee240 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:02.188634 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2090821-bef3-426f-b5e7-ebb6b02ee240 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:02.189243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2090821-bef3-426f-b5e7-ebb6b02ee240 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:02.191334 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 187/363] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:02.192631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2090821-bef3-426f-b5e7-ebb6b02ee240 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:02.317089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd5a33-9589-4198-aa9b-8d441304fd9d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:02.344237 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:02.346168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:02.381581 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad187e1-a811-43db-a470-33d54f56eb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:02.382793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad187e1-a811-43db-a470-33d54f56eb47 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:02.384240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad187e1-a811-43db-a470-33d54f56eb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:02.385484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad187e1-a811-43db-a470-33d54f56eb47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:02.398441 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2090821-bef3-426f-b5e7-ebb6b02ee240 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:02.411838 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad187e1-a811-43db-a470-33d54f56eb47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:02.425393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-8ad187e1-a811-43db-a470-33d54f56eb47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:53:02.425393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:02.425393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:02.425393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:02.425393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:02.425393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:02.425393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:02.425393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:02.425393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:02.425393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:02.425393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:02.425393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:02.425393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:02.425393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:02.425393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:02.425393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:02.426429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:02.426429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:02.426429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:02.426429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:02.426429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:02.426429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:02.426429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:02.426429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:02.426429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:02.426429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:02.426429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:02.426429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:02.426429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:02.426429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:02.426429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:02.426429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:02.427204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:02.427204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:02.427204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:02.427204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:02.427204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:02.427204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:02.427204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:02.427204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:02.427204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:02.427204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:02.427204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:53:02.427204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:02.436920 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 177/364] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:53:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:02.441153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8a0c7-fb39-4ab4-b20f-16d6b9d294ca None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:02.441690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8a0c7-fb39-4ab4-b20f-16d6b9d294ca None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:02.442174 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8a0c7-fb39-4ab4-b20f-16d6b9d294ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:02.464474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-15d8a0c7-fb39-4ab4-b20f-16d6b9d294ca None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:02.466124 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-15d8a0c7-fb39-4ab4-b20f-16d6b9d294ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:02.480234 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7300c4-dbe0-4060-bc90-36c9d1fbab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:02.481058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7300c4-dbe0-4060-bc90-36c9d1fbab1c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:02.481349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7300c4-dbe0-4060-bc90-36c9d1fbab1c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:02.481632 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7300c4-dbe0-4060-bc90-36c9d1fbab1c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:02.500377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7300c4-dbe0-4060-bc90-36c9d1fbab1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:02.513674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ca7300c4-dbe0-4060-bc90-36c9d1fbab1c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:53:02.513674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:02.513674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:02.513674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:02.513674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:02.513674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:02.513674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:02.513674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:02.513674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:02.513674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:02.513674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:02.513674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:02.513674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:02.513674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:02.513674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:02.513674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:02.514607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:02.514607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:02.514607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:02.514607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:02.514607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:02.514607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:02.514607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:02.514607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:02.514607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:02.514607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:02.514607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:02.514607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:02.514607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:02.514607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:02.514607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:02.514607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:02.515943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:02.515943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:02.515943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:02.515943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:02.515943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:02.515943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:02.515943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:02.515943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:02.515943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:02.515943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:02.515943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:53:02.515943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:02.515943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 188/365] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:02.515943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7300c4-dbe0-4060-bc90-36c9d1fbab1c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:02.573680 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 178/366] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:02.576050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8a0c7-fb39-4ab4-b20f-16d6b9d294ca None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:02.671266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7300c4-dbe0-4060-bc90-36c9d1fbab1c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:02.712817 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed5bea-50e7-4a10-b308-677cdc1f289d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:02.713836 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed5bea-50e7-4a10-b308-677cdc1f289d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:02.714340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed5bea-50e7-4a10-b308-677cdc1f289d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:02.714817 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed5bea-50e7-4a10-b308-677cdc1f289d None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:02.715767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed5bea-50e7-4a10-b308-677cdc1f289d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:02.716301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed5bea-50e7-4a10-b308-677cdc1f289d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:02.717869 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed5bea-50e7-4a10-b308-677cdc1f289d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:02.729965 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:02.734621 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 189/367] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:02.735526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed5bea-50e7-4a10-b308-677cdc1f289d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:02.757487 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8a0c7-fb39-4ab4-b20f-16d6b9d294ca None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:02.762154 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:02.830916 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c0e90-e513-4bad-981c-33373f119397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:02.831597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c0e90-e513-4bad-981c-33373f119397 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:02.831900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c0e90-e513-4bad-981c-33373f119397 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:02.832177 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c0e90-e513-4bad-981c-33373f119397 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:02.832936 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c0e90-e513-4bad-981c-33373f119397 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:02.833240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c0e90-e513-4bad-981c-33373f119397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:02.834629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c0e90-e513-4bad-981c-33373f119397 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:02.851553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 179/368] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:53:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:02.852449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c0e90-e513-4bad-981c-33373f119397 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:02.879528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed5bea-50e7-4a10-b308-677cdc1f289d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:02.917965 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cc3e8-3396-46ec-ad9d-319a63d6ff27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:02.918784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cc3e8-3396-46ec-ad9d-319a63d6ff27 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:02.919069 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cc3e8-3396-46ec-ad9d-319a63d6ff27 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:02.919347 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cc3e8-3396-46ec-ad9d-319a63d6ff27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:02.932059 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480cc3e8-3396-46ec-ad9d-319a63d6ff27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:02.939934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-480cc3e8-3396-46ec-ad9d-319a63d6ff27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:53:02.939934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:02.939934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:02.939934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:02.939934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:02.939934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:02.939934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:02.939934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:02.939934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:02.939934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:02.939934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:02.939934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:02.939934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:02.939934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:02.939934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:02.939934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:02.940828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:02.940828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:02.940828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:02.940828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:02.940828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:02.940828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:02.940828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:02.940828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:02.940828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:02.940828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:02.940828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:02.940828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:02.940828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:02.940828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:02.940828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:02.940828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:02.941629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:02.941629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:02.941629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:02.941629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:02.941629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:02.941629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:02.941629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:02.941629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:02.941629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:02.941629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:02.941629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:53:02.941629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:02.941629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 190/369] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:53:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:02.942893 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cc3e8-3396-46ec-ad9d-319a63d6ff27 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:03.008293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:03.050099 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cc3e8-3396-46ec-ad9d-319a63d6ff27 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:03.087116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c44a7a-ed1b-4286-acdc-4b4aea9ef73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:03.088140 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c44a7a-ed1b-4286-acdc-4b4aea9ef73b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:03.088431 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c44a7a-ed1b-4286-acdc-4b4aea9ef73b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:03.088710 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c44a7a-ed1b-4286-acdc-4b4aea9ef73b None admin] PATH_INFO: `/v3/users/370ad1d42a6947d3ba134ec5336fcf53` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:03.089965 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c44a7a-ed1b-4286-acdc-4b4aea9ef73b None admin] RBAC: Authorizing `identity:get_user(user_id=370ad1d42a6947d3ba134ec5336fcf53)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:03.091413 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c44a7a-ed1b-4286-acdc-4b4aea9ef73b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:03.094038 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 191/370] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:53:02 2022] GET /identity/v3/users/370ad1d42a6947d3ba134ec5336fcf53 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:03.094601 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c44a7a-ed1b-4286-acdc-4b4aea9ef73b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:03.187697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c0e90-e513-4bad-981c-33373f119397 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:03.206344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c44a7a-ed1b-4286-acdc-4b4aea9ef73b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:03.236279 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:03.248095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc57e8b-c4e0-45f9-ac17-c1a07dd941e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:03.248838 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc57e8b-c4e0-45f9-ac17-c1a07dd941e0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:03.249127 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc57e8b-c4e0-45f9-ac17-c1a07dd941e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:03.249447 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc57e8b-c4e0-45f9-ac17-c1a07dd941e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:03.251335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d3fcd-5edc-4455-a7fb-e5345baee8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:03.252023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d3fcd-5edc-4455-a7fb-e5345baee8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:03.252309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d3fcd-5edc-4455-a7fb-e5345baee8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:03.252587 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d3fcd-5edc-4455-a7fb-e5345baee8b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:03.253792 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d3fcd-5edc-4455-a7fb-e5345baee8b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:03.254113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d3fcd-5edc-4455-a7fb-e5345baee8b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:03.255486 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d3fcd-5edc-4455-a7fb-e5345baee8b9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:03.275304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 192/371] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:03.275956 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d3fcd-5edc-4455-a7fb-e5345baee8b9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:03.316183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:03.388132 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc57e8b-c4e0-45f9-ac17-c1a07dd941e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:03.389615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc57e8b-c4e0-45f9-ac17-c1a07dd941e0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:03.488044 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d3fcd-5edc-4455-a7fb-e5345baee8b9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:03.537822 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff67b8-b43f-4f9e-b884-1c096d8ea60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:03.538484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff67b8-b43f-4f9e-b884-1c096d8ea60c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:03.538767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff67b8-b43f-4f9e-b884-1c096d8ea60c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:03.539046 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff67b8-b43f-4f9e-b884-1c096d8ea60c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:03.540125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff67b8-b43f-4f9e-b884-1c096d8ea60c None admin] RBAC: Adding query filter params (role.id=9742d46a027d4a4a8066c058e5ee5316, user.id=370ad1d42a6947d3ba134ec5336fcf53, scope.system=all) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:03.540446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff67b8-b43f-4f9e-b884-1c096d8ea60c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:03.542708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff67b8-b43f-4f9e-b884-1c096d8ea60c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:03.557334 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 193/372] 10.222.0.41 () {56 vars in 1308 bytes} [Mon May 30 11:53:03 2022] GET /identity/v3/role_assignments?user.id=370ad1d42a6947d3ba134ec5336fcf53&scope.system=all&role.id=9742d46a027d4a4a8066c058e5ee5316 => generated 510 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:03.558186 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff67b8-b43f-4f9e-b884-1c096d8ea60c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:03.599582 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 180/373] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:03.605105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc57e8b-c4e0-45f9-ac17-c1a07dd941e0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:03.625898 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:03.722313 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff67b8-b43f-4f9e-b884-1c096d8ea60c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:03.800879 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:03.805891 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea557419-ccda-4968-8db8-9286d2c93c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:03.806596 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea557419-ccda-4968-8db8-9286d2c93c3c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:03.807041 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea557419-ccda-4968-8db8-9286d2c93c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:03.807320 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea557419-ccda-4968-8db8-9286d2c93c3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:03.910224 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc57e8b-c4e0-45f9-ac17-c1a07dd941e0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:03.950341 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea557419-ccda-4968-8db8-9286d2c93c3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:03.952361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea557419-ccda-4968-8db8-9286d2c93c3c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:03.978563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2bdf7-d3e4-472c-9277-6f953d0cdae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:03.979436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2bdf7-d3e4-472c-9277-6f953d0cdae7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:03.979720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2bdf7-d3e4-472c-9277-6f953d0cdae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:03.980140 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2bdf7-d3e4-472c-9277-6f953d0cdae7 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:03.981444 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2bdf7-d3e4-472c-9277-6f953d0cdae7 None admin] RBAC: Authorizing `identity:get_project(project_id=138b20881cbe45999d64699abc79c48d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:03.982906 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2bdf7-d3e4-472c-9277-6f953d0cdae7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:03.985171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 181/374] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:53:03 2022] GET /identity/v3/projects/138b20881cbe45999d64699abc79c48d => generated 302 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:03.993832 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2bdf7-d3e4-472c-9277-6f953d0cdae7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:04.040485 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:04.132008 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 194/375] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:04.137671 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea557419-ccda-4968-8db8-9286d2c93c3c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:04.226449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2bdf7-d3e4-472c-9277-6f953d0cdae7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:04.289675 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb208a-cff8-449a-809f-9da02875d450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:04.290999 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb208a-cff8-449a-809f-9da02875d450 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:04.291466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb208a-cff8-449a-809f-9da02875d450 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:04.291987 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb208a-cff8-449a-809f-9da02875d450 None admin] PATH_INFO: `/v3/groups/b7f9c9216fee4c55a5f067843421084d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:04.294366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb208a-cff8-449a-809f-9da02875d450 None admin] RBAC: Authorizing `identity:get_group(group_id=b7f9c9216fee4c55a5f067843421084d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:04.296079 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb208a-cff8-449a-809f-9da02875d450 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:04.299141 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 182/376] 10.222.0.41 () {56 vars in 1180 bytes} [Mon May 30 11:53:03 2022] GET /identity/v3/groups/b7f9c9216fee4c55a5f067843421084d => generated 226 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:04.304443 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb208a-cff8-449a-809f-9da02875d450 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:04.307611 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:04.319263 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea557419-ccda-4968-8db8-9286d2c93c3c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:04.374735 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf3189-d218-4759-82ef-d9da61e2ecf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:04.375743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf3189-d218-4759-82ef-d9da61e2ecf3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:04.376083 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf3189-d218-4759-82ef-d9da61e2ecf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:04.376399 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf3189-d218-4759-82ef-d9da61e2ecf3 None admin] PATH_INFO: `/v3/projects/93674931dbb347aea1d901cb89aa3b24` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:04.377620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf3189-d218-4759-82ef-d9da61e2ecf3 None admin] RBAC: Authorizing `identity:get_project(project_id=93674931dbb347aea1d901cb89aa3b24)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:04.379084 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf3189-d218-4759-82ef-d9da61e2ecf3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:04.381704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 195/377] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:53:04 2022] GET /identity/v3/projects/93674931dbb347aea1d901cb89aa3b24 => generated 344 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:04.383029 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e458b8-2b02-4567-9d8e-acaee032213a None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:04.383316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e458b8-2b02-4567-9d8e-acaee032213a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:04.383591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e458b8-2b02-4567-9d8e-acaee032213a None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:04.385054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 196/378] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:04.390553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e458b8-2b02-4567-9d8e-acaee032213a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:04.416435 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:04.457014 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb208a-cff8-449a-809f-9da02875d450 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:04.505025 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f156f7-1acd-4da3-b3df-e7d9f7b0213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:04.505694 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f156f7-1acd-4da3-b3df-e7d9f7b0213c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:04.505973 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f156f7-1acd-4da3-b3df-e7d9f7b0213c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:04.506243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f156f7-1acd-4da3-b3df-e7d9f7b0213c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:04.507080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f156f7-1acd-4da3-b3df-e7d9f7b0213c None admin] RBAC: Adding query filter params (group.id=b7f9c9216fee4c55a5f067843421084d, role.id=d50989dd2d24440f9724d5d7975df7cf, scope.project.id=138b20881cbe45999d64699abc79c48d) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:04.507393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f156f7-1acd-4da3-b3df-e7d9f7b0213c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:04.508874 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f156f7-1acd-4da3-b3df-e7d9f7b0213c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:04.518329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 183/379] 10.222.0.41 () {56 vars in 1376 bytes} [Mon May 30 11:53:04 2022] GET /identity/v3/role_assignments?group.id=b7f9c9216fee4c55a5f067843421084d&scope.project.id=138b20881cbe45999d64699abc79c48d&role.id=d50989dd2d24440f9724d5d7975df7cf => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:04.524138 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9f3bd-2c6b-4397-a228-17ad6e76ef2a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:04.526377 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9f3bd-2c6b-4397-a228-17ad6e76ef2a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:04.526864 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9f3bd-2c6b-4397-a228-17ad6e76ef2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:04.530292 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e458b8-2b02-4567-9d8e-acaee032213a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:04.560761 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-70d9f3bd-2c6b-4397-a228-17ad6e76ef2a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:04.565416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-70d9f3bd-2c6b-4397-a228-17ad6e76ef2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:04.606090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1428eb-e0c6-4fa2-a7fc-2e9eb85c0de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:04.607521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1428eb-e0c6-4fa2-a7fc-2e9eb85c0de8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:04.609870 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1428eb-e0c6-4fa2-a7fc-2e9eb85c0de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:04.613125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1428eb-e0c6-4fa2-a7fc-2e9eb85c0de8 None admin] PATH_INFO: `/v3/groups/539dd332d3ee4d4ab37ff619bdb3220b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:04.625228 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1428eb-e0c6-4fa2-a7fc-2e9eb85c0de8 None admin] RBAC: Authorizing `identity:get_group(group_id=539dd332d3ee4d4ab37ff619bdb3220b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:04.626981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1428eb-e0c6-4fa2-a7fc-2e9eb85c0de8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:04.630063 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 197/380] 10.222.0.41 () {56 vars in 1180 bytes} [Mon May 30 11:53:04 2022] GET /identity/v3/groups/539dd332d3ee4d4ab37ff619bdb3220b => generated 229 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:04.635782 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1428eb-e0c6-4fa2-a7fc-2e9eb85c0de8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:04.681576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:04.697800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 184/381] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:04.731958 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9f3bd-2c6b-4397-a228-17ad6e76ef2a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:04.813868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:04.865373 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1428eb-e0c6-4fa2-a7fc-2e9eb85c0de8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:04.875716 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9f3bd-2c6b-4397-a228-17ad6e76ef2a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:04.912167 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d70f2-6467-4ebe-9b6b-3bdd356ccbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:04.913030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d70f2-6467-4ebe-9b6b-3bdd356ccbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:04.913387 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d70f2-6467-4ebe-9b6b-3bdd356ccbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:04.913746 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d70f2-6467-4ebe-9b6b-3bdd356ccbf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:04.913927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0339b14-c735-44e3-9cbe-9b53fafce1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:04.914752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d70f2-6467-4ebe-9b6b-3bdd356ccbf3 None admin] RBAC: Adding query filter params (group.id=539dd332d3ee4d4ab37ff619bdb3220b, role.id=8196ef570097443bac15d3cf39878486, scope.project.id=93674931dbb347aea1d901cb89aa3b24) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:04.915098 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0339b14-c735-44e3-9cbe-9b53fafce1bd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:04.915197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d70f2-6467-4ebe-9b6b-3bdd356ccbf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:04.915664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0339b14-c735-44e3-9cbe-9b53fafce1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:04.917644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d70f2-6467-4ebe-9b6b-3bdd356ccbf3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:04.918117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0339b14-c735-44e3-9cbe-9b53fafce1bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:04.925513 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 198/382] 10.222.0.41 () {56 vars in 1376 bytes} [Mon May 30 11:53:04 2022] GET /identity/v3/role_assignments?group.id=539dd332d3ee4d4ab37ff619bdb3220b&scope.project.id=93674931dbb347aea1d901cb89aa3b24&role.id=8196ef570097443bac15d3cf39878486 => generated 260 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:04.938868 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0339b14-c735-44e3-9cbe-9b53fafce1bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:04.947617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-f0339b14-c735-44e3-9cbe-9b53fafce1bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:53:04.947617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:04.947617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:04.947617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:04.947617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:04.947617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:04.947617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:04.947617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:04.947617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:04.947617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:04.947617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:04.947617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:04.947617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:04.947617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:04.947617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:04.947617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:04.948563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:04.948563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:04.948563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:04.948563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:04.948563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:04.948563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:04.948563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:04.948563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:04.948563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:04.948563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:04.948563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:04.948563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:04.948563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:04.948563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:04.948563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:04.948563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:04.949342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:04.949342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:04.949342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:04.949342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:04.949342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:04.949342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:04.949342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:04.949342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:04.949342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:04.949342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:04.949342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:53:04.949342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:04.951950 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 185/383] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:53:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:04.958838 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d70f2-6467-4ebe-9b6b-3bdd356ccbf3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:05.087582 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d70f2-6467-4ebe-9b6b-3bdd356ccbf3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:05.128296 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58864c-1374-404c-926e-fb605b09e338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:05.128984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58864c-1374-404c-926e-fb605b09e338 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:05.129279 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58864c-1374-404c-926e-fb605b09e338 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:05.129559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58864c-1374-404c-926e-fb605b09e338 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:05.130338 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58864c-1374-404c-926e-fb605b09e338 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:05.130651 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58864c-1374-404c-926e-fb605b09e338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:05.132088 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58864c-1374-404c-926e-fb605b09e338 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:05.142254 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 199/384] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:05.147709 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0339b14-c735-44e3-9cbe-9b53fafce1bd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:05.242304 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:05.272192 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5f291-2fa3-4923-a3e6-6cf1d08adba9 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:05.272494 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5f291-2fa3-4923-a3e6-6cf1d08adba9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:05.272770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5f291-2fa3-4923-a3e6-6cf1d08adba9 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:05.275929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 200/385] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:53:05.280311 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff4454-25f2-4e50-991d-cca74f89811b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:05.280757 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff4454-25f2-4e50-991d-cca74f89811b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:05.281064 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff4454-25f2-4e50-991d-cca74f89811b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:05.295880 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:05.302159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0339b14-c735-44e3-9cbe-9b53fafce1bd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:05.305502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-01ff4454-25f2-4e50-991d-cca74f89811b None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:05.306929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-01ff4454-25f2-4e50-991d-cca74f89811b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:05.361368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e5b5c-2621-4123-b4be-532240b2608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:05.362209 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e5b5c-2621-4123-b4be-532240b2608a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:05.362437 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e5b5c-2621-4123-b4be-532240b2608a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:05.362711 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e5b5c-2621-4123-b4be-532240b2608a None admin] PATH_INFO: `/v3/groups/b7f9c9216fee4c55a5f067843421084d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:05.364018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e5b5c-2621-4123-b4be-532240b2608a None admin] RBAC: Authorizing `identity:get_group(group_id=b7f9c9216fee4c55a5f067843421084d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:05.365418 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e5b5c-2621-4123-b4be-532240b2608a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:05.368445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 186/386] 10.222.0.41 () {56 vars in 1180 bytes} [Mon May 30 11:53:05 2022] GET /identity/v3/groups/b7f9c9216fee4c55a5f067843421084d => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:05.372722 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e5b5c-2621-4123-b4be-532240b2608a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:05.386856 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 201/387] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:53:05.416444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f06d24-6e0a-4cc9-936f-4f75bf0131b5 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:05.417055 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f06d24-6e0a-4cc9-936f-4f75bf0131b5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:05.417537 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f06d24-6e0a-4cc9-936f-4f75bf0131b5 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:05.420152 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 202/388] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:53:05.425055 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312cdf0-097a-4abd-afc2-26034e8edf4d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:05.425603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312cdf0-097a-4abd-afc2-26034e8edf4d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:05.426083 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312cdf0-097a-4abd-afc2-26034e8edf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:05.449457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8312cdf0-097a-4abd-afc2-26034e8edf4d None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:05.451595 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8312cdf0-097a-4abd-afc2-26034e8edf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:05.491792 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e5b5c-2621-4123-b4be-532240b2608a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:05.518609 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:05.532076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c370ee9-550b-463a-9623-69755dfbc94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:05.533050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c370ee9-550b-463a-9623-69755dfbc94e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:05.533402 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c370ee9-550b-463a-9623-69755dfbc94e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:05.533755 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c370ee9-550b-463a-9623-69755dfbc94e None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:05.535076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c370ee9-550b-463a-9623-69755dfbc94e None admin] RBAC: Authorizing `identity:get_project(project_id=3bc1541c2b5e4bde81670004fdd58f45)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:05.536683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c370ee9-550b-463a-9623-69755dfbc94e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:05.539011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 187/389] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:53:05 2022] GET /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:05.539673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c370ee9-550b-463a-9623-69755dfbc94e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:05.548776 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 203/390] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:53:05.550941 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312cdf0-097a-4abd-afc2-26034e8edf4d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:05.638469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:05.671100 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c370ee9-550b-463a-9623-69755dfbc94e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:05.678146 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312cdf0-097a-4abd-afc2-26034e8edf4d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:05.717073 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a070a-c246-4081-b93b-54f7c6bc47eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:05.718143 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a070a-c246-4081-b93b-54f7c6bc47eb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:05.718587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a070a-c246-4081-b93b-54f7c6bc47eb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:05.720161 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a070a-c246-4081-b93b-54f7c6bc47eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:05.732023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122ba0c-d705-452d-b75e-009209c78daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:05.732915 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122ba0c-d705-452d-b75e-009209c78daa None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:05.733201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122ba0c-d705-452d-b75e-009209c78daa None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:05.733532 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122ba0c-d705-452d-b75e-009209c78daa None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45/groups/b7f9c9216fee4c55a5f067843421084d/roles/d50989dd2d24440f9724d5d7975df7cf` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:05.735933 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a070a-c246-4081-b93b-54f7c6bc47eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:05.736066 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122ba0c-d705-452d-b75e-009209c78daa None admin] RBAC: Authorizing `identity:create_grant(project_id=3bc1541c2b5e4bde81670004fdd58f45, group_id=b7f9c9216fee4c55a5f067843421084d, role_id=d50989dd2d24440f9724d5d7975df7cf)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:05.737401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122ba0c-d705-452d-b75e-009209c78daa None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:05.745993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-ed2a070a-c246-4081-b93b-54f7c6bc47eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:53:05.745993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:05.745993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:05.745993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:05.745993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:05.745993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:05.745993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:05.745993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:05.745993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:05.745993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:05.745993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:05.745993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:05.745993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:05.745993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:05.745993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:05.745993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:05.747151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:05.747151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:05.747151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:05.747151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:05.747151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:05.747151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:05.747151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:05.747151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:05.747151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:05.747151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:05.747151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:05.747151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:05.747151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:05.747151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:05.747151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:05.747151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:05.748155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:05.748155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:05.748155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:05.748155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:05.748155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:05.748155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:05.748155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:05.748155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:05.748155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:05.748155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:05.748155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:53:05.748155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:05.750914 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 188/391] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:05.752064 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a070a-c246-4081-b93b-54f7c6bc47eb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:05.759149 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 204/392] 10.222.0.41 () {58 vars in 1442 bytes} [Mon May 30 11:53:05 2022] PUT /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45/groups/b7f9c9216fee4c55a5f067843421084d/roles/d50989dd2d24440f9724d5d7975df7cf => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:53:05.759149 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122ba0c-d705-452d-b75e-009209c78daa None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:05.838438 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:05.898061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a070a-c246-4081-b93b-54f7c6bc47eb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:05.908136 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122ba0c-d705-452d-b75e-009209c78daa None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:05.934505 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb7c6e-426a-4380-a131-25f421095b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:05.935325 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb7c6e-426a-4380-a131-25f421095b79 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:05.935613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb7c6e-426a-4380-a131-25f421095b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:05.937253 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb7c6e-426a-4380-a131-25f421095b79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:05.939006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:05.955371 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571a0e0-541e-48a0-a033-fa751ff5a5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:05.955942 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb7c6e-426a-4380-a131-25f421095b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:05.956124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571a0e0-541e-48a0-a033-fa751ff5a5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:05.956692 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571a0e0-541e-48a0-a033-fa751ff5a5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:05.957281 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571a0e0-541e-48a0-a033-fa751ff5a5e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:05.958253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571a0e0-541e-48a0-a033-fa751ff5a5e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:05.958571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571a0e0-541e-48a0-a033-fa751ff5a5e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:05.960081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571a0e0-541e-48a0-a033-fa751ff5a5e2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:05.966543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-e9bb7c6e-426a-4380-a131-25f421095b79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:53:05.966543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:05.966543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:05.966543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:05.966543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:05.966543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:05.966543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:05.966543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:05.966543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:05.966543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:05.966543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:05.966543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:05.966543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:05.966543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:05.966543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:05.966543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:05.967470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:05.967470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:05.967470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:05.967470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:05.967470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:05.967470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:05.967470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:05.967470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:05.967470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:05.967470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:05.967470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:05.967470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:05.967470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:05.967470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:05.967470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:05.967470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:05.968363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:05.968363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:05.968363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:05.968363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:05.968363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:05.968363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:05.968363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:05.968363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:05.968363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:05.968363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:05.968363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:53:05.968363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:05.969040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 189/393] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:05.970129 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 205/394] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:53:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:05.974481 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb7c6e-426a-4380-a131-25f421095b79 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:05.977187 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571a0e0-541e-48a0-a033-fa751ff5a5e2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:06.174744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb7c6e-426a-4380-a131-25f421095b79 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:06.177718 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571a0e0-541e-48a0-a033-fa751ff5a5e2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:06.192019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:06.214992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1f176-de7d-4f97-9925-d4973d6172a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:06.215890 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1f176-de7d-4f97-9925-d4973d6172a3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:06.216178 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1f176-de7d-4f97-9925-d4973d6172a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:06.216445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1f176-de7d-4f97-9925-d4973d6172a3 None admin] PATH_INFO: `/v3/groups/b7f9c9216fee4c55a5f067843421084d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:06.223840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1f176-de7d-4f97-9925-d4973d6172a3 None admin] RBAC: Authorizing `identity:get_group(group_id=b7f9c9216fee4c55a5f067843421084d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:06.223840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1f176-de7d-4f97-9925-d4973d6172a3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:06.223840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 206/395] 10.222.0.41 () {56 vars in 1180 bytes} [Mon May 30 11:53:05 2022] GET /identity/v3/groups/b7f9c9216fee4c55a5f067843421084d => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:06.227735 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1f176-de7d-4f97-9925-d4973d6172a3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:06.229274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990034e-84d8-4892-b727-6272ea0d796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:06.230110 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990034e-84d8-4892-b727-6272ea0d796a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:06.230536 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990034e-84d8-4892-b727-6272ea0d796a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:06.230951 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990034e-84d8-4892-b727-6272ea0d796a None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:06.231881 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990034e-84d8-4892-b727-6272ea0d796a None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:06.232410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990034e-84d8-4892-b727-6272ea0d796a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:06.234210 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990034e-84d8-4892-b727-6272ea0d796a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:06.252213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 190/396] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:53:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:06.269648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990034e-84d8-4892-b727-6272ea0d796a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:06.302126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:06.348194 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1f176-de7d-4f97-9925-d4973d6172a3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:06.385060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddb674-2b97-417d-b277-33420bef1598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:06.385925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddb674-2b97-417d-b277-33420bef1598 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:06.386211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddb674-2b97-417d-b277-33420bef1598 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:06.386486 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddb674-2b97-417d-b277-33420bef1598 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:06.388635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ddb674-2b97-417d-b277-33420bef1598 None admin] RBAC: Authorizing `identity:get_project(project_id=138b20881cbe45999d64699abc79c48d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:06.390150 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ddb674-2b97-417d-b277-33420bef1598 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:06.392791 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 207/397] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:53:06 2022] GET /identity/v3/projects/138b20881cbe45999d64699abc79c48d => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:06.398255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddb674-2b97-417d-b277-33420bef1598 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:06.422464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990034e-84d8-4892-b727-6272ea0d796a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:06.464878 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a1158-d3ea-453b-a1f9-9b63ed064c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:06.465934 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a1158-d3ea-453b-a1f9-9b63ed064c37 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:06.466227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a1158-d3ea-453b-a1f9-9b63ed064c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:06.466612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a1158-d3ea-453b-a1f9-9b63ed064c37 None admin] PATH_INFO: `/v3/groups/b7f9c9216fee4c55a5f067843421084d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:06.467843 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a1158-d3ea-453b-a1f9-9b63ed064c37 None admin] RBAC: Authorizing `identity:get_group(group_id=b7f9c9216fee4c55a5f067843421084d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:06.469878 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a1158-d3ea-453b-a1f9-9b63ed064c37 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:06.471647 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 191/398] 10.222.0.41 () {56 vars in 1180 bytes} [Mon May 30 11:53:06 2022] GET /identity/v3/groups/b7f9c9216fee4c55a5f067843421084d => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:06.477332 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a1158-d3ea-453b-a1f9-9b63ed064c37 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:06.509843 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddb674-2b97-417d-b277-33420bef1598 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:06.526431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:06.535609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:06.549189 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54d90b-ee5a-4e3d-9a3d-7d25a2147499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:06.550078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54d90b-ee5a-4e3d-9a3d-7d25a2147499 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:06.550417 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54d90b-ee5a-4e3d-9a3d-7d25a2147499 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:06.550702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54d90b-ee5a-4e3d-9a3d-7d25a2147499 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d/groups/b7f9c9216fee4c55a5f067843421084d/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:06.552746 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54d90b-ee5a-4e3d-9a3d-7d25a2147499 None admin] RBAC: Authorizing `identity:create_grant(project_id=138b20881cbe45999d64699abc79c48d, group_id=b7f9c9216fee4c55a5f067843421084d, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:06.554180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54d90b-ee5a-4e3d-9a3d-7d25a2147499 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:06.572084 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 208/399] 10.222.0.41 () {58 vars in 1442 bytes} [Mon May 30 11:53:06 2022] PUT /identity/v3/projects/138b20881cbe45999d64699abc79c48d/groups/b7f9c9216fee4c55a5f067843421084d/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:53:06.597584 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a1158-d3ea-453b-a1f9-9b63ed064c37 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:06.637560 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d3de9-27a8-4896-83f6-8722cec0cc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:06.638483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d3de9-27a8-4896-83f6-8722cec0cc08 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:06.638773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d3de9-27a8-4896-83f6-8722cec0cc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:06.639052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d3de9-27a8-4896-83f6-8722cec0cc08 None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:06.641103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d3de9-27a8-4896-83f6-8722cec0cc08 None admin] RBAC: Authorizing `identity:get_project(project_id=3bc1541c2b5e4bde81670004fdd58f45)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:06.642711 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d3de9-27a8-4896-83f6-8722cec0cc08 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:06.649550 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 192/400] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:53:06 2022] GET /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:06.651208 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54d90b-ee5a-4e3d-9a3d-7d25a2147499 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:06.794577 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54d90b-ee5a-4e3d-9a3d-7d25a2147499 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:06.832178 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0ce59-d22c-4387-aeb5-151bd2ea6a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:06.833072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0ce59-d22c-4387-aeb5-151bd2ea6a3e None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:06.833358 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0ce59-d22c-4387-aeb5-151bd2ea6a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:06.833639 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0ce59-d22c-4387-aeb5-151bd2ea6a3e None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45/groups/b7f9c9216fee4c55a5f067843421084d/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:06.837165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0ce59-d22c-4387-aeb5-151bd2ea6a3e None admin] RBAC: Authorizing `identity:create_grant(project_id=3bc1541c2b5e4bde81670004fdd58f45, group_id=b7f9c9216fee4c55a5f067843421084d, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:06.838638 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0ce59-d22c-4387-aeb5-151bd2ea6a3e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:06.856492 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 209/401] 10.222.0.41 () {58 vars in 1442 bytes} [Mon May 30 11:53:06 2022] PUT /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45/groups/b7f9c9216fee4c55a5f067843421084d/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:53:07.424913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47641b-26d6-447c-b683-434b29f7487c None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:07.425433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47641b-26d6-447c-b683-434b29f7487c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:07.425433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47641b-26d6-447c-b683-434b29f7487c None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:07.427302 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 193/402] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:07.433285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fe790-fe40-44e0-a16a-350f774583ea None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:07.433823 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fe790-fe40-44e0-a16a-350f774583ea None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:07.434302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fe790-fe40-44e0-a16a-350f774583ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:07.453714 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-242fe790-fe40-44e0-a16a-350f774583ea None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:07.455239 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-242fe790-fe40-44e0-a16a-350f774583ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:07.511981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:07.547969 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 210/403] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:07.593655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47641b-26d6-447c-b683-434b29f7487c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:07.721530 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47641b-26d6-447c-b683-434b29f7487c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:07.732739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:07.764516 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f23c64-9440-4258-97ff-92c0feb85a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:07.765661 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f23c64-9440-4258-97ff-92c0feb85a10 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:07.770984 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f23c64-9440-4258-97ff-92c0feb85a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:07.770984 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f23c64-9440-4258-97ff-92c0feb85a10 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:07.784711 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f23c64-9440-4258-97ff-92c0feb85a10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:07.797271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b7f23c64-9440-4258-97ff-92c0feb85a10 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:53:07.797271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:07.797271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:07.797271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:07.797271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:07.797271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:07.797271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:07.797271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:07.797271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:07.797271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:07.797271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:07.797271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:07.797271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:07.797271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:07.797271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:07.797271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:07.799451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:07.799451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:07.799451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:07.799451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:07.799451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:07.799451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:07.799451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:07.799451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:07.799451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:07.799451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:07.799451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:07.799451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:07.799451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:07.799451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:07.799451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:07.799451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:07.801526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:07.801526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:07.801526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:07.801526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:07.801526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:07.801526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:07.801526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:07.801526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:07.801526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:07.801526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:07.801526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:53:07.801526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:07.801526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 194/404] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:53:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:07.809129 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fe790-fe40-44e0-a16a-350f774583ea None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:07.933503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fe790-fe40-44e0-a16a-350f774583ea None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:07.982994 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bdefd-1183-40cf-b01f-ff9507928ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:07.983592 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bdefd-1183-40cf-b01f-ff9507928ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:07.984027 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bdefd-1183-40cf-b01f-ff9507928ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:07.984389 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bdefd-1183-40cf-b01f-ff9507928ed2 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:07.985203 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bdefd-1183-40cf-b01f-ff9507928ed2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:07.985515 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bdefd-1183-40cf-b01f-ff9507928ed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:07.986894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bdefd-1183-40cf-b01f-ff9507928ed2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:08.000216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 211/405] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:08.005466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f23c64-9440-4258-97ff-92c0feb85a10 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:08.136788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f23c64-9440-4258-97ff-92c0feb85a10 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:08.183319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748cbf1-d213-451f-878d-6ffa884f1015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:08.184620 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748cbf1-d213-451f-878d-6ffa884f1015 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:08.185167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748cbf1-d213-451f-878d-6ffa884f1015 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:08.185644 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748cbf1-d213-451f-878d-6ffa884f1015 None admin] PATH_INFO: `/v3/groups/b7f9c9216fee4c55a5f067843421084d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:08.187731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748cbf1-d213-451f-878d-6ffa884f1015 None admin] RBAC: Authorizing `identity:get_group(group_id=b7f9c9216fee4c55a5f067843421084d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:08.189599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748cbf1-d213-451f-878d-6ffa884f1015 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:08.191497 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 195/406] 10.222.0.41 () {56 vars in 1180 bytes} [Mon May 30 11:53:08 2022] GET /identity/v3/groups/b7f9c9216fee4c55a5f067843421084d => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:08.197107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bdefd-1183-40cf-b01f-ff9507928ed2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:08.199125 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f3e4c-d95e-42bf-9aaf-66fd4ffb554c None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:08.199640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f3e4c-d95e-42bf-9aaf-66fd4ffb554c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:08.200137 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f3e4c-d95e-42bf-9aaf-66fd4ffb554c None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:08.201944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 196/407] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:08.207364 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e8d44-8521-4e58-ab85-731113aa3780 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:08.207651 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e8d44-8521-4e58-ab85-731113aa3780 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:08.207960 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e8d44-8521-4e58-ab85-731113aa3780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:08.225244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-827e8d44-8521-4e58-ab85-731113aa3780 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:08.226440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-827e8d44-8521-4e58-ab85-731113aa3780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:08.259622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:08.298408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 197/408] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:53:08.307030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:08.322053 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e8d44-8521-4e58-ab85-731113aa3780 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:08.425361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e8d44-8521-4e58-ab85-731113aa3780 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:08.460651 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8699ab-6dfb-42fb-8548-4922ed0b3b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:08.461452 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8699ab-6dfb-42fb-8548-4922ed0b3b18 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:08.461897 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8699ab-6dfb-42fb-8548-4922ed0b3b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:08.462316 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8699ab-6dfb-42fb-8548-4922ed0b3b18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:08.462426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bdefd-1183-40cf-b01f-ff9507928ed2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:08.474333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8699ab-6dfb-42fb-8548-4922ed0b3b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:08.482494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-db8699ab-6dfb-42fb-8548-4922ed0b3b18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:53:08.482494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:08.482494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:08.482494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:08.482494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:08.482494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:08.482494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:08.482494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:08.482494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:08.482494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:08.482494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:08.482494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:08.482494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:08.482494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:08.482494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:08.482494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:08.483532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:08.483532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:08.483532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:08.483532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:08.483532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:08.483532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:08.483532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:08.483532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:08.483532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:08.483532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:08.483532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:08.483532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:08.483532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:08.483532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:08.483532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:08.483532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:08.484474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:08.484474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:08.484474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:08.484474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:08.484474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:08.484474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:08.484474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:08.484474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:08.484474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:08.484474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:08.484474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:53:08.484474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:08.491593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 198/409] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:53:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:53:08.493097 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8699ab-6dfb-42fb-8548-4922ed0b3b18 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:08.525001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:08.537100 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e39fb5-4fc2-4656-9bd6-35a7c88e700d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:08.538199 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e39fb5-4fc2-4656-9bd6-35a7c88e700d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:08.538601 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e39fb5-4fc2-4656-9bd6-35a7c88e700d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:08.538957 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e39fb5-4fc2-4656-9bd6-35a7c88e700d None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:08.544628 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e39fb5-4fc2-4656-9bd6-35a7c88e700d None admin] RBAC: Authorizing `identity:get_project(project_id=138b20881cbe45999d64699abc79c48d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:08.546387 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e39fb5-4fc2-4656-9bd6-35a7c88e700d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:08.552854 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 212/410] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:53:08 2022] GET /identity/v3/projects/138b20881cbe45999d64699abc79c48d => generated 302 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:08.558016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e39fb5-4fc2-4656-9bd6-35a7c88e700d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:08.609081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8699ab-6dfb-42fb-8548-4922ed0b3b18 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:08.645807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c238dc7-2bd2-4ca1-9387-c0ac84c6febc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:08.646865 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c238dc7-2bd2-4ca1-9387-c0ac84c6febc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:08.647331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c238dc7-2bd2-4ca1-9387-c0ac84c6febc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:08.647858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c238dc7-2bd2-4ca1-9387-c0ac84c6febc None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:08.648785 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c238dc7-2bd2-4ca1-9387-c0ac84c6febc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:08.649283 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c238dc7-2bd2-4ca1-9387-c0ac84c6febc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:08.650851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c238dc7-2bd2-4ca1-9387-c0ac84c6febc None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:08.664010 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 199/411] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:08.667694 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c238dc7-2bd2-4ca1-9387-c0ac84c6febc None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:08.766968 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:08.778769 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c238dc7-2bd2-4ca1-9387-c0ac84c6febc None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:08.814983 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17fd15-8f6e-46fb-b7b2-225578ce223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:08.816118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17fd15-8f6e-46fb-b7b2-225578ce223c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:08.816553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17fd15-8f6e-46fb-b7b2-225578ce223c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:08.817001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17fd15-8f6e-46fb-b7b2-225578ce223c None admin] PATH_INFO: `/v3/groups/539dd332d3ee4d4ab37ff619bdb3220b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:08.818416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17fd15-8f6e-46fb-b7b2-225578ce223c None admin] RBAC: Authorizing `identity:get_group(group_id=539dd332d3ee4d4ab37ff619bdb3220b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:08.820041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17fd15-8f6e-46fb-b7b2-225578ce223c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:08.822158 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 200/412] 10.222.0.41 () {56 vars in 1180 bytes} [Mon May 30 11:53:08 2022] GET /identity/v3/groups/539dd332d3ee4d4ab37ff619bdb3220b => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:08.828567 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17fd15-8f6e-46fb-b7b2-225578ce223c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:08.851990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e39fb5-4fc2-4656-9bd6-35a7c88e700d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:08.860224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:08.925873 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ceb24-d575-454e-add6-f196fd7d08fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:08.926765 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ceb24-d575-454e-add6-f196fd7d08fa None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:08.927049 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ceb24-d575-454e-add6-f196fd7d08fa None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:08.927323 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ceb24-d575-454e-add6-f196fd7d08fa None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d/groups/b7f9c9216fee4c55a5f067843421084d/roles/d50989dd2d24440f9724d5d7975df7cf` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:08.930372 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ceb24-d575-454e-add6-f196fd7d08fa None admin] RBAC: Authorizing `identity:create_grant(project_id=138b20881cbe45999d64699abc79c48d, group_id=b7f9c9216fee4c55a5f067843421084d, role_id=d50989dd2d24440f9724d5d7975df7cf)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:08.931997 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ceb24-d575-454e-add6-f196fd7d08fa None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:08.949629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 213/413] 10.222.0.41 () {58 vars in 1442 bytes} [Mon May 30 11:53:08 2022] PUT /identity/v3/projects/138b20881cbe45999d64699abc79c48d/groups/b7f9c9216fee4c55a5f067843421084d/roles/d50989dd2d24440f9724d5d7975df7cf => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:53:08.951375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3116d-120c-4e47-8945-437dfa50c4f8 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:08.951713 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3116d-120c-4e47-8945-437dfa50c4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:08.952059 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3116d-120c-4e47-8945-437dfa50c4f8 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:08.954951 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 214/414] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:08.966346 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e471a-cd44-49cf-8ffa-1038fb979f14 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:08.966346 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e471a-cd44-49cf-8ffa-1038fb979f14 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:08.966346 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e471a-cd44-49cf-8ffa-1038fb979f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:08.986083 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-382e471a-cd44-49cf-8ffa-1038fb979f14 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:08.987591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-382e471a-cd44-49cf-8ffa-1038fb979f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:09.014050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17fd15-8f6e-46fb-b7b2-225578ce223c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:09.078230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 215/415] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:53:09.097626 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afabef-0a21-4648-a310-845673d1c0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:09.098878 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afabef-0a21-4648-a310-845673d1c0dd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:09.099422 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afabef-0a21-4648-a310-845673d1c0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:09.099945 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afabef-0a21-4648-a310-845673d1c0dd None admin] PATH_INFO: `/v3/projects/93674931dbb347aea1d901cb89aa3b24` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:09.101478 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afabef-0a21-4648-a310-845673d1c0dd None admin] RBAC: Authorizing `identity:get_project(project_id=93674931dbb347aea1d901cb89aa3b24)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:09.103185 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afabef-0a21-4648-a310-845673d1c0dd None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:09.105945 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 201/416] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:53:08 2022] GET /identity/v3/projects/93674931dbb347aea1d901cb89aa3b24 => generated 344 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:09.106170 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e471a-cd44-49cf-8ffa-1038fb979f14 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:09.112188 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afabef-0a21-4648-a310-845673d1c0dd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:09.159761 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:09.229050 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:09.240494 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e471a-cd44-49cf-8ffa-1038fb979f14 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:09.262629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afabef-0a21-4648-a310-845673d1c0dd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:09.301146 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e650498-03d3-4cfd-8718-94a076491455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:09.302173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e650498-03d3-4cfd-8718-94a076491455 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:09.302463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e650498-03d3-4cfd-8718-94a076491455 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:09.302742 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e650498-03d3-4cfd-8718-94a076491455 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:09.302856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86165e12-179c-4849-8980-40b07852e417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:09.303632 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86165e12-179c-4849-8980-40b07852e417 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:09.303947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86165e12-179c-4849-8980-40b07852e417 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:09.304230 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86165e12-179c-4849-8980-40b07852e417 None admin] PATH_INFO: `/v3/projects/93674931dbb347aea1d901cb89aa3b24/groups/539dd332d3ee4d4ab37ff619bdb3220b/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:09.306466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86165e12-179c-4849-8980-40b07852e417 None admin] RBAC: Authorizing `identity:create_grant(project_id=93674931dbb347aea1d901cb89aa3b24, group_id=539dd332d3ee4d4ab37ff619bdb3220b, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:09.307953 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86165e12-179c-4849-8980-40b07852e417 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:09.325378 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 202/417] 10.222.0.41 () {58 vars in 1442 bytes} [Mon May 30 11:53:09 2022] PUT /identity/v3/projects/93674931dbb347aea1d901cb89aa3b24/groups/539dd332d3ee4d4ab37ff619bdb3220b/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:53:09.333241 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e650498-03d3-4cfd-8718-94a076491455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:09.342702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-1e650498-03d3-4cfd-8718-94a076491455 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:53:09.342702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:09.342702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:09.342702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:09.342702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:09.342702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:09.342702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:09.342702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:09.342702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:09.342702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:09.342702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:09.342702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:09.342702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:09.342702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:09.342702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:09.342702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:09.343929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:09.343929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:09.343929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:09.343929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:09.343929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:09.343929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:09.343929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:09.343929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:09.343929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:09.343929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:09.343929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:09.343929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:09.343929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:09.343929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:09.343929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:09.343929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:09.345335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:09.345335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:09.345335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:09.345335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:09.345335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:09.345335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:09.345335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:09.345335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:09.345335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:09.345335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:09.345335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:53:09.345335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:09.345335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 216/418] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:53:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:53:09.350209 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86165e12-179c-4849-8980-40b07852e417 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:09.449642 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:09.467538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86165e12-179c-4849-8980-40b07852e417 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:09.507508 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b60dc-f563-4964-abfe-cd0f93a27fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:09.508242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b60dc-f563-4964-abfe-cd0f93a27fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:09.508530 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b60dc-f563-4964-abfe-cd0f93a27fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:09.508814 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b60dc-f563-4964-abfe-cd0f93a27fa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:09.509594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b60dc-f563-4964-abfe-cd0f93a27fa5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:09.509909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b60dc-f563-4964-abfe-cd0f93a27fa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:09.511349 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b60dc-f563-4964-abfe-cd0f93a27fa5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:09.522306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 203/419] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:09.528471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e650498-03d3-4cfd-8718-94a076491455 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:09.649151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e650498-03d3-4cfd-8718-94a076491455 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:09.701825 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf796d0-c5d4-4b10-94cc-931bc57c8e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:09.703395 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf796d0-c5d4-4b10-94cc-931bc57c8e1d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:09.703907 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf796d0-c5d4-4b10-94cc-931bc57c8e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:09.704403 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf796d0-c5d4-4b10-94cc-931bc57c8e1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:09.742160 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:09.804590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf796d0-c5d4-4b10-94cc-931bc57c8e1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:09.806067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf796d0-c5d4-4b10-94cc-931bc57c8e1d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:09.889662 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654a8b9-17b0-40ec-9992-0b869c8adbed None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:09.890510 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654a8b9-17b0-40ec-9992-0b869c8adbed None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:09.890849 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654a8b9-17b0-40ec-9992-0b869c8adbed None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:09.892451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 204/420] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:09.900514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9e94e-6196-485f-87ba-3b31a6204f0f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:09.901055 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9e94e-6196-485f-87ba-3b31a6204f0f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:09.901547 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9e94e-6196-485f-87ba-3b31a6204f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:09.919341 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 217/421] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:09.924997 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf796d0-c5d4-4b10-94cc-931bc57c8e1d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:09.945238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a6c9e94e-6196-485f-87ba-3b31a6204f0f None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:09.946480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a6c9e94e-6196-485f-87ba-3b31a6204f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:09.998844 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:10.027854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 205/422] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:10.029767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3869798-507a-4898-98ef-6a976fd1c9d6 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:10.030350 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3869798-507a-4898-98ef-6a976fd1c9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:10.031506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3869798-507a-4898-98ef-6a976fd1c9d6 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:10.033046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 206/423] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:10.038679 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b3d03-03ea-491d-b939-4a35c48d98cc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:10.039191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b3d03-03ea-491d-b939-4a35c48d98cc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:10.039764 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b3d03-03ea-491d-b939-4a35c48d98cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:10.048120 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf796d0-c5d4-4b10-94cc-931bc57c8e1d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:10.060530 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9b9b3d03-03ea-491d-b939-4a35c48d98cc None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:10.063064 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9b9b3d03-03ea-491d-b939-4a35c48d98cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:10.085511 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e9d61-b026-4e26-921d-d1b1783528b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:10.086425 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e9d61-b026-4e26-921d-d1b1783528b9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:10.086717 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e9d61-b026-4e26-921d-d1b1783528b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:10.087329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e9d61-b026-4e26-921d-d1b1783528b9 None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:10.088237 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e9d61-b026-4e26-921d-d1b1783528b9 None admin] RBAC: Authorizing `identity:get_project(project_id=3bc1541c2b5e4bde81670004fdd58f45)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:10.089785 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e9d61-b026-4e26-921d-d1b1783528b9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:10.096791 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 218/424] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:53:09 2022] GET /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:10.097662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e9d61-b026-4e26-921d-d1b1783528b9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:10.141483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 207/425] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:10.148728 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b3d03-03ea-491d-b939-4a35c48d98cc None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:10.168272 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:10.205130 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e9d61-b026-4e26-921d-d1b1783528b9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:10.228986 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:10.241212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd574fa7-c984-4680-99c3-b501c0ec3663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:10.242017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd574fa7-c984-4680-99c3-b501c0ec3663 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:10.242305 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd574fa7-c984-4680-99c3-b501c0ec3663 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:10.242587 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd574fa7-c984-4680-99c3-b501c0ec3663 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:10.254364 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd574fa7-c984-4680-99c3-b501c0ec3663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:10.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-fd574fa7-c984-4680-99c3-b501c0ec3663 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:53:10.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:10.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:10.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:10.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:10.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:10.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:10.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:10.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:10.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:10.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:10.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:10.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:10.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:10.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:10.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:10.263244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:10.263244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:10.263244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:10.263244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:10.263244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:10.263244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:10.263244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:10.263244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:10.263244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:10.263244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:10.263244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:10.263244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:10.263244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:10.263244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:10.263244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:10.263244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:10.264058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:10.264058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:10.264058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:10.264058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:10.264058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:10.264058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:10.264058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:10.264058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:10.264058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:10.264058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:10.264058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:53:10.264058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:10.264058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 219/426] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:10.265942 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd574fa7-c984-4680-99c3-b501c0ec3663 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:10.284929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b3d03-03ea-491d-b939-4a35c48d98cc None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:10.322761 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000437ff-75b4-43c7-bbda-6ae47ca0bc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:10.324182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000437ff-75b4-43c7-bbda-6ae47ca0bc26 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:10.324667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000437ff-75b4-43c7-bbda-6ae47ca0bc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:10.325139 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000437ff-75b4-43c7-bbda-6ae47ca0bc26 None admin] PATH_INFO: `/v3/groups/b7f9c9216fee4c55a5f067843421084d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:10.326624 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000437ff-75b4-43c7-bbda-6ae47ca0bc26 None admin] RBAC: Authorizing `identity:get_group(group_id=b7f9c9216fee4c55a5f067843421084d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:10.329201 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000437ff-75b4-43c7-bbda-6ae47ca0bc26 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:10.331316 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 208/427] 10.222.0.41 () {56 vars in 1180 bytes} [Mon May 30 11:53:10 2022] GET /identity/v3/groups/b7f9c9216fee4c55a5f067843421084d => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:10.332309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000437ff-75b4-43c7-bbda-6ae47ca0bc26 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:10.377848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd574fa7-c984-4680-99c3-b501c0ec3663 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:10.415158 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5bb54-e0ae-4e95-9ad3-a882c5608bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:10.415999 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5bb54-e0ae-4e95-9ad3-a882c5608bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:10.416329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5bb54-e0ae-4e95-9ad3-a882c5608bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:10.416615 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5bb54-e0ae-4e95-9ad3-a882c5608bd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:10.428419 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5bb54-e0ae-4e95-9ad3-a882c5608bd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:10.436300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-80e5bb54-e0ae-4e95-9ad3-a882c5608bd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:53:10.436300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:10.436300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:10.436300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:10.436300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:10.436300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:10.436300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:10.436300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:10.436300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:10.436300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:10.436300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:10.436300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:10.436300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:10.436300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:10.436300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:10.436300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:10.437293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:10.437293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:10.437293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:10.437293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:10.437293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:10.437293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:10.437293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:10.437293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:10.437293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:10.437293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:10.437293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:10.437293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:10.437293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:10.437293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:10.437293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:10.437293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:10.438204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:10.438204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:10.438204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:10.438204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:10.438204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:10.438204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:10.438204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:10.438204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:10.438204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:10.438204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:10.438204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:53:10.438204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:10.438204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 220/428] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:10.438849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5bb54-e0ae-4e95-9ad3-a882c5608bd7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:10.452273 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:10.457883 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000437ff-75b4-43c7-bbda-6ae47ca0bc26 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:10.486534 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:10.499677 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0b998-4164-4638-aa78-2596ecd2b0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:10.500772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0b998-4164-4638-aa78-2596ecd2b0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:10.501308 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0b998-4164-4638-aa78-2596ecd2b0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:10.501783 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0b998-4164-4638-aa78-2596ecd2b0f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:10.502729 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0b998-4164-4638-aa78-2596ecd2b0f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:10.503356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0b998-4164-4638-aa78-2596ecd2b0f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:10.505063 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0b998-4164-4638-aa78-2596ecd2b0f1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:10.514591 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 209/429] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:53:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:10.516397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0b998-4164-4638-aa78-2596ecd2b0f1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:10.549305 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5bb54-e0ae-4e95-9ad3-a882c5608bd7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:10.585432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cfa79-bb05-4d13-a31a-2cbf0f3deb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:10.585931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cfa79-bb05-4d13-a31a-2cbf0f3deb7c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:10.586226 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cfa79-bb05-4d13-a31a-2cbf0f3deb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:10.586513 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cfa79-bb05-4d13-a31a-2cbf0f3deb7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:10.587360 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cfa79-bb05-4d13-a31a-2cbf0f3deb7c None admin] RBAC: Adding query filter params (group.id=b7f9c9216fee4c55a5f067843421084d, role.id=d50989dd2d24440f9724d5d7975df7cf, scope.project.id=3bc1541c2b5e4bde81670004fdd58f45) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:10.587734 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cfa79-bb05-4d13-a31a-2cbf0f3deb7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:10.589241 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cfa79-bb05-4d13-a31a-2cbf0f3deb7c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:10.596102 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 221/430] 10.222.0.41 () {56 vars in 1376 bytes} [Mon May 30 11:53:10 2022] GET /identity/v3/role_assignments?group.id=b7f9c9216fee4c55a5f067843421084d&scope.project.id=3bc1541c2b5e4bde81670004fdd58f45&role.id=d50989dd2d24440f9724d5d7975df7cf => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:10.604169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cfa79-bb05-4d13-a31a-2cbf0f3deb7c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:10.631362 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0b998-4164-4638-aa78-2596ecd2b0f1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:10.674826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae397b-f3a9-43b9-ad4b-d18831695ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:10.676043 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae397b-f3a9-43b9-ad4b-d18831695ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:10.676527 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae397b-f3a9-43b9-ad4b-d18831695ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:10.677017 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae397b-f3a9-43b9-ad4b-d18831695ad7 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:10.677988 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae397b-f3a9-43b9-ad4b-d18831695ad7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:10.678549 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae397b-f3a9-43b9-ad4b-d18831695ad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:10.680178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae397b-f3a9-43b9-ad4b-d18831695ad7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:10.686284 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:10.691316 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 210/431] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:53:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:10.701640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae397b-f3a9-43b9-ad4b-d18831695ad7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:10.804170 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cfa79-bb05-4d13-a31a-2cbf0f3deb7c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:10.812249 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:10.820829 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae397b-f3a9-43b9-ad4b-d18831695ad7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:10.865872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38f044-2c45-42b9-93a3-5f10b4571efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:10.866924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6e2ae-bab2-4873-b22b-413858dcc0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:10.867847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38f044-2c45-42b9-93a3-5f10b4571efe None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:10.868334 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38f044-2c45-42b9-93a3-5f10b4571efe None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:10.868823 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38f044-2c45-42b9-93a3-5f10b4571efe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:10.870353 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6e2ae-bab2-4873-b22b-413858dcc0ce None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:10.873292 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6e2ae-bab2-4873-b22b-413858dcc0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:10.873838 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6e2ae-bab2-4873-b22b-413858dcc0ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:10.973647 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:10.981498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38f044-2c45-42b9-93a3-5f10b4571efe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:10.983487 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38f044-2c45-42b9-93a3-5f10b4571efe None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:10.988907 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6e2ae-bab2-4873-b22b-413858dcc0ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:10.989856 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6e2ae-bab2-4873-b22b-413858dcc0ce None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:11.112113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 222/432] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:11.117737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6e2ae-bab2-4873-b22b-413858dcc0ce None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:11.123411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 211/433] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 30 11:53:11.126714 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:11.129361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38f044-2c45-42b9-93a3-5f10b4571efe None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:11.235095 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6e2ae-bab2-4873-b22b-413858dcc0ce None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:11.262969 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:11.269954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38f044-2c45-42b9-93a3-5f10b4571efe None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:11.273457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d459139-9fc3-4938-b974-5231e699d906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:11.274247 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d459139-9fc3-4938-b974-5231e699d906 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:11.274606 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d459139-9fc3-4938-b974-5231e699d906 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:11.274956 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d459139-9fc3-4938-b974-5231e699d906 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:11.276279 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d459139-9fc3-4938-b974-5231e699d906 None admin] RBAC: Authorizing `identity:get_project(project_id=138b20881cbe45999d64699abc79c48d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:11.277807 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d459139-9fc3-4938-b974-5231e699d906 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:11.284288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 223/434] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:53:11 2022] GET /identity/v3/projects/138b20881cbe45999d64699abc79c48d => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:11.286449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d459139-9fc3-4938-b974-5231e699d906 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:11.322663 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702cc6d-fa97-4d80-89cc-de422749de0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:11.324530 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702cc6d-fa97-4d80-89cc-de422749de0c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:11.324997 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702cc6d-fa97-4d80-89cc-de422749de0c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:11.325726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702cc6d-fa97-4d80-89cc-de422749de0c None admin] PATH_INFO: `/v3/projects/3bc1541c2b5e4bde81670004fdd58f45` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:11.328577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702cc6d-fa97-4d80-89cc-de422749de0c None admin] RBAC: Authorizing `identity:get_project(project_id=3bc1541c2b5e4bde81670004fdd58f45)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:11.330067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702cc6d-fa97-4d80-89cc-de422749de0c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:11.332052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 212/435] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:53:11 2022] GET /identity/v3/projects/3bc1541c2b5e4bde81670004fdd58f45 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:11.340588 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702cc6d-fa97-4d80-89cc-de422749de0c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:11.381243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:11.411654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d459139-9fc3-4938-b974-5231e699d906 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:11.453409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e7d1b-0ea9-45fa-aef7-04ece3433999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:11.454499 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e7d1b-0ea9-45fa-aef7-04ece3433999 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:11.454749 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e7d1b-0ea9-45fa-aef7-04ece3433999 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:11.455035 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e7d1b-0ea9-45fa-aef7-04ece3433999 None admin] PATH_INFO: `/v3/groups/b7f9c9216fee4c55a5f067843421084d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:11.456430 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e7d1b-0ea9-45fa-aef7-04ece3433999 None admin] RBAC: Authorizing `identity:get_group(group_id=b7f9c9216fee4c55a5f067843421084d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:11.458042 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e7d1b-0ea9-45fa-aef7-04ece3433999 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:11.464448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702cc6d-fa97-4d80-89cc-de422749de0c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:11.464986 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 224/436] 10.222.0.41 () {56 vars in 1180 bytes} [Mon May 30 11:53:11 2022] GET /identity/v3/groups/b7f9c9216fee4c55a5f067843421084d => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:11.466274 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e7d1b-0ea9-45fa-aef7-04ece3433999 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:11.503168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b838c-87e8-477d-a3cd-bb87e9f5faa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:11.504285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b838c-87e8-477d-a3cd-bb87e9f5faa8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:11.504715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b838c-87e8-477d-a3cd-bb87e9f5faa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:11.505136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b838c-87e8-477d-a3cd-bb87e9f5faa8 None admin] PATH_INFO: `/v3/groups/b7f9c9216fee4c55a5f067843421084d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:11.506481 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b838c-87e8-477d-a3cd-bb87e9f5faa8 None admin] RBAC: Authorizing `identity:get_group(group_id=b7f9c9216fee4c55a5f067843421084d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:11.508125 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b838c-87e8-477d-a3cd-bb87e9f5faa8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:11.510248 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 213/437] 10.222.0.41 () {56 vars in 1180 bytes} [Mon May 30 11:53:11 2022] GET /identity/v3/groups/b7f9c9216fee4c55a5f067843421084d => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:11.518530 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b838c-87e8-477d-a3cd-bb87e9f5faa8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:11.557240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:11.591410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e7d1b-0ea9-45fa-aef7-04ece3433999 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:11.630811 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e7b84-af1e-466b-ab3a-d32d9745647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:11.631657 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e7b84-af1e-466b-ab3a-d32d9745647c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:11.632053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e7b84-af1e-466b-ab3a-d32d9745647c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:11.632432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e7b84-af1e-466b-ab3a-d32d9745647c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:11.633352 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e7b84-af1e-466b-ab3a-d32d9745647c None admin] RBAC: Adding query filter params (group.id=b7f9c9216fee4c55a5f067843421084d, role.id=5674314ace5445ccbca611d8cfdc25f1, scope.project.id=138b20881cbe45999d64699abc79c48d) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:11.633744 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e7b84-af1e-466b-ab3a-d32d9745647c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:11.635515 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e7b84-af1e-466b-ab3a-d32d9745647c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:11.642321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b838c-87e8-477d-a3cd-bb87e9f5faa8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:11.647925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 225/438] 10.222.0.41 () {56 vars in 1376 bytes} [Mon May 30 11:53:11 2022] GET /identity/v3/role_assignments?group.id=b7f9c9216fee4c55a5f067843421084d&scope.project.id=138b20881cbe45999d64699abc79c48d&role.id=5674314ace5445ccbca611d8cfdc25f1 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:11.657580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83f724-763c-4162-b6e1-19a985986612 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:11.657928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83f724-763c-4162-b6e1-19a985986612 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:11.658147 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83f724-763c-4162-b6e1-19a985986612 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:11.659728 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 226/439] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:53:11.665372 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69351431-8982-46c9-aab8-bcc6514f05d4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:11.665651 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69351431-8982-46c9-aab8-bcc6514f05d4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:11.665853 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69351431-8982-46c9-aab8-bcc6514f05d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:11.677619 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:11.684011 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-69351431-8982-46c9-aab8-bcc6514f05d4 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:11.685382 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-69351431-8982-46c9-aab8-bcc6514f05d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:11.700917 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34020d12-6b6c-4870-93e3-ded483956e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:11.702110 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34020d12-6b6c-4870-93e3-ded483956e3c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:11.703471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34020d12-6b6c-4870-93e3-ded483956e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:11.704152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34020d12-6b6c-4870-93e3-ded483956e3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:11.705207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34020d12-6b6c-4870-93e3-ded483956e3c None admin] RBAC: Adding query filter params (group.id=b7f9c9216fee4c55a5f067843421084d, role.id=5674314ace5445ccbca611d8cfdc25f1, scope.project.id=3bc1541c2b5e4bde81670004fdd58f45) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:11.705739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34020d12-6b6c-4870-93e3-ded483956e3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:11.708519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34020d12-6b6c-4870-93e3-ded483956e3c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:11.723697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 214/440] 10.222.0.41 () {56 vars in 1376 bytes} [Mon May 30 11:53:11 2022] GET /identity/v3/role_assignments?group.id=b7f9c9216fee4c55a5f067843421084d&scope.project.id=3bc1541c2b5e4bde81670004fdd58f45&role.id=5674314ace5445ccbca611d8cfdc25f1 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:11.770315 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 227/441] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:53:11.794883 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34020d12-6b6c-4870-93e3-ded483956e3c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:11.916643 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:11.920230 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34020d12-6b6c-4870-93e3-ded483956e3c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:11.959562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f01e0e-6e1e-4657-8c68-3fdfd4af98e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:11.960416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f01e0e-6e1e-4657-8c68-3fdfd4af98e5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:11.960775 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f01e0e-6e1e-4657-8c68-3fdfd4af98e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:11.961139 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f01e0e-6e1e-4657-8c68-3fdfd4af98e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:11.974451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f01e0e-6e1e-4657-8c68-3fdfd4af98e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:11.983094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-e2f01e0e-6e1e-4657-8c68-3fdfd4af98e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:53:11.983094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:11.983094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:11.983094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:11.983094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:11.983094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:11.983094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:11.983094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:11.983094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:11.983094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:11.983094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:11.983094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:11.983094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:11.983094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:11.983094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:11.983094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:11.984570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:11.984570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:11.984570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:11.984570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:11.984570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:11.984570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:11.984570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:11.984570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:11.984570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:11.984570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:11.984570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:11.984570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:11.984570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:11.984570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:11.984570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:11.984570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:11.985452 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:11.985452 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:11.985452 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:11.985452 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:11.985452 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:11.985452 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:11.985452 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:11.985452 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:11.985452 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:11.985452 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:11.985452 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:53:11.985452 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:11.986079 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 215/442] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:53:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:11.992383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69351431-8982-46c9-aab8-bcc6514f05d4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:12.085137 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0455f0-3890-431a-9c88-cbafbf71de57 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:12.085763 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0455f0-3890-431a-9c88-cbafbf71de57 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:12.086243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0455f0-3890-431a-9c88-cbafbf71de57 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:12.087797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 216/443] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:12.093126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8939da-7236-49ba-82ba-7175604330ba None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:12.093610 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8939da-7236-49ba-82ba-7175604330ba None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:12.093932 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8939da-7236-49ba-82ba-7175604330ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:12.101949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69351431-8982-46c9-aab8-bcc6514f05d4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:12.117189 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-eb8939da-7236-49ba-82ba-7175604330ba None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:12.118973 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-eb8939da-7236-49ba-82ba-7175604330ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:12.142396 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe529824-b660-4848-a0a4-7e6dd467e297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:12.143070 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe529824-b660-4848-a0a4-7e6dd467e297 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:12.143363 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe529824-b660-4848-a0a4-7e6dd467e297 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:12.143644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe529824-b660-4848-a0a4-7e6dd467e297 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:12.144444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe529824-b660-4848-a0a4-7e6dd467e297 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:12.144759 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe529824-b660-4848-a0a4-7e6dd467e297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:12.146168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe529824-b660-4848-a0a4-7e6dd467e297 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:12.148689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:12.158644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 228/444] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:12.163902 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe529824-b660-4848-a0a4-7e6dd467e297 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:12.206942 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 217/445] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:53:12.231400 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8939da-7236-49ba-82ba-7175604330ba None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:12.282620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe529824-b660-4848-a0a4-7e6dd467e297 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:12.322124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a009ca7-cc65-4c9d-9491-c6bea747882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:12.322929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a009ca7-cc65-4c9d-9491-c6bea747882a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:12.323072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a009ca7-cc65-4c9d-9491-c6bea747882a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:12.323258 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a009ca7-cc65-4c9d-9491-c6bea747882a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:12.338327 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:12.351089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8939da-7236-49ba-82ba-7175604330ba None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:12.392976 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e0695-926a-4729-b233-e62838b883a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:12.393861 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e0695-926a-4729-b233-e62838b883a2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:12.394062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e0695-926a-4729-b233-e62838b883a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:12.394332 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e0695-926a-4729-b233-e62838b883a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:12.407125 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e0695-926a-4729-b233-e62838b883a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:12.408317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:12.415041 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a009ca7-cc65-4c9d-9491-c6bea747882a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:12.415405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-055e0695-926a-4729-b233-e62838b883a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:53:12.415405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:12.415405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:12.415405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:12.415405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:12.415405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:12.415405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:12.415405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:12.415405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:12.415405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:12.415405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:12.415405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:12.415405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:12.415405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:12.415405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:12.415405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:12.416370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:12.416370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:12.416370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:12.416370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:12.416370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:12.416370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:12.416370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:12.416370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:12.416370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:12.416370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:12.416370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:12.416370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:12.416370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:12.416370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:12.416370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:12.416370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:12.417266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:12.417266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:12.417266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:12.417266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:12.417266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:12.417266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:12.417266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:12.417266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:12.417266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:12.417266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:12.417266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:53:12.417266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:12.418007 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a009ca7-cc65-4c9d-9491-c6bea747882a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:12.418085 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 218/446] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:53:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:12.424827 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e0695-926a-4729-b233-e62838b883a2 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:12.538202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 229/447] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 30 11:53:12.542982 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e0695-926a-4729-b233-e62838b883a2 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:12.543604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a009ca7-cc65-4c9d-9491-c6bea747882a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:12.576832 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539b384-3d7e-42de-9c47-b06d2f51d73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:12.578157 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539b384-3d7e-42de-9c47-b06d2f51d73c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:12.578436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539b384-3d7e-42de-9c47-b06d2f51d73c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:12.578713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539b384-3d7e-42de-9c47-b06d2f51d73c None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:12.579464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539b384-3d7e-42de-9c47-b06d2f51d73c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:12.579775 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539b384-3d7e-42de-9c47-b06d2f51d73c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:12.581194 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539b384-3d7e-42de-9c47-b06d2f51d73c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:12.589580 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 219/448] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:12.595088 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539b384-3d7e-42de-9c47-b06d2f51d73c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:12.610305 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:12.638814 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:12.642716 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a009ca7-cc65-4c9d-9491-c6bea747882a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:12.678176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4d4e7-1e4a-454f-b5f5-20542dc7aee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:12.679026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4d4e7-1e4a-454f-b5f5-20542dc7aee1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:12.679307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4d4e7-1e4a-454f-b5f5-20542dc7aee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:12.679583 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4d4e7-1e4a-454f-b5f5-20542dc7aee1 None admin] PATH_INFO: `/v3/projects/138b20881cbe45999d64699abc79c48d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:12.680803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4d4e7-1e4a-454f-b5f5-20542dc7aee1 None admin] RBAC: Authorizing `identity:get_project(project_id=138b20881cbe45999d64699abc79c48d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:12.682248 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4d4e7-1e4a-454f-b5f5-20542dc7aee1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:12.683964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 230/449] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:53:12 2022] GET /identity/v3/projects/138b20881cbe45999d64699abc79c48d => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:12.689955 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4d4e7-1e4a-454f-b5f5-20542dc7aee1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:12.694670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539b384-3d7e-42de-9c47-b06d2f51d73c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:12.727876 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af372b6b-d4ba-47cc-9e5e-391cc1744b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:12.728926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af372b6b-d4ba-47cc-9e5e-391cc1744b28 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:12.729220 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af372b6b-d4ba-47cc-9e5e-391cc1744b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:12.729506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af372b6b-d4ba-47cc-9e5e-391cc1744b28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:12.790895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4d4e7-1e4a-454f-b5f5-20542dc7aee1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:12.803158 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af372b6b-d4ba-47cc-9e5e-391cc1744b28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:12.804647 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af372b6b-d4ba-47cc-9e5e-391cc1744b28 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:12.818013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:12.826226 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fda844-1ff5-4994-9e42-71ce55b496f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:12.827078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fda844-1ff5-4994-9e42-71ce55b496f6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:12.827904 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fda844-1ff5-4994-9e42-71ce55b496f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:12.828185 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fda844-1ff5-4994-9e42-71ce55b496f6 None admin] PATH_INFO: `/v3/groups/b7f9c9216fee4c55a5f067843421084d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:12.829377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fda844-1ff5-4994-9e42-71ce55b496f6 None admin] RBAC: Authorizing `identity:get_group(group_id=b7f9c9216fee4c55a5f067843421084d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:12.830796 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fda844-1ff5-4994-9e42-71ce55b496f6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:12.832449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 231/450] 10.222.0.41 () {56 vars in 1180 bytes} [Mon May 30 11:53:12 2022] GET /identity/v3/groups/b7f9c9216fee4c55a5f067843421084d => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:12.838049 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fda844-1ff5-4994-9e42-71ce55b496f6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:12.870798 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:12.904773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 220/451] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 30 11:53:12.910294 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af372b6b-d4ba-47cc-9e5e-391cc1744b28 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:12.938335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fda844-1ff5-4994-9e42-71ce55b496f6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:12.972069 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afaf50a-bf65-4e63-bb36-95ee848aa8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:12.972717 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afaf50a-bf65-4e63-bb36-95ee848aa8ac None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:12.973002 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afaf50a-bf65-4e63-bb36-95ee848aa8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:12.973284 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afaf50a-bf65-4e63-bb36-95ee848aa8ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:12.974122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afaf50a-bf65-4e63-bb36-95ee848aa8ac None admin] RBAC: Adding query filter params (group.id=b7f9c9216fee4c55a5f067843421084d, role.id=d50989dd2d24440f9724d5d7975df7cf, scope.project.id=138b20881cbe45999d64699abc79c48d) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:12.974438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afaf50a-bf65-4e63-bb36-95ee848aa8ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:12.975884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afaf50a-bf65-4e63-bb36-95ee848aa8ac None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:12.981636 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 232/452] 10.222.0.41 () {56 vars in 1376 bytes} [Mon May 30 11:53:12 2022] GET /identity/v3/role_assignments?group.id=b7f9c9216fee4c55a5f067843421084d&scope.project.id=138b20881cbe45999d64699abc79c48d&role.id=d50989dd2d24440f9724d5d7975df7cf => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:13.009909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af372b6b-d4ba-47cc-9e5e-391cc1744b28 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:13.025353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:13.047710 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1935a-619a-4e8f-a6e9-827a3637b9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:13.048641 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1935a-619a-4e8f-a6e9-827a3637b9bc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:13.048929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1935a-619a-4e8f-a6e9-827a3637b9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:13.049208 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1935a-619a-4e8f-a6e9-827a3637b9bc None admin] PATH_INFO: `/v3/projects/93674931dbb347aea1d901cb89aa3b24` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:13.050496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1935a-619a-4e8f-a6e9-827a3637b9bc None admin] RBAC: Authorizing `identity:get_project(project_id=93674931dbb347aea1d901cb89aa3b24)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:13.052021 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1935a-619a-4e8f-a6e9-827a3637b9bc None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:13.053824 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 221/453] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:53:12 2022] GET /identity/v3/projects/93674931dbb347aea1d901cb89aa3b24 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:13.059435 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afaf50a-bf65-4e63-bb36-95ee848aa8ac None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:13.164084 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:13.168263 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afaf50a-bf65-4e63-bb36-95ee848aa8ac None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:13.204061 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c09e60-bc2e-440f-b5f8-3d41f3c95675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:13.204922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c09e60-bc2e-440f-b5f8-3d41f3c95675 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:13.205212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c09e60-bc2e-440f-b5f8-3d41f3c95675 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:13.205493 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c09e60-bc2e-440f-b5f8-3d41f3c95675 None admin] PATH_INFO: `/v3/groups/539dd332d3ee4d4ab37ff619bdb3220b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:13.206674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c09e60-bc2e-440f-b5f8-3d41f3c95675 None admin] RBAC: Authorizing `identity:get_group(group_id=539dd332d3ee4d4ab37ff619bdb3220b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:13.208159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c09e60-bc2e-440f-b5f8-3d41f3c95675 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:13.209778 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 233/454] 10.222.0.41 () {56 vars in 1180 bytes} [Mon May 30 11:53:13 2022] GET /identity/v3/groups/539dd332d3ee4d4ab37ff619bdb3220b => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:13.215520 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1935a-619a-4e8f-a6e9-827a3637b9bc None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:13.317973 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1935a-619a-4e8f-a6e9-827a3637b9bc None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:13.351894 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d725f5-2f9c-4566-9f1b-8a82b173e72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:13.352552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d725f5-2f9c-4566-9f1b-8a82b173e72c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:13.352839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d725f5-2f9c-4566-9f1b-8a82b173e72c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:13.353122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d725f5-2f9c-4566-9f1b-8a82b173e72c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:13.353957 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d725f5-2f9c-4566-9f1b-8a82b173e72c None admin] RBAC: Adding query filter params (group.id=539dd332d3ee4d4ab37ff619bdb3220b, role.id=8196ef570097443bac15d3cf39878486, scope.project.id=93674931dbb347aea1d901cb89aa3b24) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:13.354276 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d725f5-2f9c-4566-9f1b-8a82b173e72c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:13.355719 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d725f5-2f9c-4566-9f1b-8a82b173e72c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:13.362721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 222/455] 10.222.0.41 () {56 vars in 1376 bytes} [Mon May 30 11:53:13 2022] GET /identity/v3/role_assignments?group.id=539dd332d3ee4d4ab37ff619bdb3220b&scope.project.id=93674931dbb347aea1d901cb89aa3b24&role.id=8196ef570097443bac15d3cf39878486 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:16.201582 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7e477-d666-4763-9ea9-9f7cb76c6404 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:16.203236 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7e477-d666-4763-9ea9-9f7cb76c6404 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:16.203731 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7e477-d666-4763-9ea9-9f7cb76c6404 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:16.205587 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 234/456] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:16.207307 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328548b2-fb74-4590-88a6-0c693f546e17 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:16.208133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328548b2-fb74-4590-88a6-0c693f546e17 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:16.208642 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328548b2-fb74-4590-88a6-0c693f546e17 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:16.210415 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 223/457] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:16.215660 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a924a7-858b-4760-a5b6-be97ff1c26dd None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:16.215805 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df0be3-dcbe-4fcc-8529-e5e1b41a15c5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:16.216040 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df0be3-dcbe-4fcc-8529-e5e1b41a15c5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:16.216360 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a924a7-858b-4760-a5b6-be97ff1c26dd None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:16.216653 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a924a7-858b-4760-a5b6-be97ff1c26dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:16.216986 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df0be3-dcbe-4fcc-8529-e5e1b41a15c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:16.235277 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c2a924a7-858b-4760-a5b6-be97ff1c26dd None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:16.236507 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c2a924a7-858b-4760-a5b6-be97ff1c26dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:16.244815 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-81df0be3-dcbe-4fcc-8529-e5e1b41a15c5 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:16.246259 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-81df0be3-dcbe-4fcc-8529-e5e1b41a15c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:16.284168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:16.336017 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 224/458] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:16.366547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 235/459] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:16.384342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a924a7-858b-4760-a5b6-be97ff1c26dd None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:16.418929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df0be3-dcbe-4fcc-8529-e5e1b41a15c5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:16.539480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:16.543665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a924a7-858b-4760-a5b6-be97ff1c26dd None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:16.548422 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df0be3-dcbe-4fcc-8529-e5e1b41a15c5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:16.587137 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c4991-7968-47ea-81ef-cae24a161bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:16.587970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c4991-7968-47ea-81ef-cae24a161bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:16.588254 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c4991-7968-47ea-81ef-cae24a161bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:16.588528 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c4991-7968-47ea-81ef-cae24a161bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:16.589470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc65e3-b1c3-42db-a29c-bfe52d79cd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:16.590369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc65e3-b1c3-42db-a29c-bfe52d79cd22 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:16.590776 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc65e3-b1c3-42db-a29c-bfe52d79cd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:16.591156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc65e3-b1c3-42db-a29c-bfe52d79cd22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:16.600651 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c4991-7968-47ea-81ef-cae24a161bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:16.602125 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c4991-7968-47ea-81ef-cae24a161bd9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:16.603424 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc65e3-b1c3-42db-a29c-bfe52d79cd22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:16.605010 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc65e3-b1c3-42db-a29c-bfe52d79cd22 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:16.620781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-de5c4991-7968-47ea-81ef-cae24a161bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:16.620781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:16.620781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:16.620781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:16.620781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:16.620781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:16.620781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:16.620781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:16.620781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:16.620781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:16.620781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:16.620781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:16.620781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:16.620781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:16.620781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:16.621905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:16.621905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:16.621905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:16.621905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:16.621905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:16.621905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:16.621905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:16.621905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:16.621905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:16.621905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:16.621905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:16.621905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:16.621905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:16.621905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:16.621905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:16.621905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:16.621905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:16.622746 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:16.622746 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:16.622746 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:16.622746 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:16.625401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-11fc65e3-b1c3-42db-a29c-bfe52d79cd22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:16.625401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:16.625401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:16.625401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:16.625401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:16.625401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:16.625401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:16.625401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:16.625401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:16.625401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:16.625401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:16.625401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:16.625401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:16.625401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:16.625401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:16.626173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:16.626173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:16.626173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:16.626173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:16.626173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:16.626173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:16.626173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:16.626173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:16.626173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:16.626173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:16.626173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:16.626173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:16.626173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:16.626173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:16.626173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:16.626173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:16.626173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:16.626988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:16.626988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:16.626988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:16.626988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:16.626988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 236/461] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:16.627602 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 225/461] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:16.629122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09759c57-0037-4573-9bc3-fa9f6bcc15b3 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:16.629564 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09759c57-0037-4573-9bc3-fa9f6bcc15b3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:16.629973 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09759c57-0037-4573-9bc3-fa9f6bcc15b3 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:16.630184 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c4991-7968-47ea-81ef-cae24a161bd9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:16.635569 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 237/462] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:16.639365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e4638-27aa-4f32-ae91-ca95ac020f80 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:16.639810 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e4638-27aa-4f32-ae91-ca95ac020f80 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:16.640210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e4638-27aa-4f32-ae91-ca95ac020f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:16.657430 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-af1e4638-27aa-4f32-ae91-ca95ac020f80 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:16.658709 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-af1e4638-27aa-4f32-ae91-ca95ac020f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:16.664151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:16.736093 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c4991-7968-47ea-81ef-cae24a161bd9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:16.736532 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 238/463] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:16.737490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e4638-27aa-4f32-ae91-ca95ac020f80 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:16.775840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c7d7e-0754-4739-8502-95a6c2f9fc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:16.775840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c7d7e-0754-4739-8502-95a6c2f9fc10 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:16.775840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c7d7e-0754-4739-8502-95a6c2f9fc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:16.775840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c7d7e-0754-4739-8502-95a6c2f9fc10 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:16.776191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c7d7e-0754-4739-8502-95a6c2f9fc10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:16.776191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c7d7e-0754-4739-8502-95a6c2f9fc10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:16.776319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c7d7e-0754-4739-8502-95a6c2f9fc10 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:16.797390 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 226/464] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:16.802883 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c7d7e-0754-4739-8502-95a6c2f9fc10 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:16.845468 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:16.871773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e4638-27aa-4f32-ae91-ca95ac020f80 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:16.900260 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:16.909886 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958e8ff-87b9-4d48-bb7a-e55614054e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:16.910840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958e8ff-87b9-4d48-bb7a-e55614054e66 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:16.911309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958e8ff-87b9-4d48-bb7a-e55614054e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:16.911787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958e8ff-87b9-4d48-bb7a-e55614054e66 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:16.912705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958e8ff-87b9-4d48-bb7a-e55614054e66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:16.913200 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958e8ff-87b9-4d48-bb7a-e55614054e66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:16.914614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958e8ff-87b9-4d48-bb7a-e55614054e66 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:16.917358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c7d7e-0754-4739-8502-95a6c2f9fc10 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:16.928130 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 239/465] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:16.929145 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958e8ff-87b9-4d48-bb7a-e55614054e66 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:16.957413 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15070f75-67cd-4e3f-b969-55433bb6b8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:16.958208 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15070f75-67cd-4e3f-b969-55433bb6b8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:16.958490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15070f75-67cd-4e3f-b969-55433bb6b8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:16.958766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15070f75-67cd-4e3f-b969-55433bb6b8d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:16.970355 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15070f75-67cd-4e3f-b969-55433bb6b8d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:16.971864 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15070f75-67cd-4e3f-b969-55433bb6b8d8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:16.990366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-15070f75-67cd-4e3f-b969-55433bb6b8d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:16.990366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:16.990366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:16.990366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:16.990366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:16.990366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:16.990366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:16.990366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:16.990366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:16.990366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:16.990366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:16.990366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:16.990366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:16.990366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:16.990366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:16.991285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:16.991285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:16.991285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:16.991285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:16.991285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:16.991285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:16.991285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:16.991285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:16.991285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:16.991285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:16.991285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:16.991285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:16.991285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:16.991285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:16.991285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:16.991285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:16.991285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:16.992521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:16.992521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:16.992521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:16.992521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:16.992521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 227/466] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:16.992933 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3429679-c9f2-461c-9252-e322ad9c9f13 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:16.993101 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3429679-c9f2-461c-9252-e322ad9c9f13 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:16.993536 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3429679-c9f2-461c-9252-e322ad9c9f13 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:16.999062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 228/467] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:16.999062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3429679-c9f2-461c-9252-e322ad9c9f13 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:17.047858 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958e8ff-87b9-4d48-bb7a-e55614054e66 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:17.084648 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9745c-ff75-443f-9558-250b735ea553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:17.085317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9745c-ff75-443f-9558-250b735ea553 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:17.085603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9745c-ff75-443f-9558-250b735ea553 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:17.085881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9745c-ff75-443f-9558-250b735ea553 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:17.086599 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9745c-ff75-443f-9558-250b735ea553 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:17.088035 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9745c-ff75-443f-9558-250b735ea553 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:17.097974 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:17.100320 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3429679-c9f2-461c-9252-e322ad9c9f13 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:17.116606 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 240/468] 10.222.0.41 () {60 vars in 1132 bytes} [Mon May 30 11:53:16 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:53:17.117420 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9745c-ff75-443f-9558-250b735ea553 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:17.152847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c3333-d084-4682-a656-a580e9c4b17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:17.154066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c3333-d084-4682-a656-a580e9c4b17e None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:17.154671 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c3333-d084-4682-a656-a580e9c4b17e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:17.156016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c3333-d084-4682-a656-a580e9c4b17e None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:17.157097 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c3333-d084-4682-a656-a580e9c4b17e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:17.158993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c3333-d084-4682-a656-a580e9c4b17e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:17.170656 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:17.196401 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 229/469] 10.222.0.41 () {60 vars in 1132 bytes} [Mon May 30 11:53:16 2022] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:53:17.196401 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d219643-f00f-4d46-9cdb-7f90ec34ee6d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:17.196401 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d219643-f00f-4d46-9cdb-7f90ec34ee6d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:17.196401 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d219643-f00f-4d46-9cdb-7f90ec34ee6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:17.238044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8d219643-f00f-4d46-9cdb-7f90ec34ee6d None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:17.240616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8d219643-f00f-4d46-9cdb-7f90ec34ee6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:17.318254 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9745c-ff75-443f-9558-250b735ea553 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:17.346481 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 230/470] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:17.372881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc5eb5-0573-4cb8-b221-c8874d5615df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:17.373552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc5eb5-0573-4cb8-b221-c8874d5615df None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:17.373838 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc5eb5-0573-4cb8-b221-c8874d5615df None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:17.374739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc5eb5-0573-4cb8-b221-c8874d5615df None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:17.375674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc5eb5-0573-4cb8-b221-c8874d5615df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:17.376018 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc5eb5-0573-4cb8-b221-c8874d5615df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:17.377406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc5eb5-0573-4cb8-b221-c8874d5615df None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:17.385170 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d219643-f00f-4d46-9cdb-7f90ec34ee6d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:17.393378 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 241/471] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:17.398937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc5eb5-0573-4cb8-b221-c8874d5615df None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:17.462596 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:17.516601 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc5eb5-0573-4cb8-b221-c8874d5615df None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:17.517752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d219643-f00f-4d46-9cdb-7f90ec34ee6d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:17.547230 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:17.555092 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c125c-eaf8-4454-b10f-53a3de0d71c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:17.555786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c125c-eaf8-4454-b10f-53a3de0d71c7 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:17.556111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c125c-eaf8-4454-b10f-53a3de0d71c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:17.556375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c125c-eaf8-4454-b10f-53a3de0d71c7 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:17.557105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c125c-eaf8-4454-b10f-53a3de0d71c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:17.558661 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c125c-eaf8-4454-b10f-53a3de0d71c7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:17.563802 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de23026-269f-4139-a4b6-de77ca78e6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:17.564891 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de23026-269f-4139-a4b6-de77ca78e6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:17.565346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de23026-269f-4139-a4b6-de77ca78e6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:17.565956 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de23026-269f-4139-a4b6-de77ca78e6d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:17.579764 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de23026-269f-4139-a4b6-de77ca78e6d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:17.581530 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de23026-269f-4139-a4b6-de77ca78e6d8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:17.590305 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 242/472] 10.222.0.41 () {60 vars in 1132 bytes} [Mon May 30 11:53:17 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:53:17.592666 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cd42b-e826-462d-845b-b95a7aaebcc4 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:17.593756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cd42b-e826-462d-845b-b95a7aaebcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:17.594241 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cd42b-e826-462d-845b-b95a7aaebcc4 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:17.596191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 243/473] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:17.601589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc743ca-27c7-4a51-90b5-8d239b580575 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:17.601853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-1de23026-269f-4139-a4b6-de77ca78e6d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:17.601853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:17.601853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:17.601853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:17.601853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:17.601853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:17.601853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:17.601853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:17.601853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:17.601853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:17.601853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:17.601853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:17.601853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:17.601853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:17.601853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:17.602665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:17.602665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:17.602665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:17.602665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:17.602665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:17.602665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:17.602665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:17.602665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:17.602665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:17.602665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:17.602665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:17.602665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:17.602665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:17.602665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:17.602665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:17.602665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:17.602665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:17.603525 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:17.603525 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:17.603525 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:17.603525 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:17.603525 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 231/474] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:17.604258 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc743ca-27c7-4a51-90b5-8d239b580575 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:17.608144 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc743ca-27c7-4a51-90b5-8d239b580575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:17.611743 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de23026-269f-4139-a4b6-de77ca78e6d8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:17.629371 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9bc743ca-27c7-4a51-90b5-8d239b580575 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:17.630651 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9bc743ca-27c7-4a51-90b5-8d239b580575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:17.739592 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 244/475] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:17.753925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de23026-269f-4139-a4b6-de77ca78e6d8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:17.776401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc743ca-27c7-4a51-90b5-8d239b580575 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:17.840108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54b074-367d-43fd-a413-5188dc1e2ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:17.840715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54b074-367d-43fd-a413-5188dc1e2ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:17.841001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54b074-367d-43fd-a413-5188dc1e2ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:17.841277 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54b074-367d-43fd-a413-5188dc1e2ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:17.842018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54b074-367d-43fd-a413-5188dc1e2ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:17.842328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54b074-367d-43fd-a413-5188dc1e2ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:17.843978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54b074-367d-43fd-a413-5188dc1e2ad1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:17.847569 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:17.859130 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 232/476] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:17.865096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54b074-367d-43fd-a413-5188dc1e2ad1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:17.913637 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:17.925834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc743ca-27c7-4a51-90b5-8d239b580575 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:17.972266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce980def-fea4-4338-8dc8-b26de0ec8364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:17.973494 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce980def-fea4-4338-8dc8-b26de0ec8364 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:17.973931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce980def-fea4-4338-8dc8-b26de0ec8364 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:17.974412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce980def-fea4-4338-8dc8-b26de0ec8364 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:17.975405 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce980def-fea4-4338-8dc8-b26de0ec8364 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:17.977711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce980def-fea4-4338-8dc8-b26de0ec8364 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:17.988796 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.sql.core [None req-ce980def-fea4-4338-8dc8-b26de0ec8364 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 30 11:53:17.988796 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 30 11:53:17.988796 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [parameters: {'id': 'a24422d202b74f949628677222650aeb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 30 11:53:17.988796 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80190) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 30 11:53:17.993243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54b074-367d-43fd-a413-5188dc1e2ad1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:18.008121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ce980def-fea4-4338-8dc8-b26de0ec8364 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 30 11:53:18.008121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:18.008121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 30 11:53:18.008121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self.dialect.do_execute( May 30 11:53:18.008121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 30 11:53:18.008121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 30 11:53:18.008121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 30 11:53:18.008121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application result = self._query(query) May 30 11:53:18.008121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 30 11:53:18.008121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application conn.query(q) May 30 11:53:18.008121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 30 11:53:18.008121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 30 11:53:18.008121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 30 11:53:18.008121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application result.read() May 30 11:53:18.008121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 30 11:53:18.009344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 30 11:53:18.009344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 30 11:53:18.009344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application packet.raise_for_error() May 30 11:53:18.009344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 30 11:53:18.009344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 30 11:53:18.009344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 30 11:53:18.009344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 30 11:53:18.009344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 30 11:53:18.009344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:18.009344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 30 11:53:18.009344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:18.009344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:18.009344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 30 11:53:18.009344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 30 11:53:18.009344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 30 11:53:18.009344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return ref.to_dict() May 30 11:53:18.009344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 30 11:53:18.009344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application next(self.gen) May 30 11:53:18.010472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 30 11:53:18.010472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application yield resource May 30 11:53:18.010472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 30 11:53:18.010472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application next(self.gen) May 30 11:53:18.010472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 30 11:53:18.010472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self.session.rollback() May 30 11:53:18.010472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 30 11:53:18.010472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self.force_reraise() May 30 11:53:18.010472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 30 11:53:18.010472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise self.value May 30 11:53:18.010472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 30 11:53:18.010472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 30 11:53:18.010472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 30 11:53:18.010472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application session.commit() May 30 11:53:18.010472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 30 11:53:18.010472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 30 11:53:18.010472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 30 11:53:18.011501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._prepare_impl() May 30 11:53:18.011501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 30 11:53:18.011501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self.session.flush() May 30 11:53:18.011501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 30 11:53:18.011501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._flush(objects) May 30 11:53:18.011501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 30 11:53:18.011501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 30 11:53:18.011501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 30 11:53:18.011501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application compat.raise_( May 30 11:53:18.011501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 30 11:53:18.011501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception May 30 11:53:18.011501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 30 11:53:18.011501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application flush_context.execute() May 30 11:53:18.011501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 30 11:53:18.011501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rec.execute(self) May 30 11:53:18.011501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 30 11:53:18.011501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 30 11:53:18.012884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 30 11:53:18.012884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application _emit_insert_statements( May 30 11:53:18.012884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 30 11:53:18.012884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application c = connection._execute_20( May 30 11:53:18.012884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 30 11:53:18.012884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 30 11:53:18.012884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 30 11:53:18.012884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 30 11:53:18.012884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 30 11:53:18.012884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ret = self._execute_context( May 30 11:53:18.012884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 30 11:53:18.012884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 30 11:53:18.012884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 30 11:53:18.012884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 30 11:53:18.012884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 30 11:53:18.012884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception May 30 11:53:18.013700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 30 11:53:18.013700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self.dialect.do_execute( May 30 11:53:18.013700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 30 11:53:18.013700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 30 11:53:18.013700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 30 11:53:18.013700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application result = self._query(query) May 30 11:53:18.013700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 30 11:53:18.013700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application conn.query(q) May 30 11:53:18.013700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 30 11:53:18.013700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 30 11:53:18.013700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 30 11:53:18.013700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application result.read() May 30 11:53:18.013700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 30 11:53:18.013700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 30 11:53:18.013700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 30 11:53:18.013700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application packet.raise_for_error() May 30 11:53:18.015125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 30 11:53:18.015125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 30 11:53:18.015125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 30 11:53:18.015125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 30 11:53:18.015125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 30 11:53:18.015125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 30 11:53:18.015125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [parameters: {'id': 'a24422d202b74f949628677222650aeb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 30 11:53:18.015125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 30 11:53:18.015125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:18.015125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:53:18.015125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:18.015125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:18.015125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:18.015125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:18.015125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:18.015125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:18.016507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:18.016507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:18.016507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:18.016507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:18.016507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:18.016507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:18.016507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 30 11:53:18.016507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 30 11:53:18.016507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:18.016507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:18.016507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 30 11:53:18.016507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 30 11:53:18.016507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 30 11:53:18.016507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 30 11:53:18.016507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 30 11:53:18.016507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:18.017507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 245/477] 10.222.0.41 () {60 vars in 1131 bytes} [Mon May 30 11:53:17 2022] POST /identity/v3/roles => generated 144 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:18.018183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce980def-fea4-4338-8dc8-b26de0ec8364 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:18.046798 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8fd1c-1c74-44d1-84a5-cc0a2169043e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:18.048109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8fd1c-1c74-44d1-84a5-cc0a2169043e None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:18.048864 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8fd1c-1c74-44d1-84a5-cc0a2169043e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:18.049386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8fd1c-1c74-44d1-84a5-cc0a2169043e None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:18.051099 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8fd1c-1c74-44d1-84a5-cc0a2169043e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:18.053118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8fd1c-1c74-44d1-84a5-cc0a2169043e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:18.082170 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 233/478] 10.222.0.41 () {60 vars in 1132 bytes} [Mon May 30 11:53:17 2022] POST /identity/v3/users => generated 249 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:53:18.156638 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce980def-fea4-4338-8dc8-b26de0ec8364 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:18.159689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:18.198764 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cba10-e234-4d2b-a4c4-fd9abfce8008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:18.199654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cba10-e234-4d2b-a4c4-fd9abfce8008 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:18.199978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cba10-e234-4d2b-a4c4-fd9abfce8008 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:18.200256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cba10-e234-4d2b-a4c4-fd9abfce8008 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:18.212909 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cba10-e234-4d2b-a4c4-fd9abfce8008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:18.221834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-e55cba10-e234-4d2b-a4c4-fd9abfce8008 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:53:18.221834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:18.221834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:18.221834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:18.221834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:18.221834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:18.221834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:18.221834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:18.221834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:18.221834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:18.221834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:18.221834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:18.221834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:18.221834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:18.221834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:18.221834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:18.222771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:18.222771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:18.222771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:18.222771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:18.222771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:18.222771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:18.222771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:18.222771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:18.222771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:18.222771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:18.222771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:18.222771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:18.222771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:18.222771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:18.222771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:18.222771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:18.223568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:18.223568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:18.223568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:18.223568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:18.223568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:18.223568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:18.223568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:18.223568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:18.223568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:18.223568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:18.223568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:53:18.223568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:18.223568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 246/479] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:53:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:18.228933 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8fd1c-1c74-44d1-84a5-cc0a2169043e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:18.361566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:18.372029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8fd1c-1c74-44d1-84a5-cc0a2169043e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:18.407902 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96ce82-5431-4791-b94f-efac706731af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:18.408480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96ce82-5431-4791-b94f-efac706731af None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:18.408766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96ce82-5431-4791-b94f-efac706731af None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:18.409044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96ce82-5431-4791-b94f-efac706731af None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:18.409800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96ce82-5431-4791-b94f-efac706731af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:18.410109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96ce82-5431-4791-b94f-efac706731af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:18.411511 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96ce82-5431-4791-b94f-efac706731af None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:18.420547 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 234/480] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:19.953392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ab32c-69a3-48b4-946f-ee9689ae3e60 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:19.953972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ab32c-69a3-48b4-946f-ee9689ae3e60 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:19.953972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ab32c-69a3-48b4-946f-ee9689ae3e60 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:19.955601 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 247/481] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:19.968963 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45983f54-21e9-4a8a-a813-9dae73f57638 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:19.969483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45983f54-21e9-4a8a-a813-9dae73f57638 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:19.969584 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45983f54-21e9-4a8a-a813-9dae73f57638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:19.989966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-45983f54-21e9-4a8a-a813-9dae73f57638 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:19.991478 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-45983f54-21e9-4a8a-a813-9dae73f57638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:20.088425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 235/482] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:20.120122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ab32c-69a3-48b4-946f-ee9689ae3e60 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:20.261360 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ab35a-e1dc-4e07-9a12-9b0760af5d07 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:20.262045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ab35a-e1dc-4e07-9a12-9b0760af5d07 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:20.262539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ab35a-e1dc-4e07-9a12-9b0760af5d07 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:20.265068 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 236/483] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:20.270981 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637e27b-82a9-4945-89b7-f52fe3c07ab7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:20.271558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637e27b-82a9-4945-89b7-f52fe3c07ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:20.272135 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637e27b-82a9-4945-89b7-f52fe3c07ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:20.291114 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3637e27b-82a9-4945-89b7-f52fe3c07ab7 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:20.292743 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3637e27b-82a9-4945-89b7-f52fe3c07ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:20.299492 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ab32c-69a3-48b4-946f-ee9689ae3e60 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:20.416411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20253d0b-4a42-4c75-a128-36550cab7af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:20.417456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20253d0b-4a42-4c75-a128-36550cab7af1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:20.417745 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20253d0b-4a42-4c75-a128-36550cab7af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:20.418022 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20253d0b-4a42-4c75-a128-36550cab7af1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:20.444036 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20253d0b-4a42-4c75-a128-36550cab7af1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:20.461522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-20253d0b-4a42-4c75-a128-36550cab7af1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:20.461522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:20.461522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:20.461522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:20.461522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:20.461522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:20.461522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:20.461522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:20.461522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:20.461522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:20.461522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:20.461522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:20.461522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:20.461522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:20.461522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:20.461522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:20.463256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:20.463256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:20.463256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:20.463256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:20.463256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:20.463256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:20.463256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:20.463256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:20.463256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:20.463256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:20.463256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:20.463256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:20.463256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:20.463256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:20.463256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:20.463256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:20.464685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:20.464685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:20.464685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:20.464685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:20.464685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:20.464685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:20.464685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:20.464685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:20.464685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:20.464685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:20.464685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:20.464685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:20.464685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 248/484] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:20.470336 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20253d0b-4a42-4c75-a128-36550cab7af1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:20.513797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 237/485] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:53:20.528256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:20.542302 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637e27b-82a9-4945-89b7-f52fe3c07ab7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:20.592233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:20.628477 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20253d0b-4a42-4c75-a128-36550cab7af1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:20.673451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637e27b-82a9-4945-89b7-f52fe3c07ab7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:20.676535 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfc397-beb3-424a-b462-23f0a059c7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:20.677490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfc397-beb3-424a-b462-23f0a059c7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:20.677979 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfc397-beb3-424a-b462-23f0a059c7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:20.678459 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfc397-beb3-424a-b462-23f0a059c7f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:20.679421 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdfc397-beb3-424a-b462-23f0a059c7f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:20.679977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdfc397-beb3-424a-b462-23f0a059c7f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:20.682259 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdfc397-beb3-424a-b462-23f0a059c7f3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:20.695216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 249/486] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:53:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:20.697370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c5f9c-ef6b-45e0-b9fc-228e547b8e49 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:20.697878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c5f9c-ef6b-45e0-b9fc-228e547b8e49 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:20.698654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c5f9c-ef6b-45e0-b9fc-228e547b8e49 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:20.704946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 250/487] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:20.704946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c5f9c-ef6b-45e0-b9fc-228e547b8e49 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:20.719196 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae1d05-7c70-4243-9df9-4c99dbc1b57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:20.720553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae1d05-7c70-4243-9df9-4c99dbc1b57a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:20.720845 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae1d05-7c70-4243-9df9-4c99dbc1b57a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:20.721125 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae1d05-7c70-4243-9df9-4c99dbc1b57a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:20.734585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae1d05-7c70-4243-9df9-4c99dbc1b57a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:20.746772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-81ae1d05-7c70-4243-9df9-4c99dbc1b57a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:20.746772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:20.746772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:20.746772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:20.746772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:20.746772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:20.746772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:20.746772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:20.746772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:20.746772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:20.746772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:20.746772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:20.746772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:20.746772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:20.746772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:20.746772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:20.747664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:20.747664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:20.747664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:20.747664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:20.747664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:20.747664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:20.747664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:20.747664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:20.747664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:20.747664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:20.747664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:20.747664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:20.747664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:20.747664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:20.747664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:20.747664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:20.748498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:20.748498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:20.748498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:20.748498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:20.748498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:20.748498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:20.748498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:20.748498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:20.748498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:20.748498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:20.748498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:20.748498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:20.755724 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 238/488] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:53:20.757230 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6592859-17b3-44dd-9747-7b9bd6c88c1a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:20.757518 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6592859-17b3-44dd-9747-7b9bd6c88c1a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:20.757794 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6592859-17b3-44dd-9747-7b9bd6c88c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:20.787427 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d6592859-17b3-44dd-9747-7b9bd6c88c1a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:20.788664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d6592859-17b3-44dd-9747-7b9bd6c88c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:20.834697 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:20.856449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c5f9c-ef6b-45e0-b9fc-228e547b8e49 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:20.881331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 239/489] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:20.882717 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6592859-17b3-44dd-9747-7b9bd6c88c1a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:20.889067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:20.910536 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6663fb-c4ce-456f-8c53-a8c06a8e6872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:20.911364 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6663fb-c4ce-456f-8c53-a8c06a8e6872 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:20.911715 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6663fb-c4ce-456f-8c53-a8c06a8e6872 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:20.912031 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6663fb-c4ce-456f-8c53-a8c06a8e6872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:20.927168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6663fb-c4ce-456f-8c53-a8c06a8e6872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:20.929144 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6663fb-c4ce-456f-8c53-a8c06a8e6872 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:20.952771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ff6663fb-c4ce-456f-8c53-a8c06a8e6872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:20.952771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:20.952771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:20.952771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:20.952771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:20.952771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:20.952771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:20.952771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:20.952771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:20.952771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:20.952771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:20.952771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:20.952771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:20.952771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:20.952771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:20.954093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:20.954093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:20.954093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:20.954093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:20.954093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:20.954093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:20.954093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:20.954093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:20.954093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:20.954093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:20.954093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:20.954093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:20.954093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:20.954093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:20.954093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:20.954093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:20.954093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:20.954919 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:20.954919 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:20.954919 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:20.954919 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:20.955947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 251/490] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:20.956201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6663fb-c4ce-456f-8c53-a8c06a8e6872 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:21.017736 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6592859-17b3-44dd-9747-7b9bd6c88c1a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:21.057194 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ce3b5-cb8e-47b2-b71c-c2a457f0811e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:21.058353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ce3b5-cb8e-47b2-b71c-c2a457f0811e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:21.058353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ce3b5-cb8e-47b2-b71c-c2a457f0811e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:21.058547 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ce3b5-cb8e-47b2-b71c-c2a457f0811e None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:21.059298 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ce3b5-cb8e-47b2-b71c-c2a457f0811e None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:21.059610 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ce3b5-cb8e-47b2-b71c-c2a457f0811e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:21.061308 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ce3b5-cb8e-47b2-b71c-c2a457f0811e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:21.075532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 240/491] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:53:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:21.076484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ce3b5-cb8e-47b2-b71c-c2a457f0811e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:21.087908 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6663fb-c4ce-456f-8c53-a8c06a8e6872 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:21.126151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62048425-f8de-458a-aa97-cc8d0dc09dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:21.127410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62048425-f8de-458a-aa97-cc8d0dc09dfa None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:21.128037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62048425-f8de-458a-aa97-cc8d0dc09dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:21.128539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62048425-f8de-458a-aa97-cc8d0dc09dfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:21.136228 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:21.142333 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62048425-f8de-458a-aa97-cc8d0dc09dfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:21.148899 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:21.151949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-62048425-f8de-458a-aa97-cc8d0dc09dfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:21.151949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:21.151949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:21.151949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:21.151949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:21.151949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:21.151949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:21.151949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:21.151949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:21.151949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:21.151949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:21.151949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:21.151949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:21.151949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:21.151949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:21.151949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:21.152821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:21.152821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:21.152821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:21.152821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:21.152821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:21.152821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:21.152821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:21.152821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:21.152821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:21.152821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:21.152821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:21.152821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:21.152821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:21.152821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:21.152821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:21.152821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:21.153584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:21.153584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:21.153584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:21.153584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:21.153584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:21.153584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:21.153584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:21.153584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:21.153584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:21.153584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:21.153584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:21.153584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:21.156490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 252/492] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:21.157458 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62048425-f8de-458a-aa97-cc8d0dc09dfa None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:21.192619 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ce3b5-cb8e-47b2-b71c-c2a457f0811e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:21.228486 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4092ff-ece8-4dd5-8476-872f6f5fe5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:21.229273 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4092ff-ece8-4dd5-8476-872f6f5fe5fa None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:21.229633 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4092ff-ece8-4dd5-8476-872f6f5fe5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:21.229990 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4092ff-ece8-4dd5-8476-872f6f5fe5fa None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:21.230802 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4092ff-ece8-4dd5-8476-872f6f5fe5fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:21.231183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4092ff-ece8-4dd5-8476-872f6f5fe5fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:21.232790 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4092ff-ece8-4dd5-8476-872f6f5fe5fa None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:21.245662 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 241/493] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:21.246891 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4092ff-ece8-4dd5-8476-872f6f5fe5fa None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:21.274950 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62048425-f8de-458a-aa97-cc8d0dc09dfa None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:21.313197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e2063-e1c7-4023-9611-0e48ea8cdce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:21.314271 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e2063-e1c7-4023-9611-0e48ea8cdce6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:21.314828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e2063-e1c7-4023-9611-0e48ea8cdce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:21.315283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e2063-e1c7-4023-9611-0e48ea8cdce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:21.328339 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e2063-e1c7-4023-9611-0e48ea8cdce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:21.329851 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e2063-e1c7-4023-9611-0e48ea8cdce6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:21.348786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-9c7e2063-e1c7-4023-9611-0e48ea8cdce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:21.348786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:21.348786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:21.348786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:21.348786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:21.348786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:21.348786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:21.348786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:21.348786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:21.348786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:21.348786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:21.348786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:21.348786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:21.348786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:21.348786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:21.349664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:21.349664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:21.349664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:21.349664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:21.349664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:21.349664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:21.349664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:21.349664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:21.349664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:21.349664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:21.349664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:21.349664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:21.349664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:21.349664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:21.349664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:21.349664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:21.349664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:21.350508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:21.350508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:21.350508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:21.350508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:21.350714 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4092ff-ece8-4dd5-8476-872f6f5fe5fa None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:21.350785 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 253/494] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:21.351393 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836d546-69c5-489d-bcea-06f5cf173e62 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:21.351681 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836d546-69c5-489d-bcea-06f5cf173e62 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:21.351981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836d546-69c5-489d-bcea-06f5cf173e62 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:21.356092 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 254/495] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:21.356092 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836d546-69c5-489d-bcea-06f5cf173e62 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:21.385168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:21.394138 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78008d-bd60-402d-8d84-7aee9c064bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:21.394819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78008d-bd60-402d-8d84-7aee9c064bff None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:21.395105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78008d-bd60-402d-8d84-7aee9c064bff None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:21.395384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78008d-bd60-402d-8d84-7aee9c064bff None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:21.396181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78008d-bd60-402d-8d84-7aee9c064bff None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:21.396495 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78008d-bd60-402d-8d84-7aee9c064bff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:21.397870 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78008d-bd60-402d-8d84-7aee9c064bff None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:21.406669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 242/496] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:53:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:21.407276 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:21.407453 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78008d-bd60-402d-8d84-7aee9c064bff None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:21.462778 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836d546-69c5-489d-bcea-06f5cf173e62 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:21.496637 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72aaee-dfd6-49be-bece-cc16019b82de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:21.497420 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72aaee-dfd6-49be-bece-cc16019b82de None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:21.497707 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72aaee-dfd6-49be-bece-cc16019b82de None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:21.497985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72aaee-dfd6-49be-bece-cc16019b82de None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:21.506013 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72aaee-dfd6-49be-bece-cc16019b82de None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:21.507462 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72aaee-dfd6-49be-bece-cc16019b82de None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:21.507862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78008d-bd60-402d-8d84-7aee9c064bff None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:21.523245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-aa72aaee-dfd6-49be-bece-cc16019b82de None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 30 11:53:21.523245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:21.523245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:21.523245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:21.523245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:21.523245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:21.523245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:21.523245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:21.523245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:21.523245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:21.523245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:21.523245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:21.523245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:21.523245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:21.523245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:21.523245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:21.524180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:21.524180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:21.524180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:21.524180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:21.524180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:21.524180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:21.524180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:21.524180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:21.524180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:21.524180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:21.524180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:21.524180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:21.524180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:21.524180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:21.524180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:21.524180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:21.524180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:21.524180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:21.525072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:21.525072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:21.525072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:21.525072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:21.525072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:21.525072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:21.525072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:21.525072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:21.525072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 30 11:53:21.525072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:21.525072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 255/497] 10.222.0.41 () {56 vars in 1093 bytes} [Mon May 30 11:53:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:21.525639 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34547f9-e060-4ac9-957b-92855b91c394 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:21.525916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34547f9-e060-4ac9-957b-92855b91c394 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:21.526175 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34547f9-e060-4ac9-957b-92855b91c394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:21.542272 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e34547f9-e060-4ac9-957b-92855b91c394 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:21.543466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e34547f9-e060-4ac9-957b-92855b91c394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:21.546945 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a6d97-f4c0-48b1-a839-2ce6c8934f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:21.547602 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a6d97-f4c0-48b1-a839-2ce6c8934f19 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:21.547912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a6d97-f4c0-48b1-a839-2ce6c8934f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:21.548191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a6d97-f4c0-48b1-a839-2ce6c8934f19 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:21.548921 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a6d97-f4c0-48b1-a839-2ce6c8934f19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:21.549225 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a6d97-f4c0-48b1-a839-2ce6c8934f19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:21.550584 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a6d97-f4c0-48b1-a839-2ce6c8934f19 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:21.563036 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 243/498] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:21.564348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc495f-8cfa-47b1-af51-b027a8427ca7 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:21.564639 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc495f-8cfa-47b1-af51-b027a8427ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:21.564913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc495f-8cfa-47b1-af51-b027a8427ca7 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:21.566352 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 244/499] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:21.566955 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc495f-8cfa-47b1-af51-b027a8427ca7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:21.615782 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 256/500] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:21.616502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34547f9-e060-4ac9-957b-92855b91c394 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:21.616697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:21.658464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:21.685604 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc495f-8cfa-47b1-af51-b027a8427ca7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:21.716111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34547f9-e060-4ac9-957b-92855b91c394 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:21.719964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0d104-5e01-4a9e-8ea2-89a74bf9822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:21.720749 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0d104-5e01-4a9e-8ea2-89a74bf9822b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:21.721032 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0d104-5e01-4a9e-8ea2-89a74bf9822b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:21.721307 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0d104-5e01-4a9e-8ea2-89a74bf9822b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:21.731316 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0d104-5e01-4a9e-8ea2-89a74bf9822b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:21.732893 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0d104-5e01-4a9e-8ea2-89a74bf9822b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:21.750566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-70c0d104-5e01-4a9e-8ea2-89a74bf9822b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:21.750566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:21.750566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:21.750566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:21.750566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:21.750566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:21.750566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:21.750566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:21.750566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:21.750566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:21.750566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:21.750566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:21.750566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:21.750566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:21.750566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:21.751439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:21.751439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:21.751439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:21.751439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:21.751439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:21.751439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:21.751439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:21.751439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:21.751439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:21.751439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:21.751439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:21.751439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:21.751439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:21.751439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:21.751439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:21.751439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:21.751439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:21.752295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:21.752295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:21.752295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:21.752295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:21.752295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 245/501] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:21.753099 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0d104-5e01-4a9e-8ea2-89a74bf9822b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:21.753367 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756bbb8-5522-41ae-bb9f-c06a270616a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:21.754045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756bbb8-5522-41ae-bb9f-c06a270616a3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:21.754362 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756bbb8-5522-41ae-bb9f-c06a270616a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:21.754646 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756bbb8-5522-41ae-bb9f-c06a270616a3 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:21.755688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756bbb8-5522-41ae-bb9f-c06a270616a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:21.756828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756bbb8-5522-41ae-bb9f-c06a270616a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:21.758276 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756bbb8-5522-41ae-bb9f-c06a270616a3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:21.795898 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 257/502] 10.222.0.41 () {56 vars in 1133 bytes} [Mon May 30 11:53:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:21.797178 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f161f-bf76-41d8-b062-5921e633fa86 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:21.797471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f161f-bf76-41d8-b062-5921e633fa86 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:21.797753 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f161f-bf76-41d8-b062-5921e633fa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:21.813522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-408f161f-bf76-41d8-b062-5921e633fa86 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:21.814721 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-408f161f-bf76-41d8-b062-5921e633fa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:21.857719 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:21.860732 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0d104-5e01-4a9e-8ea2-89a74bf9822b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:21.881060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 258/503] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:21.881931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f161f-bf76-41d8-b062-5921e633fa86 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:21.894713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c286a5-7148-4bb2-b18f-f6ae4bc70aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:21.895505 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c286a5-7148-4bb2-b18f-f6ae4bc70aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:21.895788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c286a5-7148-4bb2-b18f-f6ae4bc70aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:21.896152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c286a5-7148-4bb2-b18f-f6ae4bc70aa2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:21.903151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c286a5-7148-4bb2-b18f-f6ae4bc70aa2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:21.904699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c286a5-7148-4bb2-b18f-f6ae4bc70aa2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:21.913404 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:21.921091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-a6c286a5-7148-4bb2-b18f-f6ae4bc70aa2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 30 11:53:21.921091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:21.921091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:21.921091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:21.921091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:21.921091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:21.921091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:21.921091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:21.921091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:21.921091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:21.921091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:21.921091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:21.921091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:21.921091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:21.921091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:21.921091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:21.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:21.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:21.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:21.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:21.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:21.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:21.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:21.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:21.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:21.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:21.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:21.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:21.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:21.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:21.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:21.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:21.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:21.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:21.923178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:21.923178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:21.923178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:21.923178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:21.923178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:21.923178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:21.923178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:21.923178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:21.923178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 30 11:53:21.923178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:21.923178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 246/504] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:21.923717 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c286a5-7148-4bb2-b18f-f6ae4bc70aa2 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:21.986716 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f161f-bf76-41d8-b062-5921e633fa86 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:22.020353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c286a5-7148-4bb2-b18f-f6ae4bc70aa2 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:22.020839 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189a5ae-e8eb-423e-9328-d3cd1a8b2f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:22.021154 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189a5ae-e8eb-423e-9328-d3cd1a8b2f47 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:22.021431 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189a5ae-e8eb-423e-9328-d3cd1a8b2f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:22.021707 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189a5ae-e8eb-423e-9328-d3cd1a8b2f47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:22.032550 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189a5ae-e8eb-423e-9328-d3cd1a8b2f47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:22.040252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-4189a5ae-e8eb-423e-9328-d3cd1a8b2f47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:22.040252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:22.040252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:22.040252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:22.040252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:22.040252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:22.040252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:22.040252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:22.040252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:22.040252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:22.040252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:22.040252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:22.040252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:22.040252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:22.040252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:22.040252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:22.041197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:22.041197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:22.041197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:22.041197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:22.041197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:22.041197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:22.041197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:22.041197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:22.041197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:22.041197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:22.041197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:22.041197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:22.041197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:22.041197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:22.041197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:22.041197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:22.041980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:22.041980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:22.041980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:22.041980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:22.041980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:22.041980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:22.041980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:22.041980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:22.041980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:22.041980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:22.041980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:22.041980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:22.041980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 259/505] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:22.042618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189a5ae-e8eb-423e-9328-d3cd1a8b2f47 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:22.057072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc7841-0697-43b4-a595-e83eb5ccb062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:22.057746 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc7841-0697-43b4-a595-e83eb5ccb062 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:22.058023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc7841-0697-43b4-a595-e83eb5ccb062 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:22.058300 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc7841-0697-43b4-a595-e83eb5ccb062 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:22.059020 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc7841-0697-43b4-a595-e83eb5ccb062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:22.059328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc7841-0697-43b4-a595-e83eb5ccb062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:22.060733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc7841-0697-43b4-a595-e83eb5ccb062 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:22.076895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 247/506] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:22.076895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc7841-0697-43b4-a595-e83eb5ccb062 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:22.095800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:22.131748 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:22.145763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189a5ae-e8eb-423e-9328-d3cd1a8b2f47 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:22.176140 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc7841-0697-43b4-a595-e83eb5ccb062 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:22.180290 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a042193-ca2c-4418-afbe-9cd7ab221896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:22.180928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a042193-ca2c-4418-afbe-9cd7ab221896 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:22.181208 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a042193-ca2c-4418-afbe-9cd7ab221896 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:22.181481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a042193-ca2c-4418-afbe-9cd7ab221896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:22.208496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece10aa0-a88d-4ab0-b84c-e05d02854ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:22.209276 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece10aa0-a88d-4ab0-b84c-e05d02854ffb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:22.209557 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece10aa0-a88d-4ab0-b84c-e05d02854ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:22.209833 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece10aa0-a88d-4ab0-b84c-e05d02854ffb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:22.220819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece10aa0-a88d-4ab0-b84c-e05d02854ffb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:22.222254 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece10aa0-a88d-4ab0-b84c-e05d02854ffb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:22.238765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-ece10aa0-a88d-4ab0-b84c-e05d02854ffb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:22.238765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:22.238765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:22.238765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:22.238765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:22.238765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:22.238765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:22.238765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:22.238765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:22.238765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:22.238765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:22.238765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:22.238765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:22.238765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:22.238765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:22.239592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:22.239592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:22.239592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:22.239592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:22.239592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:22.239592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:22.239592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:22.239592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:22.239592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:22.239592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:22.239592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:22.239592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:22.239592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:22.239592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:22.239592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:22.239592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:22.239592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:22.240477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:22.240477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:22.240477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:22.240477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:22.240477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 248/507] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:22.240749 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece10aa0-a88d-4ab0-b84c-e05d02854ffb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:22.252008 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a042193-ca2c-4418-afbe-9cd7ab221896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:22.253775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a042193-ca2c-4418-afbe-9cd7ab221896 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:22.324295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:22.346009 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:22.349489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece10aa0-a88d-4ab0-b84c-e05d02854ffb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:22.367051 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 260/508] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:22.368420 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a042193-ca2c-4418-afbe-9cd7ab221896 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:22.392427 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983e261-36cc-475d-b770-4d8f3443a073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:22.393199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983e261-36cc-475d-b770-4d8f3443a073 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:22.393375 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983e261-36cc-475d-b770-4d8f3443a073 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:22.393650 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983e261-36cc-475d-b770-4d8f3443a073 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:22.394496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983e261-36cc-475d-b770-4d8f3443a073 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:22.394803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983e261-36cc-475d-b770-4d8f3443a073 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:22.396258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983e261-36cc-475d-b770-4d8f3443a073 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:22.433518 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 249/509] 10.222.0.41 () {56 vars in 1137 bytes} [Mon May 30 11:53:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:22.434371 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983e261-36cc-475d-b770-4d8f3443a073 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:22.482593 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a042193-ca2c-4418-afbe-9cd7ab221896 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:22.543004 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983e261-36cc-475d-b770-4d8f3443a073 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:22.576716 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:22.583728 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada0c17-d3a0-4061-9fd7-f9e33880c913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:22.584926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada0c17-d3a0-4061-9fd7-f9e33880c913 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:22.585216 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada0c17-d3a0-4061-9fd7-f9e33880c913 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:22.585492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada0c17-d3a0-4061-9fd7-f9e33880c913 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:22.593770 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada0c17-d3a0-4061-9fd7-f9e33880c913 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:22.595238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada0c17-d3a0-4061-9fd7-f9e33880c913 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:22.611181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-5ada0c17-d3a0-4061-9fd7-f9e33880c913 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 30 11:53:22.611181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:22.611181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:22.611181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:22.611181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:22.611181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:22.611181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:22.611181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:22.611181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:22.611181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:22.611181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:22.611181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:22.611181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:22.611181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:22.611181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:22.611181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:22.612331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:22.612331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:22.612331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:22.612331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:22.612331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:22.612331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:22.612331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:22.612331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:22.612331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:22.612331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:22.612331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:22.612331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:22.612331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:22.612331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:22.612331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:22.612331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:22.612331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:22.612331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:22.613319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:22.613319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:22.613319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:22.613319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:22.613319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:22.613319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:22.613319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:22.613319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:22.613319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 30 11:53:22.613319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:22.617219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 250/510] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:22.617219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada0c17-d3a0-4061-9fd7-f9e33880c913 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:22.640825 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f45bd-c344-4850-b533-bb9ae4f36143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:22.641508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f45bd-c344-4850-b533-bb9ae4f36143 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:22.641790 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f45bd-c344-4850-b533-bb9ae4f36143 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:22.642068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f45bd-c344-4850-b533-bb9ae4f36143 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:22.642820 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f45bd-c344-4850-b533-bb9ae4f36143 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:22.643133 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f45bd-c344-4850-b533-bb9ae4f36143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:22.644531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f45bd-c344-4850-b533-bb9ae4f36143 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:22.652309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 261/511] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:53:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:22.653081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f45bd-c344-4850-b533-bb9ae4f36143 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:22.702536 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:22.719826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada0c17-d3a0-4061-9fd7-f9e33880c913 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:22.753124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f45bd-c344-4850-b533-bb9ae4f36143 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:22.754112 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a5ad5-fb1d-4bec-bf51-f3775de17db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:22.754777 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a5ad5-fb1d-4bec-bf51-f3775de17db5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:22.755060 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a5ad5-fb1d-4bec-bf51-f3775de17db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:22.755345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a5ad5-fb1d-4bec-bf51-f3775de17db5 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:22.756096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a5ad5-fb1d-4bec-bf51-f3775de17db5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:22.756408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a5ad5-fb1d-4bec-bf51-f3775de17db5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:22.757784 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a5ad5-fb1d-4bec-bf51-f3775de17db5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:22.771358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 251/512] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:22.772240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a5ad5-fb1d-4bec-bf51-f3775de17db5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:22.793806 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5a4b9-b66a-446a-8574-b656fa366959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:22.794587 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5a4b9-b66a-446a-8574-b656fa366959 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:22.794875 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5a4b9-b66a-446a-8574-b656fa366959 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:22.795152 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5a4b9-b66a-446a-8574-b656fa366959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:22.805530 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5a4b9-b66a-446a-8574-b656fa366959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:22.806966 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5a4b9-b66a-446a-8574-b656fa366959 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:22.820732 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:22.824924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-fcf5a4b9-b66a-446a-8574-b656fa366959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:22.824924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:22.824924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:22.824924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:22.824924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:22.824924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:22.824924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:22.824924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:22.824924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:22.824924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:22.824924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:22.824924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:22.824924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:22.824924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:22.824924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:22.825737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:22.825737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:22.825737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:22.825737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:22.825737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:22.825737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:22.825737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:22.825737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:22.825737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:22.825737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:22.825737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:22.825737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:22.825737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:22.825737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:22.825737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:22.825737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:22.825737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:22.826548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:22.826548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:22.826548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:22.826548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:22.826548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 262/513] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:22.827029 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5a4b9-b66a-446a-8574-b656fa366959 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:22.875716 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a5ad5-fb1d-4bec-bf51-f3775de17db5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:22.910628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501c9be-cb55-4139-9b0e-f00544915bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:22.911301 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501c9be-cb55-4139-9b0e-f00544915bba None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:22.911590 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501c9be-cb55-4139-9b0e-f00544915bba None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:22.911895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501c9be-cb55-4139-9b0e-f00544915bba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:22.930458 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5a4b9-b66a-446a-8574-b656fa366959 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:22.931990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:22.965154 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f1496-46e1-45ea-b121-c67c99caa28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:22.965844 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f1496-46e1-45ea-b121-c67c99caa28f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:22.966134 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f1496-46e1-45ea-b121-c67c99caa28f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:22.966408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f1496-46e1-45ea-b121-c67c99caa28f None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:22.967244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f1496-46e1-45ea-b121-c67c99caa28f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:22.968071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f1496-46e1-45ea-b121-c67c99caa28f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:22.969988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f1496-46e1-45ea-b121-c67c99caa28f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:22.978851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501c9be-cb55-4139-9b0e-f00544915bba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:22.980346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501c9be-cb55-4139-9b0e-f00544915bba None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:22.987268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 263/514] 10.222.0.41 () {56 vars in 1137 bytes} [Mon May 30 11:53:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:22.988119 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f1496-46e1-45ea-b121-c67c99caa28f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:23.029762 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:23.082735 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 252/515] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:23.083484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501c9be-cb55-4139-9b0e-f00544915bba None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:23.089545 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f1496-46e1-45ea-b121-c67c99caa28f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:23.127932 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e7ae5-8917-40ee-8b1d-9364159cf5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:23.128712 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e7ae5-8917-40ee-8b1d-9364159cf5cf None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:23.128981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e7ae5-8917-40ee-8b1d-9364159cf5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:23.129260 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e7ae5-8917-40ee-8b1d-9364159cf5cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:23.139234 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e7ae5-8917-40ee-8b1d-9364159cf5cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:23.141280 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e7ae5-8917-40ee-8b1d-9364159cf5cf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:23.158568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-cc7e7ae5-8917-40ee-8b1d-9364159cf5cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:23.158568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:23.158568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:23.158568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:23.158568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:23.158568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:23.158568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:23.158568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:23.158568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:23.158568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:23.158568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:23.158568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:23.158568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:23.158568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:23.158568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:23.159591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:23.159591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:23.159591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:23.159591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:23.159591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:23.159591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:23.159591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:23.159591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:23.159591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:23.159591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:23.159591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:23.159591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:23.159591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:23.159591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:23.159591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:23.159591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:23.159591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:23.160800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:23.160800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:23.160800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:23.160800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:23.160800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 264/516] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:23.160800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e7ae5-8917-40ee-8b1d-9364159cf5cf None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:23.176995 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:23.187595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501c9be-cb55-4139-9b0e-f00544915bba None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:23.221545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578d6d3-d558-4982-a9f3-d22c4b8517c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:23.222222 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578d6d3-d558-4982-a9f3-d22c4b8517c0 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:23.222506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578d6d3-d558-4982-a9f3-d22c4b8517c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:23.222784 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578d6d3-d558-4982-a9f3-d22c4b8517c0 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:23.223492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578d6d3-d558-4982-a9f3-d22c4b8517c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:23.225006 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578d6d3-d558-4982-a9f3-d22c4b8517c0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:23.245143 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 253/517] 10.222.0.41 () {60 vars in 1132 bytes} [Mon May 30 11:53:23 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:53:23.246216 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578d6d3-d558-4982-a9f3-d22c4b8517c0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:23.256526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:23.270537 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e7ae5-8917-40ee-8b1d-9364159cf5cf None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:23.311020 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944478c5-96c7-4d31-8724-6b13e6918910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:23.312425 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944478c5-96c7-4d31-8724-6b13e6918910 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:23.312732 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944478c5-96c7-4d31-8724-6b13e6918910 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:23.312997 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944478c5-96c7-4d31-8724-6b13e6918910 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:23.313819 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944478c5-96c7-4d31-8724-6b13e6918910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:23.314141 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944478c5-96c7-4d31-8724-6b13e6918910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:23.315774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944478c5-96c7-4d31-8724-6b13e6918910 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:23.329457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 265/518] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:23.329457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944478c5-96c7-4d31-8724-6b13e6918910 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:23.362903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578d6d3-d558-4982-a9f3-d22c4b8517c0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:23.401683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1326b-bc6a-4593-b9e9-eba9aecd59af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:23.402342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1326b-bc6a-4593-b9e9-eba9aecd59af None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:23.402633 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1326b-bc6a-4593-b9e9-eba9aecd59af None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:23.402909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1326b-bc6a-4593-b9e9-eba9aecd59af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:23.412644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:23.450233 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944478c5-96c7-4d31-8724-6b13e6918910 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:23.480601 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1326b-bc6a-4593-b9e9-eba9aecd59af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:23.482079 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1326b-bc6a-4593-b9e9-eba9aecd59af None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:23.491580 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:23.495945 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a2018-0a06-4b23-bd72-14d8d5a36667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:23.497176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a2018-0a06-4b23-bd72-14d8d5a36667 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:23.497473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a2018-0a06-4b23-bd72-14d8d5a36667 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:23.497753 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a2018-0a06-4b23-bd72-14d8d5a36667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:23.510361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a2018-0a06-4b23-bd72-14d8d5a36667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:23.512379 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a2018-0a06-4b23-bd72-14d8d5a36667 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:23.530837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-906a2018-0a06-4b23-bd72-14d8d5a36667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:23.530837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:23.530837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:23.530837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:23.530837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:23.530837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:23.530837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:23.530837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:23.530837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:23.530837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:23.530837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:23.530837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:23.530837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:23.530837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:23.530837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:23.531809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:23.531809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:23.531809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:23.531809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:23.531809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:23.531809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:23.531809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:23.531809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:23.531809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:23.531809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:23.531809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:23.531809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:23.531809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:23.531809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:23.531809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:23.531809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:23.531809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:23.532845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:23.532845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:23.532845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:23.532845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:23.532845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 266/519] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:23.533195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a2018-0a06-4b23-bd72-14d8d5a36667 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:23.598968 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 254/520] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:23.598968 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1326b-bc6a-4593-b9e9-eba9aecd59af None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:23.657102 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a2018-0a06-4b23-bd72-14d8d5a36667 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:23.684241 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:23.696580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3056c-4b2a-413b-b332-8e03cfabc77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:23.697245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3056c-4b2a-413b-b332-8e03cfabc77f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:23.697528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3056c-4b2a-413b-b332-8e03cfabc77f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:23.697807 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3056c-4b2a-413b-b332-8e03cfabc77f None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:23.698540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3056c-4b2a-413b-b332-8e03cfabc77f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:23.698850 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3056c-4b2a-413b-b332-8e03cfabc77f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:23.700053 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1326b-bc6a-4593-b9e9-eba9aecd59af None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:23.700251 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3056c-4b2a-413b-b332-8e03cfabc77f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:23.707901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:23.718530 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 267/521] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:23.718530 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3056c-4b2a-413b-b332-8e03cfabc77f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:23.741661 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfedd8e-9780-4112-96e2-0a496cbd2924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:23.742460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfedd8e-9780-4112-96e2-0a496cbd2924 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:23.742749 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfedd8e-9780-4112-96e2-0a496cbd2924 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:23.743014 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfedd8e-9780-4112-96e2-0a496cbd2924 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:23.751082 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfedd8e-9780-4112-96e2-0a496cbd2924 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:23.752564 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfedd8e-9780-4112-96e2-0a496cbd2924 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:23.774670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7dfedd8e-9780-4112-96e2-0a496cbd2924 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:23.774670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:23.774670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:23.774670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:23.774670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:23.774670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:23.774670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:23.774670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:23.774670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:23.774670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:23.774670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:23.774670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:23.774670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:23.774670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:23.774670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:23.775500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:23.775500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:23.775500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:23.775500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:23.775500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:23.775500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:23.775500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:23.775500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:23.775500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:23.775500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:23.775500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:23.775500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:23.775500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:23.775500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:23.775500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:23.775500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:23.775500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:23.776493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:23.776493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:23.776493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:23.776493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:23.776493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:23.776493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:23.776493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:23.776493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:23.777787 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 255/522] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:23.779040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfedd8e-9780-4112-96e2-0a496cbd2924 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:23.834029 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3056c-4b2a-413b-b332-8e03cfabc77f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:23.870192 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb03aa-6a2d-453c-a9a0-a690c301cc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:23.870860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb03aa-6a2d-453c-a9a0-a690c301cc6c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:23.871153 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb03aa-6a2d-453c-a9a0-a690c301cc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:23.871724 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb03aa-6a2d-453c-a9a0-a690c301cc6c None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:23.872498 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb03aa-6a2d-453c-a9a0-a690c301cc6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:23.872816 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb03aa-6a2d-453c-a9a0-a690c301cc6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:23.874818 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb03aa-6a2d-453c-a9a0-a690c301cc6c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:23.891412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 268/523] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:23.891412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb03aa-6a2d-453c-a9a0-a690c301cc6c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:23.898220 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfedd8e-9780-4112-96e2-0a496cbd2924 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:23.934761 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f08be3-0e17-4962-99de-2d217de931cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:23.935474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f08be3-0e17-4962-99de-2d217de931cd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:23.935768 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f08be3-0e17-4962-99de-2d217de931cd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:23.936077 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f08be3-0e17-4962-99de-2d217de931cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:23.939660 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:23.948365 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f08be3-0e17-4962-99de-2d217de931cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:23.949835 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f08be3-0e17-4962-99de-2d217de931cd None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:23.967109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-31f08be3-0e17-4962-99de-2d217de931cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:23.967109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:23.967109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:23.967109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:23.967109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:23.967109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:23.967109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:23.967109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:23.967109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:23.967109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:23.967109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:23.967109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:23.967109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:23.967109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:23.967109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:23.968433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:23.968433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:23.968433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:23.968433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:23.968433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:23.968433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:23.968433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:23.968433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:23.968433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:23.968433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:23.968433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:23.968433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:23.968433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:23.968433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:23.968433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:23.968433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:23.968433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:23.969770 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:23.969770 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:23.969770 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:23.969770 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:23.969770 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 256/524] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:23.969770 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f08be3-0e17-4962-99de-2d217de931cd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:23.994969 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:24.003658 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb03aa-6a2d-453c-a9a0-a690c301cc6c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:24.041974 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11e160-3924-4497-ab5a-0f79d3bc57a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:24.042847 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11e160-3924-4497-ab5a-0f79d3bc57a8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:24.043136 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11e160-3924-4497-ab5a-0f79d3bc57a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:24.043417 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11e160-3924-4497-ab5a-0f79d3bc57a8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:24.051759 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11e160-3924-4497-ab5a-0f79d3bc57a8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:24.053227 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11e160-3924-4497-ab5a-0f79d3bc57a8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:24.069169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ad11e160-3924-4497-ab5a-0f79d3bc57a8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 30 11:53:24.069169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:24.069169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:24.069169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:24.069169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:24.069169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:24.069169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:24.069169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:24.069169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:24.069169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:24.069169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:24.069169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:24.069169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:24.069169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:24.069169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:24.069169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:24.070085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:24.070085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:24.070085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:24.070085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:24.070085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:24.070085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:24.070085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:24.070085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:24.070085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:24.070085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:24.070085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:24.070085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:24.070085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:24.070085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:24.070085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:24.070085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:24.070085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:24.070085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:24.070947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:24.070947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:24.070947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:24.070947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:24.070947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:24.070947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:24.070947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:24.070947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:24.070947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 30 11:53:24.070947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:24.070947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 269/525] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:24.071612 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11e160-3924-4497-ab5a-0f79d3bc57a8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:24.087647 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f08be3-0e17-4962-99de-2d217de931cd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:24.131278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3ad41-f922-4a92-bad5-51518dbf8a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:24.131992 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3ad41-f922-4a92-bad5-51518dbf8a69 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:24.132289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3ad41-f922-4a92-bad5-51518dbf8a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:24.132572 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3ad41-f922-4a92-bad5-51518dbf8a69 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:24.133376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3ad41-f922-4a92-bad5-51518dbf8a69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:24.133693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3ad41-f922-4a92-bad5-51518dbf8a69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:24.135140 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3ad41-f922-4a92-bad5-51518dbf8a69 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:24.153628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 257/526] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:24.154445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3ad41-f922-4a92-bad5-51518dbf8a69 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:24.192038 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11e160-3924-4497-ab5a-0f79d3bc57a8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:24.195053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:24.229384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b486a-7908-4db8-afd5-3f4ce3a024bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:24.230182 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b486a-7908-4db8-afd5-3f4ce3a024bf None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:24.230469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b486a-7908-4db8-afd5-3f4ce3a024bf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:24.230751 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b486a-7908-4db8-afd5-3f4ce3a024bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:24.237363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:24.238799 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b486a-7908-4db8-afd5-3f4ce3a024bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:24.240510 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b486a-7908-4db8-afd5-3f4ce3a024bf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:24.256446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-025b486a-7908-4db8-afd5-3f4ce3a024bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:24.256446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:24.256446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:24.256446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:24.256446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:24.256446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:24.256446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:24.256446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:24.256446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:24.256446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:24.256446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:24.256446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:24.256446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:24.256446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:24.256446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:24.257301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:24.257301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:24.257301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:24.257301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:24.257301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:24.257301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:24.257301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:24.257301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:24.257301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:24.257301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:24.257301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:24.257301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:24.257301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:24.257301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:24.257301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:24.257301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:24.257301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:24.258443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:24.258443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:24.258443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:24.258443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:24.258443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:24.258443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:24.258443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:24.258443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:24.258443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 270/527] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:24.259074 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b486a-7908-4db8-afd5-3f4ce3a024bf None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:24.265727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3ad41-f922-4a92-bad5-51518dbf8a69 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:24.301367 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ba130-fbdd-4086-921e-47309a84428b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:24.302033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ba130-fbdd-4086-921e-47309a84428b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:24.302316 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ba130-fbdd-4086-921e-47309a84428b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:24.302592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ba130-fbdd-4086-921e-47309a84428b None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:24.303351 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ba130-fbdd-4086-921e-47309a84428b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:24.303650 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ba130-fbdd-4086-921e-47309a84428b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:24.305047 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ba130-fbdd-4086-921e-47309a84428b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:24.318259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 258/528] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:24.319079 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ba130-fbdd-4086-921e-47309a84428b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:24.375017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b486a-7908-4db8-afd5-3f4ce3a024bf None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:24.420097 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d263e4-6482-43f0-9618-4cbe722ab9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:24.421664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d263e4-6482-43f0-9618-4cbe722ab9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:24.421948 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d263e4-6482-43f0-9618-4cbe722ab9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:24.422479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d263e4-6482-43f0-9618-4cbe722ab9a9 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:24.423757 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d263e4-6482-43f0-9618-4cbe722ab9a9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:24.424384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d263e4-6482-43f0-9618-4cbe722ab9a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:24.425866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ba130-fbdd-4086-921e-47309a84428b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:24.425982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d263e4-6482-43f0-9618-4cbe722ab9a9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:24.453737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 271/529] 10.222.0.41 () {56 vars in 1139 bytes} [Mon May 30 11:53:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:24.453737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d263e4-6482-43f0-9618-4cbe722ab9a9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:24.461681 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449a7c1-fb2e-44e7-a0a8-04b6843b0bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:24.462341 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449a7c1-fb2e-44e7-a0a8-04b6843b0bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:24.462624 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449a7c1-fb2e-44e7-a0a8-04b6843b0bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:24.462897 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449a7c1-fb2e-44e7-a0a8-04b6843b0bf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:24.463807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449a7c1-fb2e-44e7-a0a8-04b6843b0bf3 None admin] RBAC: Adding query filter params (role.id=dc57e0b7f67947e0b6b63c4ad0148358, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=bb3820a613744c15b840681fe6b6e808) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:24.464146 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449a7c1-fb2e-44e7-a0a8-04b6843b0bf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:24.465586 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449a7c1-fb2e-44e7-a0a8-04b6843b0bf3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:24.472221 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 259/530] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:53:24 2022] GET /identity/v3/role_assignments?user.id=bb3820a613744c15b840681fe6b6e808&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=dc57e0b7f67947e0b6b63c4ad0148358 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:24.473044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449a7c1-fb2e-44e7-a0a8-04b6843b0bf3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:24.476059 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:24.500768 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:24.610733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449a7c1-fb2e-44e7-a0a8-04b6843b0bf3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:24.619074 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d263e4-6482-43f0-9618-4cbe722ab9a9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:24.659564 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18178125-389d-43ea-a443-ddc5ab3e93c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:24.660291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18178125-389d-43ea-a443-ddc5ab3e93c6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:24.660581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18178125-389d-43ea-a443-ddc5ab3e93c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:24.660862 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18178125-389d-43ea-a443-ddc5ab3e93c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:24.661784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18178125-389d-43ea-a443-ddc5ab3e93c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:24.662100 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18178125-389d-43ea-a443-ddc5ab3e93c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:24.662521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdf34a-613e-47d0-94c4-8f0d5ee095f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:24.663568 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdf34a-613e-47d0-94c4-8f0d5ee095f9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:24.663687 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18178125-389d-43ea-a443-ddc5ab3e93c6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:24.664260 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdf34a-613e-47d0-94c4-8f0d5ee095f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:24.664749 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdf34a-613e-47d0-94c4-8f0d5ee095f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:24.673930 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdf34a-613e-47d0-94c4-8f0d5ee095f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:24.675707 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdf34a-613e-47d0-94c4-8f0d5ee095f9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:24.685485 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 272/531] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:24.686266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18178125-389d-43ea-a443-ddc5ab3e93c6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:24.695013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-4cfdf34a-613e-47d0-94c4-8f0d5ee095f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:24.695013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:24.695013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:24.695013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:24.695013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:24.695013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:24.695013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:24.695013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:24.695013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:24.695013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:24.695013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:24.695013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:24.695013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:24.695013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:24.695013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:24.696050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:24.696050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:24.696050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:24.696050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:24.696050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:24.696050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:24.696050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:24.696050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:24.696050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:24.696050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:24.696050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:24.696050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:24.696050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:24.696050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:24.696050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:24.696050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:24.696050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:24.697102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:24.697102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:24.697102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:24.697102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:24.697102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:24.697102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:24.697102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:24.697102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:24.699547 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 260/532] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:24.700561 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdf34a-613e-47d0-94c4-8f0d5ee095f9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:24.780627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:24.786148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:24.808038 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18178125-389d-43ea-a443-ddc5ab3e93c6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:24.830655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdf34a-613e-47d0-94c4-8f0d5ee095f9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:24.846252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d9e57-6e58-4e00-9b83-5bd17f4676bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:24.847041 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d9e57-6e58-4e00-9b83-5bd17f4676bc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:24.847424 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d9e57-6e58-4e00-9b83-5bd17f4676bc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:24.847799 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d9e57-6e58-4e00-9b83-5bd17f4676bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:24.875106 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc647f-a3a0-496b-866a-ca1020e0f0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:24.876222 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc647f-a3a0-496b-866a-ca1020e0f0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:24.876510 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc647f-a3a0-496b-866a-ca1020e0f0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:24.876789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc647f-a3a0-496b-866a-ca1020e0f0a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:24.877643 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc647f-a3a0-496b-866a-ca1020e0f0a5 None admin] RBAC: Adding query filter params (role.id=dc57e0b7f67947e0b6b63c4ad0148358, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=2ffa6d38c01f4820a705c06991654bb4) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:24.877961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc647f-a3a0-496b-866a-ca1020e0f0a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:24.879415 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc647f-a3a0-496b-866a-ca1020e0f0a5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:24.885934 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 261/533] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:53:24 2022] GET /identity/v3/role_assignments?user.id=2ffa6d38c01f4820a705c06991654bb4&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=dc57e0b7f67947e0b6b63c4ad0148358 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:24.886820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc647f-a3a0-496b-866a-ca1020e0f0a5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:24.941418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d9e57-6e58-4e00-9b83-5bd17f4676bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:24.943888 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d9e57-6e58-4e00-9b83-5bd17f4676bc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:25.001464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc647f-a3a0-496b-866a-ca1020e0f0a5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:25.039973 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:25.062937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:25.071358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5917e-71cd-4ee5-8d9c-da7a72df871c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:25.072208 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5917e-71cd-4ee5-8d9c-da7a72df871c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:25.072448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5917e-71cd-4ee5-8d9c-da7a72df871c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:25.072730 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5917e-71cd-4ee5-8d9c-da7a72df871c None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:25.073561 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5917e-71cd-4ee5-8d9c-da7a72df871c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:25.074016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5917e-71cd-4ee5-8d9c-da7a72df871c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:25.075539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5917e-71cd-4ee5-8d9c-da7a72df871c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:25.091217 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 262/534] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:25.098957 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5917e-71cd-4ee5-8d9c-da7a72df871c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:25.111187 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 273/535] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:25.116773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d9e57-6e58-4e00-9b83-5bd17f4676bc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:25.262907 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5917e-71cd-4ee5-8d9c-da7a72df871c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:25.269382 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d9e57-6e58-4e00-9b83-5bd17f4676bc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:25.323479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb7646-431f-4577-90ed-7891425e616d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:25.324108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb7646-431f-4577-90ed-7891425e616d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:25.324396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb7646-431f-4577-90ed-7891425e616d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:25.324681 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb7646-431f-4577-90ed-7891425e616d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:25.325535 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb7646-431f-4577-90ed-7891425e616d None admin] RBAC: Adding query filter params (role.id=dc57e0b7f67947e0b6b63c4ad0148358, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=ca1110aeeded4ab0b6fa2aedfa8740c3) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:25.325851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb7646-431f-4577-90ed-7891425e616d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:25.327494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb7646-431f-4577-90ed-7891425e616d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:25.332181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadf63e-cb4b-4d03-a5f0-36b21c4c5a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:25.332985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadf63e-cb4b-4d03-a5f0-36b21c4c5a52 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:25.333270 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadf63e-cb4b-4d03-a5f0-36b21c4c5a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:25.333549 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadf63e-cb4b-4d03-a5f0-36b21c4c5a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:25.347969 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 263/536] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:53:25 2022] GET /identity/v3/role_assignments?user.id=ca1110aeeded4ab0b6fa2aedfa8740c3&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=dc57e0b7f67947e0b6b63c4ad0148358 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:25.350025 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadf63e-cb4b-4d03-a5f0-36b21c4c5a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:25.351522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadf63e-cb4b-4d03-a5f0-36b21c4c5a52 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:25.378775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-eaadf63e-cb4b-4d03-a5f0-36b21c4c5a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:25.378775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:25.378775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:25.378775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:25.378775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:25.378775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:25.378775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:25.378775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:25.378775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:25.378775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:25.378775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:25.378775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:25.378775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:25.378775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:25.378775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:25.379693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:25.379693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:25.379693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:25.379693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:25.379693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:25.379693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:25.379693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:25.379693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:25.379693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:25.379693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:25.379693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:25.379693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:25.379693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:25.379693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:25.379693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:25.379693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:25.379693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:25.381021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:25.381021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:25.381021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:25.381021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:25.381021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 274/537] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:53:25.386136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb7646-431f-4577-90ed-7891425e616d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:25.464227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:25.530280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb7646-431f-4577-90ed-7891425e616d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:25.588492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed07cd-eeb6-4370-9665-71f51bf75a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:25.589110 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed07cd-eeb6-4370-9665-71f51bf75a2a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:25.589398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed07cd-eeb6-4370-9665-71f51bf75a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:25.589677 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed07cd-eeb6-4370-9665-71f51bf75a2a None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:25.590436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed07cd-eeb6-4370-9665-71f51bf75a2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:25.590751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed07cd-eeb6-4370-9665-71f51bf75a2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:25.592217 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed07cd-eeb6-4370-9665-71f51bf75a2a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:25.617808 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 264/538] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:25.624172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadf63e-cb4b-4d03-a5f0-36b21c4c5a52 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:25.625413 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5330c38-04b3-4552-8f93-2676f3fcae35 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:25.625709 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5330c38-04b3-4552-8f93-2676f3fcae35 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:25.625989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5330c38-04b3-4552-8f93-2676f3fcae35 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:25.627659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 265/539] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:53:25.635862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287cf31-c818-470a-abde-8c0a99ff4bf8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:25.635862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287cf31-c818-470a-abde-8c0a99ff4bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:25.635862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287cf31-c818-470a-abde-8c0a99ff4bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:25.660380 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1287cf31-c818-470a-abde-8c0a99ff4bf8 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:25.661626 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1287cf31-c818-470a-abde-8c0a99ff4bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:25.696441 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:25.743966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 266/540] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:53:25.773430 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287cf31-c818-470a-abde-8c0a99ff4bf8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:25.773519 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadf63e-cb4b-4d03-a5f0-36b21c4c5a52 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:25.829374 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:25.851590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d9f87-1e9e-4fce-86a8-199b522f3c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:25.852358 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d9f87-1e9e-4fce-86a8-199b522f3c29 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:25.852708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d9f87-1e9e-4fce-86a8-199b522f3c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:25.853038 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d9f87-1e9e-4fce-86a8-199b522f3c29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:25.872960 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d9f87-1e9e-4fce-86a8-199b522f3c29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:25.875168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d9f87-1e9e-4fce-86a8-199b522f3c29 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:25.878695 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287cf31-c818-470a-abde-8c0a99ff4bf8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:25.901418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-be4d9f87-1e9e-4fce-86a8-199b522f3c29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:25.901418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:25.901418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:25.901418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:25.901418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:25.901418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:25.901418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:25.901418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:25.901418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:25.901418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:25.901418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:25.901418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:25.901418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:25.901418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:25.901418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:25.902316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:25.902316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:25.902316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:25.902316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:25.902316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:25.902316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:25.902316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:25.902316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:25.902316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:25.902316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:25.902316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:25.902316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:25.902316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:25.902316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:25.902316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:25.902316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:25.902316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:25.903138 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:25.903138 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:25.903138 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:25.903138 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:25.903138 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:25.903138 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:25.903138 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:25.903138 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:25.912329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 275/541] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:25.914783 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c884ae-657a-4b32-9c2a-4a56ef19dc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:25.915590 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c884ae-657a-4b32-9c2a-4a56ef19dc38 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:25.915904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c884ae-657a-4b32-9c2a-4a56ef19dc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:25.916182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c884ae-657a-4b32-9c2a-4a56ef19dc38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:25.917844 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d9f87-1e9e-4fce-86a8-199b522f3c29 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:25.927416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c884ae-657a-4b32-9c2a-4a56ef19dc38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:25.935480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-f7c884ae-657a-4b32-9c2a-4a56ef19dc38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:25.935480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:25.935480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:25.935480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:25.935480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:25.935480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:25.935480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:25.935480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:25.935480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:25.935480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:25.935480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:25.935480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:25.935480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:25.935480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:25.935480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:25.935480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:25.938274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:25.938274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:25.938274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:25.938274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:25.938274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:25.938274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:25.938274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:25.938274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:25.938274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:25.938274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:25.938274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:25.938274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:25.938274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:25.938274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:25.938274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:25.938274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:25.940264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:25.940264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:25.940264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:25.940264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:25.940264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:25.940264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:25.940264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:25.940264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:25.940264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:25.940264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:25.940264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:25.940264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:25.940264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 267/542] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:25.947842 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c884ae-657a-4b32-9c2a-4a56ef19dc38 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:26.051223 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c884ae-657a-4b32-9c2a-4a56ef19dc38 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:26.054703 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:26.087584 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa9e78-f419-4830-aa2b-4ebba06866cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:26.088490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa9e78-f419-4830-aa2b-4ebba06866cd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:26.088779 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa9e78-f419-4830-aa2b-4ebba06866cd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:26.089062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa9e78-f419-4830-aa2b-4ebba06866cd None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:26.089816 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa9e78-f419-4830-aa2b-4ebba06866cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:26.090127 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa9e78-f419-4830-aa2b-4ebba06866cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:26.091514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa9e78-f419-4830-aa2b-4ebba06866cd None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:26.112077 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 268/543] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:53:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:26.122677 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa9e78-f419-4830-aa2b-4ebba06866cd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:26.148969 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:26.164549 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d9f87-1e9e-4fce-86a8-199b522f3c29 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:26.232815 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa9e78-f419-4830-aa2b-4ebba06866cd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:26.240551 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463e450-cce4-4d3e-bf18-31d1a26fde3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:26.241452 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463e450-cce4-4d3e-bf18-31d1a26fde3c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:26.241563 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463e450-cce4-4d3e-bf18-31d1a26fde3c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:26.241789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463e450-cce4-4d3e-bf18-31d1a26fde3c None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:26.242607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463e450-cce4-4d3e-bf18-31d1a26fde3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:26.242926 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463e450-cce4-4d3e-bf18-31d1a26fde3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:26.244531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463e450-cce4-4d3e-bf18-31d1a26fde3c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:26.263164 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 276/544] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:26.269734 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463e450-cce4-4d3e-bf18-31d1a26fde3c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:26.273036 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb40de8-c587-4d11-97e4-ab75dc81a8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:26.274185 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb40de8-c587-4d11-97e4-ab75dc81a8db None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:26.274717 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb40de8-c587-4d11-97e4-ab75dc81a8db None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:26.275272 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb40de8-c587-4d11-97e4-ab75dc81a8db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:26.288147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb40de8-c587-4d11-97e4-ab75dc81a8db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:26.289979 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb40de8-c587-4d11-97e4-ab75dc81a8db None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:26.309406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-9fb40de8-c587-4d11-97e4-ab75dc81a8db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:26.309406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:26.309406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:26.309406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:26.309406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:26.309406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:26.309406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:26.309406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:26.309406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:26.309406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:26.309406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:26.309406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:26.309406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:26.309406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:26.309406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:26.310281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:26.310281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:26.310281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:26.310281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:26.310281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:26.310281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:26.310281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:26.310281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:26.310281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:26.310281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:26.310281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:26.310281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:26.310281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:26.310281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:26.310281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:26.310281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:26.310281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:26.311123 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:26.311123 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:26.311123 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:26.311123 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:26.313644 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 269/545] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:53:26.319115 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb40de8-c587-4d11-97e4-ab75dc81a8db None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:26.338170 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:26.438863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb40de8-c587-4d11-97e4-ab75dc81a8db None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:26.476748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec9c34-5d40-4acb-8af3-3a8a1708ad1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:26.477945 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec9c34-5d40-4acb-8af3-3a8a1708ad1b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:26.478440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec9c34-5d40-4acb-8af3-3a8a1708ad1b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:26.478924 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec9c34-5d40-4acb-8af3-3a8a1708ad1b None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:26.479893 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec9c34-5d40-4acb-8af3-3a8a1708ad1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:26.480415 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec9c34-5d40-4acb-8af3-3a8a1708ad1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:26.482149 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec9c34-5d40-4acb-8af3-3a8a1708ad1b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:26.489827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463e450-cce4-4d3e-bf18-31d1a26fde3c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:26.496924 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 270/546] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:26.502878 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec9c34-5d40-4acb-8af3-3a8a1708ad1b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:26.529386 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07835d-96d1-4771-b5b5-fcf3410b8c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:26.530660 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07835d-96d1-4771-b5b5-fcf3410b8c06 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:26.531784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07835d-96d1-4771-b5b5-fcf3410b8c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:26.531995 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07835d-96d1-4771-b5b5-fcf3410b8c06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:26.532864 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07835d-96d1-4771-b5b5-fcf3410b8c06 None admin] RBAC: Adding query filter params (role.id=dc57e0b7f67947e0b6b63c4ad0148358, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=ae7bc0d4fd924bfb89f874d1c6fc3d4b) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:26.533200 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07835d-96d1-4771-b5b5-fcf3410b8c06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:26.534710 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07835d-96d1-4771-b5b5-fcf3410b8c06 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:26.551847 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 277/547] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:53:26 2022] GET /identity/v3/role_assignments?user.id=ae7bc0d4fd924bfb89f874d1c6fc3d4b&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=dc57e0b7f67947e0b6b63c4ad0148358 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:26.597008 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:26.626797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec9c34-5d40-4acb-8af3-3a8a1708ad1b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:26.668035 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158a4c9-83b3-493f-940c-64ca02118401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:26.669245 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158a4c9-83b3-493f-940c-64ca02118401 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:26.669745 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158a4c9-83b3-493f-940c-64ca02118401 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:26.670230 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158a4c9-83b3-493f-940c-64ca02118401 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:26.678906 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158a4c9-83b3-493f-940c-64ca02118401 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:26.680822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158a4c9-83b3-493f-940c-64ca02118401 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:26.697669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-5158a4c9-83b3-493f-940c-64ca02118401 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 30 11:53:26.697669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:26.697669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:26.697669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:26.697669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:26.697669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:26.697669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:26.697669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:26.697669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:26.697669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:26.697669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:26.697669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:26.697669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:26.697669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:26.697669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:26.697669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:26.699121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:26.699121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:26.699121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:26.699121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:26.699121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:26.699121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:26.699121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:26.699121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:26.699121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:26.699121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:26.699121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:26.699121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:26.699121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:26.699121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:26.699121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:26.699121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:26.699121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:26.699121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:26.700241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:26.700241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:26.700241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:26.700241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:26.700241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:26.700241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:26.700241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:26.700241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:26.700241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 30 11:53:26.700241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:26.703517 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 271/548] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:53:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:26.709374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07835d-96d1-4771-b5b5-fcf3410b8c06 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:26.729775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:26.841128 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07835d-96d1-4771-b5b5-fcf3410b8c06 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:26.882833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef01f3-05df-460b-9f09-9e3d399b128d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:26.883504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef01f3-05df-460b-9f09-9e3d399b128d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:26.883784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef01f3-05df-460b-9f09-9e3d399b128d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:26.884087 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef01f3-05df-460b-9f09-9e3d399b128d None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:26.884933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef01f3-05df-460b-9f09-9e3d399b128d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:26.885241 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef01f3-05df-460b-9f09-9e3d399b128d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:26.886664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef01f3-05df-460b-9f09-9e3d399b128d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:26.905606 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 278/549] 10.222.0.41 () {56 vars in 1135 bytes} [Mon May 30 11:53:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:26.910780 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158a4c9-83b3-493f-940c-64ca02118401 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:27.018013 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613f444-ca69-4873-8309-3afac0d81219 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:27.018627 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613f444-ca69-4873-8309-3afac0d81219 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:27.019106 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613f444-ca69-4873-8309-3afac0d81219 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:27.021034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 279/550] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:53:27.026445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270d3c3-e316-4711-90cd-bd2fbee2efa2 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:27.026998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270d3c3-e316-4711-90cd-bd2fbee2efa2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:27.027479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270d3c3-e316-4711-90cd-bd2fbee2efa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:27.041238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158a4c9-83b3-493f-940c-64ca02118401 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:27.069621 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1270d3c3-e316-4711-90cd-bd2fbee2efa2 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:27.070841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1270d3c3-e316-4711-90cd-bd2fbee2efa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:27.077444 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6e2c0-3de9-460e-a4e8-e0f88f897f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:27.078272 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6e2c0-3de9-460e-a4e8-e0f88f897f92 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:27.078560 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6e2c0-3de9-460e-a4e8-e0f88f897f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:27.078843 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6e2c0-3de9-460e-a4e8-e0f88f897f92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:27.087412 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:27.152357 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6e2c0-3de9-460e-a4e8-e0f88f897f92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:27.153995 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6e2c0-3de9-460e-a4e8-e0f88f897f92 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:27.241531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 280/551] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:53:27.258862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 272/552] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:27.264672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270d3c3-e316-4711-90cd-bd2fbee2efa2 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:27.271928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6e2c0-3de9-460e-a4e8-e0f88f897f92 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:27.283550 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:27.328185 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:27.382582 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6e2c0-3de9-460e-a4e8-e0f88f897f92 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:27.422655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a00276-3a2f-4721-afdc-5064c867a49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:27.423576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a00276-3a2f-4721-afdc-5064c867a49f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:27.423909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a00276-3a2f-4721-afdc-5064c867a49f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:27.424191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a00276-3a2f-4721-afdc-5064c867a49f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:27.435242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a00276-3a2f-4721-afdc-5064c867a49f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:27.444029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-e5a00276-3a2f-4721-afdc-5064c867a49f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:27.444029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:27.444029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:27.444029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:27.444029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:27.444029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:27.444029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:27.444029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:27.444029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:27.444029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:27.444029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:27.444029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:27.444029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:27.444029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:27.444029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:27.444029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:27.445029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:27.445029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:27.445029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:27.445029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:27.445029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:27.445029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:27.445029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:27.445029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:27.445029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:27.445029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:27.445029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:27.445029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:27.445029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:27.445029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:27.445029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:27.445029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:27.445839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:27.445839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:27.445839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:27.445839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:27.445839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:27.445839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:27.445839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:27.445839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:27.445839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:27.445839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:27.445839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:27.445839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:27.445839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 273/553] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:53:27.453028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a00276-3a2f-4721-afdc-5064c867a49f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:27.484588 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270d3c3-e316-4711-90cd-bd2fbee2efa2 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:27.560750 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83dbb2-25fd-45d2-889a-3256c0b02ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:27.564025 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83dbb2-25fd-45d2-889a-3256c0b02ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:27.564473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83dbb2-25fd-45d2-889a-3256c0b02ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:27.564903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83dbb2-25fd-45d2-889a-3256c0b02ca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:27.583442 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83dbb2-25fd-45d2-889a-3256c0b02ca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:27.585762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83dbb2-25fd-45d2-889a-3256c0b02ca5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:27.623700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-5d83dbb2-25fd-45d2-889a-3256c0b02ca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:27.623700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:27.623700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:27.623700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:27.623700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:27.623700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:27.623700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:27.623700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:27.623700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:27.623700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:27.623700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:27.623700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:27.623700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:27.623700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:27.623700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:27.625445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:27.625445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:27.625445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:27.625445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:27.625445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:27.625445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:27.625445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:27.625445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:27.625445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:27.625445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:27.625445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:27.625445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:27.625445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:27.625445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:27.625445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:27.625445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:27.625445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:27.626597 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:27.626597 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:27.626597 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:27.626597 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:27.630020 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 281/554] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:27.637003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83dbb2-25fd-45d2-889a-3256c0b02ca5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:27.662610 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:27.676655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a00276-3a2f-4721-afdc-5064c867a49f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:27.748601 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3420e27-adf1-443d-93c6-bfdc24bc8745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:27.750197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3420e27-adf1-443d-93c6-bfdc24bc8745 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:27.750646 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3420e27-adf1-443d-93c6-bfdc24bc8745 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:27.751079 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3420e27-adf1-443d-93c6-bfdc24bc8745 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:27.751992 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3420e27-adf1-443d-93c6-bfdc24bc8745 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:27.752454 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3420e27-adf1-443d-93c6-bfdc24bc8745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:27.755431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3420e27-adf1-443d-93c6-bfdc24bc8745 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:27.761459 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:27.783648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 274/555] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:53:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:27.789375 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3420e27-adf1-443d-93c6-bfdc24bc8745 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:27.868059 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83dbb2-25fd-45d2-889a-3256c0b02ca5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:27.931734 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f52e98-96bf-4249-89cd-c221d4f4e1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:27.932546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f52e98-96bf-4249-89cd-c221d4f4e1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:27.933077 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f52e98-96bf-4249-89cd-c221d4f4e1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:27.933365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f52e98-96bf-4249-89cd-c221d4f4e1b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:27.934529 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f52e98-96bf-4249-89cd-c221d4f4e1b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:27.935098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f52e98-96bf-4249-89cd-c221d4f4e1b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:27.936882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f52e98-96bf-4249-89cd-c221d4f4e1b6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:27.944126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3420e27-adf1-443d-93c6-bfdc24bc8745 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:27.956596 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 282/556] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:27.958047 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd028067-5edc-41ad-8869-896798c5e67b None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:27.958772 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd028067-5edc-41ad-8869-896798c5e67b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:27.959053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd028067-5edc-41ad-8869-896798c5e67b None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:27.961350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 283/557] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:27.962072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd028067-5edc-41ad-8869-896798c5e67b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:27.997296 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68c8e2-3627-490f-aee1-1d6a37fcd182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:27.998563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68c8e2-3627-490f-aee1-1d6a37fcd182 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:27.999406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68c8e2-3627-490f-aee1-1d6a37fcd182 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:27.999765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68c8e2-3627-490f-aee1-1d6a37fcd182 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:28.018343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68c8e2-3627-490f-aee1-1d6a37fcd182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:28.019983 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68c8e2-3627-490f-aee1-1d6a37fcd182 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:28.048072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-4d68c8e2-3627-490f-aee1-1d6a37fcd182 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:28.048072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:28.048072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:28.048072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:28.048072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:28.048072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:28.048072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:28.048072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:28.048072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:28.048072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:28.048072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:28.048072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:28.048072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:28.048072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:28.048072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:28.049793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:28.049793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:28.049793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:28.049793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:28.049793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:28.049793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:28.049793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:28.049793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:28.049793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:28.049793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:28.049793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:28.049793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:28.049793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:28.049793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:28.049793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:28.049793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:28.049793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:28.051018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:28.051018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:28.051018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:28.051018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:28.054233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 275/558] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:28.054233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa7e49-6121-4875-88ce-ac68aa79c296 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:28.054233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa7e49-6121-4875-88ce-ac68aa79c296 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:28.054233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa7e49-6121-4875-88ce-ac68aa79c296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:28.078157 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5dfa7e49-6121-4875-88ce-ac68aa79c296 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:28.079406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5dfa7e49-6121-4875-88ce-ac68aa79c296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:28.081575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:28.114063 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd028067-5edc-41ad-8869-896798c5e67b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:28.137230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:28.156794 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 276/559] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:28.158284 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa7e49-6121-4875-88ce-ac68aa79c296 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:28.162622 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e45c6-1df0-4701-b1fc-8f7a29de3e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:28.163616 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e45c6-1df0-4701-b1fc-8f7a29de3e2f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:28.164085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e45c6-1df0-4701-b1fc-8f7a29de3e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:28.164531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e45c6-1df0-4701-b1fc-8f7a29de3e2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:28.175538 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e45c6-1df0-4701-b1fc-8f7a29de3e2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:28.177773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e45c6-1df0-4701-b1fc-8f7a29de3e2f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:28.198337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-a64e45c6-1df0-4701-b1fc-8f7a29de3e2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:28.198337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:28.198337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:28.198337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:28.198337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:28.198337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:28.198337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:28.198337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:28.198337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:28.198337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:28.198337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:28.198337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:28.198337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:28.198337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:28.198337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:28.199521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:28.199521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:28.199521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:28.199521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:28.199521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:28.199521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:28.199521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:28.199521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:28.199521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:28.199521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:28.199521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:28.199521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:28.199521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:28.199521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:28.199521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:28.199521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:28.199521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:28.200618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:28.200618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:28.200618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:28.200618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:28.200618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:28.200618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:28.200618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:28.200618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:28.203371 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 284/560] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:28.205844 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e45c6-1df0-4701-b1fc-8f7a29de3e2f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:28.272594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa7e49-6121-4875-88ce-ac68aa79c296 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:28.315073 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbb031-6161-4b06-926c-5389ec54ef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:28.316262 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbb031-6161-4b06-926c-5389ec54ef63 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:28.317090 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbb031-6161-4b06-926c-5389ec54ef63 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:28.317701 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbb031-6161-4b06-926c-5389ec54ef63 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:28.318876 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbb031-6161-4b06-926c-5389ec54ef63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:28.319582 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbb031-6161-4b06-926c-5389ec54ef63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:28.321430 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbb031-6161-4b06-926c-5389ec54ef63 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:28.330910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:28.337531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e45c6-1df0-4701-b1fc-8f7a29de3e2f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:28.344143 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 277/561] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:28.346035 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbb031-6161-4b06-926c-5389ec54ef63 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:28.383605 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411585ff-53ea-4701-b31c-2582d441cbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:28.384444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411585ff-53ea-4701-b31c-2582d441cbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:28.384720 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411585ff-53ea-4701-b31c-2582d441cbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:28.385002 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411585ff-53ea-4701-b31c-2582d441cbf4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:28.395757 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411585ff-53ea-4701-b31c-2582d441cbf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:28.403473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-411585ff-53ea-4701-b31c-2582d441cbf4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:28.403473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:28.403473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:28.403473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:28.403473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:28.403473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:28.403473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:28.403473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:28.403473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:28.403473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:28.403473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:28.403473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:28.403473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:28.403473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:28.403473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:28.403473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:28.404667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:28.404667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:28.404667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:28.404667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:28.404667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:28.404667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:28.404667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:28.404667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:28.404667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:28.404667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:28.404667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:28.404667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:28.404667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:28.404667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:28.404667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:28.404667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:28.405573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:28.405573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:28.405573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:28.405573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:28.405573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:28.405573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:28.405573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:28.405573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:28.405573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:28.405573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:28.405573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:28.405573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:28.405573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 285/562] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:28.405573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411585ff-53ea-4701-b31c-2582d441cbf4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:28.459518 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbb031-6161-4b06-926c-5389ec54ef63 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:28.460325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:28.496693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3158d-8102-4e1d-814e-08e464b24db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:28.497364 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3158d-8102-4e1d-814e-08e464b24db4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:28.497650 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3158d-8102-4e1d-814e-08e464b24db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:28.497927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3158d-8102-4e1d-814e-08e464b24db4 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:28.499395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3158d-8102-4e1d-814e-08e464b24db4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:28.499708 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3158d-8102-4e1d-814e-08e464b24db4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:28.501192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3158d-8102-4e1d-814e-08e464b24db4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:28.516217 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 278/563] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:28.517803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ee5e7-b0e5-4a8f-a6ff-1dac4186eca1 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:28.518096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ee5e7-b0e5-4a8f-a6ff-1dac4186eca1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:28.518376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ee5e7-b0e5-4a8f-a6ff-1dac4186eca1 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:28.523947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 279/564] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:28.523947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ee5e7-b0e5-4a8f-a6ff-1dac4186eca1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:28.533427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411585ff-53ea-4701-b31c-2582d441cbf4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:28.571003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8112f-c5f8-43a0-b733-7698c8e582fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:28.572205 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8112f-c5f8-43a0-b733-7698c8e582fd None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:28.572664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8112f-c5f8-43a0-b733-7698c8e582fd None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:28.573100 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8112f-c5f8-43a0-b733-7698c8e582fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:28.581124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8112f-c5f8-43a0-b733-7698c8e582fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:28.582750 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8112f-c5f8-43a0-b733-7698c8e582fd None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:28.584872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:28.598068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-a3f8112f-c5f8-43a0-b733-7698c8e582fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 30 11:53:28.598068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:28.598068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:28.598068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:28.598068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:28.598068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:28.598068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:28.598068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:28.598068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:28.598068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:28.598068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:28.598068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:28.598068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:28.598068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:28.598068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:28.598068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:28.599094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:28.599094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:28.599094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:28.599094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:28.599094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:28.599094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:28.599094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:28.599094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:28.599094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:28.599094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:28.599094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:28.599094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:28.599094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:28.599094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:28.599094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:28.599094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:28.599094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:28.599094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:28.600058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:28.600058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:28.600058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:28.600058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:28.600058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:28.600058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:28.600058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:28.600058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:28.600058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 30 11:53:28.600058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:28.600058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 286/565] 10.222.0.41 () {56 vars in 1093 bytes} [Mon May 30 11:53:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:28.600058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8112f-c5f8-43a0-b733-7698c8e582fd None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:28.637635 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ee5e7-b0e5-4a8f-a6ff-1dac4186eca1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:28.675701 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fdfcfe-8f09-4349-afd6-0880f830bf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:28.676337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdfcfe-8f09-4349-afd6-0880f830bf3c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:28.676629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdfcfe-8f09-4349-afd6-0880f830bf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:28.676886 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdfcfe-8f09-4349-afd6-0880f830bf3c None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:28.677636 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fdfcfe-8f09-4349-afd6-0880f830bf3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:28.677950 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fdfcfe-8f09-4349-afd6-0880f830bf3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:28.679332 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fdfcfe-8f09-4349-afd6-0880f830bf3c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:28.688490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 280/566] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:53:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:28.689747 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddbc87-f69e-4120-8b6a-a3cd94d94e7b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:28.690041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddbc87-f69e-4120-8b6a-a3cd94d94e7b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:28.690322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddbc87-f69e-4120-8b6a-a3cd94d94e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:28.707437 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-bfddbc87-f69e-4120-8b6a-a3cd94d94e7b None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:28.708668 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bfddbc87-f69e-4120-8b6a-a3cd94d94e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:28.712222 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:28.717170 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8112f-c5f8-43a0-b733-7698c8e582fd None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:28.755889 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43257540-22c3-4455-8fe7-9f5b064b376a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:28.756837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43257540-22c3-4455-8fe7-9f5b064b376a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:28.757303 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43257540-22c3-4455-8fe7-9f5b064b376a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:28.757584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43257540-22c3-4455-8fe7-9f5b064b376a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:28.758450 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43257540-22c3-4455-8fe7-9f5b064b376a None admin] RBAC: Adding query filter params (role.id=dc57e0b7f67947e0b6b63c4ad0148358, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=83e5f980cdb74227bb31c7e7e5eab74b) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:28.758748 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43257540-22c3-4455-8fe7-9f5b064b376a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:28.760215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43257540-22c3-4455-8fe7-9f5b064b376a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:28.771872 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 287/567] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:53:28 2022] GET /identity/v3/role_assignments?user.id=83e5f980cdb74227bb31c7e7e5eab74b&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=dc57e0b7f67947e0b6b63c4ad0148358 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:28.771872 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43257540-22c3-4455-8fe7-9f5b064b376a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:28.792250 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 281/568] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:28.793393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddbc87-f69e-4120-8b6a-a3cd94d94e7b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:28.870039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:28.931040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddbc87-f69e-4120-8b6a-a3cd94d94e7b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:28.943401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43257540-22c3-4455-8fe7-9f5b064b376a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:28.970957 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9498dc2-842c-4de5-a1c6-795b8df71f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:28.972095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9498dc2-842c-4de5-a1c6-795b8df71f53 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:28.972569 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9498dc2-842c-4de5-a1c6-795b8df71f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:28.973045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9498dc2-842c-4de5-a1c6-795b8df71f53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:28.986179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9498dc2-842c-4de5-a1c6-795b8df71f53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:28.987763 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9498dc2-842c-4de5-a1c6-795b8df71f53 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:28.988226 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6118e2e-9c6e-43ea-b768-b7cd0a80b70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:28.989167 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6118e2e-9c6e-43ea-b768-b7cd0a80b70d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:28.989732 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6118e2e-9c6e-43ea-b768-b7cd0a80b70d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:28.990174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6118e2e-9c6e-43ea-b768-b7cd0a80b70d None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:28.991241 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6118e2e-9c6e-43ea-b768-b7cd0a80b70d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:28.991719 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6118e2e-9c6e-43ea-b768-b7cd0a80b70d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:28.993338 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6118e2e-9c6e-43ea-b768-b7cd0a80b70d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:29.007048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d9498dc2-842c-4de5-a1c6-795b8df71f53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:29.007048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:29.007048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:29.007048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:29.007048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:29.007048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:29.007048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:29.007048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:29.007048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:29.007048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:29.007048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:29.007048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:29.007048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:29.007048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:29.007048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:29.008171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:29.008171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:29.008171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:29.008171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:29.008171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:29.008171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:29.008171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:29.008171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:29.008171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:29.008171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:29.008171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:29.008171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:29.008171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:29.008171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:29.008171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:29.008171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:29.008171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:29.009105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:29.009105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:29.009105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:29.009105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:29.009105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 282/569] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:29.009623 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9498dc2-842c-4de5-a1c6-795b8df71f53 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:29.021405 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 288/570] 10.222.0.41 () {56 vars in 1133 bytes} [Mon May 30 11:53:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:29.022766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6118e2e-9c6e-43ea-b768-b7cd0a80b70d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:29.047735 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:29.114215 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9498dc2-842c-4de5-a1c6-795b8df71f53 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:29.115795 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:29.144114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6118e2e-9c6e-43ea-b768-b7cd0a80b70d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:29.151315 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a0474-5172-4c2a-8318-f1b5f8588a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:29.152153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a0474-5172-4c2a-8318-f1b5f8588a66 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:29.152438 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a0474-5172-4c2a-8318-f1b5f8588a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:29.152713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a0474-5172-4c2a-8318-f1b5f8588a66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:29.164615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a0474-5172-4c2a-8318-f1b5f8588a66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:29.172599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-be4a0474-5172-4c2a-8318-f1b5f8588a66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:29.172599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:29.172599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:29.172599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:29.172599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:29.172599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:29.172599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:29.172599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:29.172599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:29.172599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:29.172599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:29.172599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:29.172599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:29.172599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:29.172599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:29.172599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:29.173748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:29.173748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:29.173748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:29.173748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:29.173748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:29.173748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:29.173748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:29.173748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:29.173748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:29.173748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:29.173748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:29.173748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:29.173748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:29.173748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:29.173748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:29.173748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:29.174597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:29.174597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:29.174597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:29.174597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:29.174597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:29.174597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:29.174597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:29.174597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:29.174597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:29.174597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:29.174597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:29.174597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:29.174597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 283/571] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:29.175280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a0474-5172-4c2a-8318-f1b5f8588a66 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:29.190344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d63a8-2e8c-4a23-b931-1744b43bd69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:29.191217 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d63a8-2e8c-4a23-b931-1744b43bd69b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:29.191681 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d63a8-2e8c-4a23-b931-1744b43bd69b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:29.192035 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d63a8-2e8c-4a23-b931-1744b43bd69b None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:29.192773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d63a8-2e8c-4a23-b931-1744b43bd69b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:29.193086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d63a8-2e8c-4a23-b931-1744b43bd69b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:29.194455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d63a8-2e8c-4a23-b931-1744b43bd69b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:29.207983 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 289/572] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:29.207983 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b08576-5ed2-408c-a6c7-aac1c611d193 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:29.208187 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b08576-5ed2-408c-a6c7-aac1c611d193 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:29.208499 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b08576-5ed2-408c-a6c7-aac1c611d193 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:29.209930 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 290/573] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:29.210639 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b08576-5ed2-408c-a6c7-aac1c611d193 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:29.282234 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a0474-5172-4c2a-8318-f1b5f8588a66 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:29.301296 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:29.316880 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f85aa-2797-45b6-a9be-96693bdac054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:29.317676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f85aa-2797-45b6-a9be-96693bdac054 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:29.317959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f85aa-2797-45b6-a9be-96693bdac054 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:29.318234 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f85aa-2797-45b6-a9be-96693bdac054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:29.327307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b08576-5ed2-408c-a6c7-aac1c611d193 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:29.331754 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f85aa-2797-45b6-a9be-96693bdac054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:29.333249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f85aa-2797-45b6-a9be-96693bdac054 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:29.352445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-bc0f85aa-2797-45b6-a9be-96693bdac054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:29.352445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:29.352445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:29.352445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:29.352445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:29.352445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:29.352445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:29.352445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:29.352445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:29.352445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:29.352445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:29.352445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:29.352445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:29.352445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:29.352445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:29.353356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:29.353356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:29.353356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:29.353356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:29.353356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:29.353356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:29.353356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:29.353356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:29.353356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:29.353356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:29.353356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:29.353356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:29.353356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:29.353356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:29.353356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:29.353356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:29.353356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:29.354227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:29.354227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:29.354227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:29.354227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:29.354227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 284/574] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:29.355027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f85aa-2797-45b6-a9be-96693bdac054 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:29.366975 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a19404-48f7-4358-877c-0109109b0e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:29.367654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a19404-48f7-4358-877c-0109109b0e5e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:29.367975 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a19404-48f7-4358-877c-0109109b0e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:29.368264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a19404-48f7-4358-877c-0109109b0e5e None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:29.369019 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a19404-48f7-4358-877c-0109109b0e5e None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:29.369337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a19404-48f7-4358-877c-0109109b0e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:29.370688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a19404-48f7-4358-877c-0109109b0e5e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:29.374107 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:29.380754 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 291/575] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:53:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:29.382387 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba7026-c56f-4955-b93a-aabbb7dcac11 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:29.382746 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba7026-c56f-4955-b93a-aabbb7dcac11 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:29.383095 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba7026-c56f-4955-b93a-aabbb7dcac11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:29.400543 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-33ba7026-c56f-4955-b93a-aabbb7dcac11 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:29.401828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-33ba7026-c56f-4955-b93a-aabbb7dcac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:29.469972 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f85aa-2797-45b6-a9be-96693bdac054 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:29.472642 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 292/576] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:29.473667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba7026-c56f-4955-b93a-aabbb7dcac11 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:29.512014 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e0f83-d932-47ee-b33f-a17552d0f288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:29.513200 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e0f83-d932-47ee-b33f-a17552d0f288 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:29.513712 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e0f83-d932-47ee-b33f-a17552d0f288 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:29.514214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e0f83-d932-47ee-b33f-a17552d0f288 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:29.522858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e0f83-d932-47ee-b33f-a17552d0f288 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:29.524593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e0f83-d932-47ee-b33f-a17552d0f288 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:29.540691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d00e0f83-d932-47ee-b33f-a17552d0f288 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 30 11:53:29.540691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:29.540691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:29.540691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:29.540691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:29.540691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:29.540691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:29.540691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:29.540691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:29.540691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:29.540691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:29.540691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:29.540691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:29.540691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:29.540691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:29.540691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:29.541841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:29.541841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:29.541841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:29.541841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:29.541841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:29.541841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:29.541841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:29.541841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:29.541841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:29.541841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:29.541841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:29.541841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:29.541841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:29.541841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:29.541841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:29.541841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:29.541841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:29.541841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:29.543054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:29.543054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:29.543054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:29.543054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:29.543054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:29.543054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:29.543054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:29.543054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:29.543054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 30 11:53:29.543054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:29.544988 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 285/577] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:29.545830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e0f83-d932-47ee-b33f-a17552d0f288 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:29.559949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:29.594068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba7026-c56f-4955-b93a-aabbb7dcac11 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:29.629864 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:29.630903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca5ef1-d740-4b3a-bb0f-736dfd93ae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:29.631643 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca5ef1-d740-4b3a-bb0f-736dfd93ae3f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:29.632149 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca5ef1-d740-4b3a-bb0f-736dfd93ae3f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:29.632471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca5ef1-d740-4b3a-bb0f-736dfd93ae3f None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:29.633302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca5ef1-d740-4b3a-bb0f-736dfd93ae3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:29.633640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca5ef1-d740-4b3a-bb0f-736dfd93ae3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:29.634991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca5ef1-d740-4b3a-bb0f-736dfd93ae3f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:29.646967 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 293/578] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:29.651984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca5ef1-d740-4b3a-bb0f-736dfd93ae3f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:29.657283 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e0f83-d932-47ee-b33f-a17552d0f288 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:29.692931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241cdc4-a960-47aa-813d-e33fcfa3ac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:29.693717 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241cdc4-a960-47aa-813d-e33fcfa3ac4b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:29.693992 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241cdc4-a960-47aa-813d-e33fcfa3ac4b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:29.694278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241cdc4-a960-47aa-813d-e33fcfa3ac4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:29.704791 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241cdc4-a960-47aa-813d-e33fcfa3ac4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:29.706256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241cdc4-a960-47aa-813d-e33fcfa3ac4b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:29.724255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-1241cdc4-a960-47aa-813d-e33fcfa3ac4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:29.724255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:29.724255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:29.724255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:29.724255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:29.724255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:29.724255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:29.724255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:29.724255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:29.724255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:29.724255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:29.724255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:29.724255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:29.724255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:29.724255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:29.725333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:29.725333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:29.725333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:29.725333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:29.725333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:29.725333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:29.725333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:29.725333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:29.725333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:29.725333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:29.725333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:29.725333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:29.725333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:29.725333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:29.725333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:29.725333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:29.725333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:29.726231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:29.726231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:29.726231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:29.726231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:29.726231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 286/579] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:29.726231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241cdc4-a960-47aa-813d-e33fcfa3ac4b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:29.764662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca5ef1-d740-4b3a-bb0f-736dfd93ae3f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:29.797689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:29.803947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa034c92-2c89-475c-bdfb-df21306a5dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:29.804744 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa034c92-2c89-475c-bdfb-df21306a5dfc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:29.805032 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa034c92-2c89-475c-bdfb-df21306a5dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:29.805310 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa034c92-2c89-475c-bdfb-df21306a5dfc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:29.816454 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa034c92-2c89-475c-bdfb-df21306a5dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:29.824202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-aa034c92-2c89-475c-bdfb-df21306a5dfc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:29.824202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:29.824202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:29.824202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:29.824202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:29.824202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:29.824202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:29.824202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:29.824202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:29.824202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:29.824202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:29.824202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:29.824202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:29.824202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:29.824202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:29.824202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:29.825159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:29.825159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:29.825159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:29.825159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:29.825159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:29.825159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:29.825159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:29.825159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:29.825159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:29.825159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:29.825159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:29.825159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:29.825159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:29.825159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:29.825159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:29.825159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:29.825984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:29.825984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:29.825984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:29.825984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:29.825984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:29.825984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:29.825984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:29.825984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:29.825984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:29.825984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:29.825984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:29.825984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:29.825984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 294/580] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:29.826931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa034c92-2c89-475c-bdfb-df21306a5dfc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:29.855030 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241cdc4-a960-47aa-813d-e33fcfa3ac4b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:29.886122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:29.898046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469d7e3-042f-46f9-84c3-434a6acde0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:29.898748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469d7e3-042f-46f9-84c3-434a6acde0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:29.899034 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469d7e3-042f-46f9-84c3-434a6acde0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:29.899313 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469d7e3-042f-46f9-84c3-434a6acde0a8 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:29.900224 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469d7e3-042f-46f9-84c3-434a6acde0a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:29.900541 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469d7e3-042f-46f9-84c3-434a6acde0a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:29.902043 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469d7e3-042f-46f9-84c3-434a6acde0a8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:29.926657 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 287/581] 10.222.0.41 () {56 vars in 1137 bytes} [Mon May 30 11:53:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:29.926657 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469d7e3-042f-46f9-84c3-434a6acde0a8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:29.941952 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa034c92-2c89-475c-bdfb-df21306a5dfc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:29.976844 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae600572-430d-4038-9a37-c95b6c4df22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:29.977568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae600572-430d-4038-9a37-c95b6c4df22d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:29.977852 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae600572-430d-4038-9a37-c95b6c4df22d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:29.978123 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae600572-430d-4038-9a37-c95b6c4df22d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:29.986241 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae600572-430d-4038-9a37-c95b6c4df22d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:29.987715 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae600572-430d-4038-9a37-c95b6c4df22d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:30.004177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ae600572-430d-4038-9a37-c95b6c4df22d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:30.004177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:30.004177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:30.004177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:30.004177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:30.004177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:30.004177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:30.004177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:30.004177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:30.004177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:30.004177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:30.004177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:30.004177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:30.004177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:30.004177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:30.005075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:30.005075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:30.005075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:30.005075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:30.005075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:30.005075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:30.005075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:30.005075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:30.005075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:30.005075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:30.005075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:30.005075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:30.005075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:30.005075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:30.005075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:30.005075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:30.005075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:30.005982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:30.005982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:30.005982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:30.005982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:30.005982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:30.005982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:30.005982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:30.005982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:30.005982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 295/582] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:30.006472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae600572-430d-4038-9a37-c95b6c4df22d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:30.053071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469d7e3-042f-46f9-84c3-434a6acde0a8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:30.068485 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:30.095107 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f933e-3f9c-4f95-a30c-89e1107f4470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:30.095773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f933e-3f9c-4f95-a30c-89e1107f4470 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:30.096175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f933e-3f9c-4f95-a30c-89e1107f4470 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:30.096353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f933e-3f9c-4f95-a30c-89e1107f4470 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:30.097076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f933e-3f9c-4f95-a30c-89e1107f4470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:30.097386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f933e-3f9c-4f95-a30c-89e1107f4470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:30.098751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f933e-3f9c-4f95-a30c-89e1107f4470 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:30.115300 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 288/583] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:30.115300 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f933e-3f9c-4f95-a30c-89e1107f4470 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:30.123015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae600572-430d-4038-9a37-c95b6c4df22d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:30.160423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8c25c-20af-47d2-8e17-d393fbe67fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:30.161154 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8c25c-20af-47d2-8e17-d393fbe67fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:30.161444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8c25c-20af-47d2-8e17-d393fbe67fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:30.161723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8c25c-20af-47d2-8e17-d393fbe67fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:30.162476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8c25c-20af-47d2-8e17-d393fbe67fc8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:30.162785 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8c25c-20af-47d2-8e17-d393fbe67fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:30.163106 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:30.164177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8c25c-20af-47d2-8e17-d393fbe67fc8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:30.177637 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 296/584] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:53:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:30.178500 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8c25c-20af-47d2-8e17-d393fbe67fc8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:30.224036 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f933e-3f9c-4f95-a30c-89e1107f4470 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:30.262055 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6ee96-7747-4de7-86c7-d5c80af51991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:30.263054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6ee96-7747-4de7-86c7-d5c80af51991 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:30.263340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6ee96-7747-4de7-86c7-d5c80af51991 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:30.263615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6ee96-7747-4de7-86c7-d5c80af51991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:30.276575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6ee96-7747-4de7-86c7-d5c80af51991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:30.278017 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6ee96-7747-4de7-86c7-d5c80af51991 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:30.284432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8c25c-20af-47d2-8e17-d393fbe67fc8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:30.298425 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:30.298807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d9e6ee96-7747-4de7-86c7-d5c80af51991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:30.298807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:30.298807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:30.298807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:30.298807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:30.298807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:30.298807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:30.298807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:30.298807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:30.298807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:30.298807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:30.298807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:30.298807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:30.298807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:30.298807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:30.299683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:30.299683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:30.299683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:30.299683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:30.299683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:30.299683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:30.299683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:30.299683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:30.299683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:30.299683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:30.299683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:30.299683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:30.299683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:30.299683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:30.299683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:30.299683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:30.299683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:30.300633 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:30.300633 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:30.300633 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:30.300633 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:30.300633 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 289/585] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:30.300930 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6ee96-7747-4de7-86c7-d5c80af51991 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:30.326439 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1def65-c63c-4470-b761-0d4af4e9207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:30.327649 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1def65-c63c-4470-b761-0d4af4e9207b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:30.327960 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1def65-c63c-4470-b761-0d4af4e9207b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:30.328236 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1def65-c63c-4470-b761-0d4af4e9207b None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:30.329034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1def65-c63c-4470-b761-0d4af4e9207b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:30.329346 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1def65-c63c-4470-b761-0d4af4e9207b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:30.330766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1def65-c63c-4470-b761-0d4af4e9207b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:30.344648 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 297/586] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:30.345454 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1def65-c63c-4470-b761-0d4af4e9207b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:30.409479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:30.415990 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6ee96-7747-4de7-86c7-d5c80af51991 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:30.452565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca8cb1-947e-4dd4-a94a-aaa6c72c1353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:30.453361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca8cb1-947e-4dd4-a94a-aaa6c72c1353 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:30.453648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca8cb1-947e-4dd4-a94a-aaa6c72c1353 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:30.453926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca8cb1-947e-4dd4-a94a-aaa6c72c1353 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:30.461772 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1def65-c63c-4470-b761-0d4af4e9207b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:30.462238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca8cb1-947e-4dd4-a94a-aaa6c72c1353 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:30.463237 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca8cb1-947e-4dd4-a94a-aaa6c72c1353 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:30.479118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-caca8cb1-947e-4dd4-a94a-aaa6c72c1353 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 30 11:53:30.479118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:30.479118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:30.479118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:30.479118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:30.479118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:30.479118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:30.479118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:30.479118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:30.479118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:30.479118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:30.479118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:30.479118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:30.479118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:30.479118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:30.479118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:30.480133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:30.480133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:30.480133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:30.480133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:30.480133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:30.480133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:30.480133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:30.480133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:30.480133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:30.480133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:30.480133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:30.480133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:30.480133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:30.480133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:30.480133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:30.480133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:30.480133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:30.480133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:30.481071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:30.481071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:30.481071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:30.481071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:30.481071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:30.481071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:30.481071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:30.481071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:30.481071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 30 11:53:30.481071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:30.481071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 290/587] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:30.481654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca8cb1-947e-4dd4-a94a-aaa6c72c1353 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:30.506546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d70abd-6c4d-4a58-b26e-5054f53216fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:30.507344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d70abd-6c4d-4a58-b26e-5054f53216fc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:30.507630 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d70abd-6c4d-4a58-b26e-5054f53216fc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:30.507940 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d70abd-6c4d-4a58-b26e-5054f53216fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:30.519451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d70abd-6c4d-4a58-b26e-5054f53216fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:30.520928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d70abd-6c4d-4a58-b26e-5054f53216fc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:30.539125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-21d70abd-6c4d-4a58-b26e-5054f53216fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:30.539125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:30.539125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:30.539125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:30.539125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:30.539125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:30.539125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:30.539125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:30.539125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:30.539125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:30.539125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:30.539125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:30.539125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:30.539125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:30.539125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:30.540071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:30.540071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:30.540071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:30.540071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:30.540071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:30.540071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:30.540071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:30.540071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:30.540071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:30.540071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:30.540071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:30.540071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:30.540071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:30.540071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:30.540071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:30.540071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:30.540071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:30.540951 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:30.540951 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:30.540951 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:30.540951 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:30.540951 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 298/588] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:30.541237 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d70abd-6c4d-4a58-b26e-5054f53216fc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:30.580940 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:30.591426 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca8cb1-947e-4dd4-a94a-aaa6c72c1353 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:30.629688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a19756-f4ef-4adc-9cfa-7225488513e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:30.630361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a19756-f4ef-4adc-9cfa-7225488513e0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:30.630649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a19756-f4ef-4adc-9cfa-7225488513e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:30.630926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a19756-f4ef-4adc-9cfa-7225488513e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:30.631653 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a19756-f4ef-4adc-9cfa-7225488513e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:30.631997 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a19756-f4ef-4adc-9cfa-7225488513e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:30.633372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a19756-f4ef-4adc-9cfa-7225488513e0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:30.646712 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 291/589] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:30.647850 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a19756-f4ef-4adc-9cfa-7225488513e0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:30.664879 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d70abd-6c4d-4a58-b26e-5054f53216fc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:30.666406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:30.708603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835c614-82c1-45c7-b323-eb03c9154e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:30.709529 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835c614-82c1-45c7-b323-eb03c9154e51 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:30.709826 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835c614-82c1-45c7-b323-eb03c9154e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:30.710121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835c614-82c1-45c7-b323-eb03c9154e51 None admin] PATH_INFO: `/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/bb3820a613744c15b840681fe6b6e808/roles/dc57e0b7f67947e0b6b63c4ad0148358` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:30.727234 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835c614-82c1-45c7-b323-eb03c9154e51 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e8426fd0e01433b8aa3a3797c687e03, user_id=bb3820a613744c15b840681fe6b6e808, role_id=dc57e0b7f67947e0b6b63c4ad0148358)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:30.728746 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835c614-82c1-45c7-b323-eb03c9154e51 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:30.744691 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 299/590] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:53:30 2022] PUT /identity/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/bb3820a613744c15b840681fe6b6e808/roles/dc57e0b7f67947e0b6b63c4ad0148358 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:53:30.745793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835c614-82c1-45c7-b323-eb03c9154e51 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:30.791300 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a19756-f4ef-4adc-9cfa-7225488513e0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:30.845435 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656c12a-096a-49a4-b88a-a02da54bbbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:30.846139 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656c12a-096a-49a4-b88a-a02da54bbbdd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:30.846418 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656c12a-096a-49a4-b88a-a02da54bbbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:30.846712 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656c12a-096a-49a4-b88a-a02da54bbbdd None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:30.847566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656c12a-096a-49a4-b88a-a02da54bbbdd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:30.847909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656c12a-096a-49a4-b88a-a02da54bbbdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:30.849490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656c12a-096a-49a4-b88a-a02da54bbbdd None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:30.855613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:30.872313 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 292/591] 10.222.0.41 () {56 vars in 1137 bytes} [Mon May 30 11:53:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:30.873238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656c12a-096a-49a4-b88a-a02da54bbbdd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:30.892460 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835c614-82c1-45c7-b323-eb03c9154e51 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:30.944380 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b83e2-59da-4666-951e-4d8784f5533d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:30.947062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b83e2-59da-4666-951e-4d8784f5533d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:30.947520 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b83e2-59da-4666-951e-4d8784f5533d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:30.947988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b83e2-59da-4666-951e-4d8784f5533d None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:30.949177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b83e2-59da-4666-951e-4d8784f5533d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:30.950062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b83e2-59da-4666-951e-4d8784f5533d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:30.951972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b83e2-59da-4666-951e-4d8784f5533d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:30.967038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:30.970495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 300/592] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:30.970495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b83e2-59da-4666-951e-4d8784f5533d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:31.001870 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656c12a-096a-49a4-b88a-a02da54bbbdd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:31.049855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8a040-997f-4d21-a241-5bfe8372bdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:31.052206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8a040-997f-4d21-a241-5bfe8372bdd7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:31.052494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8a040-997f-4d21-a241-5bfe8372bdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:31.052776 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8a040-997f-4d21-a241-5bfe8372bdd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:31.061736 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8a040-997f-4d21-a241-5bfe8372bdd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:31.064409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8a040-997f-4d21-a241-5bfe8372bdd7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:31.079863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-abb8a040-997f-4d21-a241-5bfe8372bdd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:31.079863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:31.079863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:31.079863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:31.079863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:31.079863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:31.079863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:31.079863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:31.079863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:31.079863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:31.079863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:31.079863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:31.079863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:31.079863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:31.079863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:31.080773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:31.080773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:31.080773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:31.080773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:31.080773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:31.080773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:31.080773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:31.080773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:31.080773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:31.080773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:31.080773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:31.080773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:31.080773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:31.080773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:31.080773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:31.080773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:31.080773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:31.081661 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:31.081661 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:31.081661 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:31.081661 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:31.081661 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:31.081661 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:31.081661 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:31.081661 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:31.081661 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 293/593] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:31.082141 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8a040-997f-4d21-a241-5bfe8372bdd7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:31.088107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b83e2-59da-4666-951e-4d8784f5533d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:31.124049 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf43fc-570f-48ca-bb9b-29abfad40bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:31.125093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf43fc-570f-48ca-bb9b-29abfad40bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:31.125389 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf43fc-570f-48ca-bb9b-29abfad40bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:31.125671 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf43fc-570f-48ca-bb9b-29abfad40bf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:31.128823 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:31.138162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf43fc-570f-48ca-bb9b-29abfad40bf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:31.140006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf43fc-570f-48ca-bb9b-29abfad40bf3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:31.158246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-fbbf43fc-570f-48ca-bb9b-29abfad40bf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:31.158246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:31.158246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:31.158246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:31.158246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:31.158246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:31.158246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:31.158246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:31.158246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:31.158246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:31.158246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:31.158246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:31.158246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:31.158246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:31.158246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:31.159151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:31.159151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:31.159151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:31.159151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:31.159151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:31.159151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:31.159151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:31.159151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:31.159151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:31.159151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:31.159151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:31.159151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:31.159151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:31.159151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:31.159151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:31.159151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:31.159151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:31.160385 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:31.160385 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:31.160385 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:31.160385 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:31.160385 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 301/594] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:31.161033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d145a38-3038-4c2a-861f-cb546ab250ad None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:31.161251 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d145a38-3038-4c2a-861f-cb546ab250ad None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:31.161536 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d145a38-3038-4c2a-861f-cb546ab250ad None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:31.167807 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 302/595] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:31.167807 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d145a38-3038-4c2a-861f-cb546ab250ad None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:31.199811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8a040-997f-4d21-a241-5bfe8372bdd7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:31.234962 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f6dfa-8771-4c42-8f2b-2d4ad683359a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:31.235763 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f6dfa-8771-4c42-8f2b-2d4ad683359a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:31.236072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f6dfa-8771-4c42-8f2b-2d4ad683359a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:31.236352 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f6dfa-8771-4c42-8f2b-2d4ad683359a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:31.239044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:31.244826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f6dfa-8771-4c42-8f2b-2d4ad683359a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:31.246771 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f6dfa-8771-4c42-8f2b-2d4ad683359a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:31.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-991f6dfa-8771-4c42-8f2b-2d4ad683359a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 30 11:53:31.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:31.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:31.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:31.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:31.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:31.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:31.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:31.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:31.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:31.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:31.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:31.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:31.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:31.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:31.262376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:31.263353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:31.263353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:31.263353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:31.263353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:31.263353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:31.263353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:31.263353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:31.263353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:31.263353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:31.263353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:31.263353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:31.263353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:31.263353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:31.263353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:31.263353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:31.263353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:31.263353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:31.263353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:31.264928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:31.264928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:31.264928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:31.264928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:31.264928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:31.264928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:31.264928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:31.264928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:31.264928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 30 11:53:31.264928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:31.264928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 294/596] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:31.266294 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f6dfa-8771-4c42-8f2b-2d4ad683359a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:31.282116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d145a38-3038-4c2a-861f-cb546ab250ad None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:31.318989 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83696869-fc1b-4dae-9826-c1a85652071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:31.319584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83696869-fc1b-4dae-9826-c1a85652071f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:31.319892 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83696869-fc1b-4dae-9826-c1a85652071f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:31.320173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83696869-fc1b-4dae-9826-c1a85652071f None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:31.322045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83696869-fc1b-4dae-9826-c1a85652071f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:31.322045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83696869-fc1b-4dae-9826-c1a85652071f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:31.323142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83696869-fc1b-4dae-9826-c1a85652071f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:31.340971 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 303/597] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:31.342215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a831cf4-3f43-4d11-9cef-a05d37fe0d74 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:31.342561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a831cf4-3f43-4d11-9cef-a05d37fe0d74 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:31.342841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a831cf4-3f43-4d11-9cef-a05d37fe0d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:31.360688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6a831cf4-3f43-4d11-9cef-a05d37fe0d74 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:31.361903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6a831cf4-3f43-4d11-9cef-a05d37fe0d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:31.376041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f6dfa-8771-4c42-8f2b-2d4ad683359a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:31.411268 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57db141-a802-4973-a467-9919239b4d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:31.411894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:31.412274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57db141-a802-4973-a467-9919239b4d97 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:31.412569 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57db141-a802-4973-a467-9919239b4d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:31.413121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57db141-a802-4973-a467-9919239b4d97 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:31.413620 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57db141-a802-4973-a467-9919239b4d97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:31.413863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57db141-a802-4973-a467-9919239b4d97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:31.415300 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57db141-a802-4973-a467-9919239b4d97 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:31.428499 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 295/598] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:31.429724 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57db141-a802-4973-a467-9919239b4d97 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:31.444366 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 304/599] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:31.456782 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a831cf4-3f43-4d11-9cef-a05d37fe0d74 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:31.494604 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:31.541862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57db141-a802-4973-a467-9919239b4d97 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:31.567165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a831cf4-3f43-4d11-9cef-a05d37fe0d74 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:31.578029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97d26d-b573-4f33-9a6f-351d32608d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:31.578682 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97d26d-b573-4f33-9a6f-351d32608d05 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:31.578970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97d26d-b573-4f33-9a6f-351d32608d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:31.579248 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97d26d-b573-4f33-9a6f-351d32608d05 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:31.580123 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97d26d-b573-4f33-9a6f-351d32608d05 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:31.580678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97d26d-b573-4f33-9a6f-351d32608d05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:31.581864 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97d26d-b573-4f33-9a6f-351d32608d05 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:31.600112 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 296/600] 10.222.0.41 () {56 vars in 1139 bytes} [Mon May 30 11:53:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:31.600954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97d26d-b573-4f33-9a6f-351d32608d05 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:31.610312 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b8d93-f575-4ab4-9dd4-f4f83d831645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:31.611210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b8d93-f575-4ab4-9dd4-f4f83d831645 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:31.611490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b8d93-f575-4ab4-9dd4-f4f83d831645 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:31.611762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b8d93-f575-4ab4-9dd4-f4f83d831645 None admin] PATH_INFO: `/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/2ffa6d38c01f4820a705c06991654bb4/roles/dc57e0b7f67947e0b6b63c4ad0148358` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:31.629029 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b8d93-f575-4ab4-9dd4-f4f83d831645 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e8426fd0e01433b8aa3a3797c687e03, user_id=2ffa6d38c01f4820a705c06991654bb4, role_id=dc57e0b7f67947e0b6b63c4ad0148358)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:31.630561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b8d93-f575-4ab4-9dd4-f4f83d831645 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:31.646633 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 305/601] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:53:31 2022] PUT /identity/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/2ffa6d38c01f4820a705c06991654bb4/roles/dc57e0b7f67947e0b6b63c4ad0148358 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:53:31.648773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b8d93-f575-4ab4-9dd4-f4f83d831645 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:31.689907 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:31.742224 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97d26d-b573-4f33-9a6f-351d32608d05 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:31.759603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:31.787508 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df3e8a-468e-4ddd-b0c1-0fd48d3ef5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:31.788503 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df3e8a-468e-4ddd-b0c1-0fd48d3ef5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:31.788839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df3e8a-468e-4ddd-b0c1-0fd48d3ef5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:31.789122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df3e8a-468e-4ddd-b0c1-0fd48d3ef5c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:31.797302 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df3e8a-468e-4ddd-b0c1-0fd48d3ef5c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:31.798295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b8d93-f575-4ab4-9dd4-f4f83d831645 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:31.798790 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df3e8a-468e-4ddd-b0c1-0fd48d3ef5c8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:31.815062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-e6df3e8a-468e-4ddd-b0c1-0fd48d3ef5c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:31.815062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:31.815062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:31.815062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:31.815062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:31.815062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:31.815062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:31.815062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:31.815062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:31.815062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:31.815062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:31.815062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:31.815062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:31.815062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:31.815062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:31.816058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:31.816058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:31.816058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:31.816058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:31.816058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:31.816058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:31.816058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:31.816058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:31.816058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:31.816058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:31.816058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:31.816058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:31.816058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:31.816058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:31.816058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:31.816058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:31.816058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:31.816912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:31.816912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:31.816912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:31.816912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:31.816912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:31.816912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:31.816912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:31.816912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:31.820235 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 297/602] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:31.821281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df3e8a-468e-4ddd-b0c1-0fd48d3ef5c8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:31.848483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed1ad9-f347-41fb-a239-ba087e9ad7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:31.849924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed1ad9-f347-41fb-a239-ba087e9ad7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:31.850411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed1ad9-f347-41fb-a239-ba087e9ad7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:31.851118 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed1ad9-f347-41fb-a239-ba087e9ad7d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:31.866144 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed1ad9-f347-41fb-a239-ba087e9ad7d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:31.874876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-87ed1ad9-f347-41fb-a239-ba087e9ad7d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:31.874876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:31.874876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:31.874876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:31.874876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:31.874876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:31.874876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:31.874876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:31.874876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:31.874876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:31.874876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:31.874876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:31.874876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:31.874876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:31.874876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:31.874876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:31.875911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:31.875911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:31.875911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:31.875911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:31.875911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:31.875911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:31.875911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:31.875911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:31.875911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:31.875911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:31.875911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:31.875911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:31.875911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:31.875911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:31.875911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:31.875911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:31.876964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:31.876964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:31.876964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:31.876964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:31.876964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:31.876964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:31.876964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:31.876964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:31.876964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:31.876964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:31.876964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:31.876964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:31.876964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 306/603] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:31.877795 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed1ad9-f347-41fb-a239-ba087e9ad7d8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:31.960581 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df3e8a-468e-4ddd-b0c1-0fd48d3ef5c8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:31.984458 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:32.003443 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6000cc-2622-4836-b270-bfa2cb4cd162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:32.004431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6000cc-2622-4836-b270-bfa2cb4cd162 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:32.004726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6000cc-2622-4836-b270-bfa2cb4cd162 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:32.004828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed1ad9-f347-41fb-a239-ba087e9ad7d8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:32.005011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6000cc-2622-4836-b270-bfa2cb4cd162 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:32.019248 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6000cc-2622-4836-b270-bfa2cb4cd162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:32.021562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6000cc-2622-4836-b270-bfa2cb4cd162 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:32.043439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-fb6000cc-2622-4836-b270-bfa2cb4cd162 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:32.043439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:32.043439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:32.043439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:32.043439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:32.043439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:32.043439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:32.043439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:32.043439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:32.043439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:32.043439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:32.043439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:32.043439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:32.043439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:32.043439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:32.044384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:32.044384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:32.044384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:32.044384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:32.044384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:32.044384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:32.044384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:32.044384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:32.044384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:32.044384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:32.044384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:32.044384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:32.044384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:32.044384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:32.044384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:32.044384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:32.044384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:32.045249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:32.045249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:32.045249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:32.045249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:32.049195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac728a-920f-478d-b6fd-9521c1e10cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:32.049897 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 298/604] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:32.050553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac728a-920f-478d-b6fd-9521c1e10cdf None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:32.050660 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6000cc-2622-4836-b270-bfa2cb4cd162 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:32.051120 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac728a-920f-478d-b6fd-9521c1e10cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:32.051597 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac728a-920f-478d-b6fd-9521c1e10cdf None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:32.052638 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac728a-920f-478d-b6fd-9521c1e10cdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:32.053145 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac728a-920f-478d-b6fd-9521c1e10cdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:32.054780 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac728a-920f-478d-b6fd-9521c1e10cdf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:32.072882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 307/605] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:32.072882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac728a-920f-478d-b6fd-9521c1e10cdf None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:32.084707 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:32.175521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac728a-920f-478d-b6fd-9521c1e10cdf None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:32.191721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6000cc-2622-4836-b270-bfa2cb4cd162 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:32.222391 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af012b03-3136-456e-bb60-36ad6943f5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:32.223128 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af012b03-3136-456e-bb60-36ad6943f5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:32.223327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af012b03-3136-456e-bb60-36ad6943f5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:32.223602 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af012b03-3136-456e-bb60-36ad6943f5c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:32.224369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af012b03-3136-456e-bb60-36ad6943f5c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:32.224677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af012b03-3136-456e-bb60-36ad6943f5c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:32.226038 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af012b03-3136-456e-bb60-36ad6943f5c5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:32.239477 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 308/606] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:32.240365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af012b03-3136-456e-bb60-36ad6943f5c5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:32.244824 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e265d37-b6c9-458f-b4ec-0e6fd07cd105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:32.245506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e265d37-b6c9-458f-b4ec-0e6fd07cd105 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:32.245793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e265d37-b6c9-458f-b4ec-0e6fd07cd105 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:32.246071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e265d37-b6c9-458f-b4ec-0e6fd07cd105 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:32.247076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e265d37-b6c9-458f-b4ec-0e6fd07cd105 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:32.247388 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e265d37-b6c9-458f-b4ec-0e6fd07cd105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:32.248895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e265d37-b6c9-458f-b4ec-0e6fd07cd105 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:32.253287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:32.261581 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 299/607] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:53:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:32.262728 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e265d37-b6c9-458f-b4ec-0e6fd07cd105 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:32.357112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af012b03-3136-456e-bb60-36ad6943f5c5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:32.375557 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:32.392335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e265d37-b6c9-458f-b4ec-0e6fd07cd105 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:32.411259 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac93b2d-6924-4b8a-89ea-db479d1775dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:32.412495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac93b2d-6924-4b8a-89ea-db479d1775dc None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:32.412933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac93b2d-6924-4b8a-89ea-db479d1775dc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:32.413362 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac93b2d-6924-4b8a-89ea-db479d1775dc None admin] PATH_INFO: `/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/ca1110aeeded4ab0b6fa2aedfa8740c3/roles/dc57e0b7f67947e0b6b63c4ad0148358` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:32.429011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69b38b-16c0-4e3c-8ab7-5f6296157810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:32.429944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69b38b-16c0-4e3c-8ab7-5f6296157810 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:32.430235 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69b38b-16c0-4e3c-8ab7-5f6296157810 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:32.430519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69b38b-16c0-4e3c-8ab7-5f6296157810 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:32.434719 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac93b2d-6924-4b8a-89ea-db479d1775dc None admin] RBAC: Authorizing `identity:create_grant(project_id=1e8426fd0e01433b8aa3a3797c687e03, user_id=ca1110aeeded4ab0b6fa2aedfa8740c3, role_id=dc57e0b7f67947e0b6b63c4ad0148358)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:32.436651 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac93b2d-6924-4b8a-89ea-db479d1775dc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:32.438200 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69b38b-16c0-4e3c-8ab7-5f6296157810 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:32.439741 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69b38b-16c0-4e3c-8ab7-5f6296157810 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:32.453981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 309/608] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:53:32 2022] PUT /identity/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/ca1110aeeded4ab0b6fa2aedfa8740c3/roles/dc57e0b7f67947e0b6b63c4ad0148358 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:53:32.455209 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac93b2d-6924-4b8a-89ea-db479d1775dc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:32.456456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-1a69b38b-16c0-4e3c-8ab7-5f6296157810 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:32.456456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:32.456456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:32.456456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:32.456456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:32.456456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:32.456456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:32.456456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:32.456456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:32.456456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:32.456456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:32.456456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:32.456456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:32.456456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:32.456456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:32.457830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:32.457830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:32.457830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:32.457830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:32.457830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:32.457830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:32.457830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:32.457830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:32.457830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:32.457830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:32.457830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:32.457830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:32.457830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:32.457830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:32.457830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:32.457830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:32.457830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:32.459058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:32.459058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:32.459058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:32.459058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:32.459058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:32.459058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:32.459058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:32.459058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:32.462544 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 300/609] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:32.464413 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69b38b-16c0-4e3c-8ab7-5f6296157810 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:32.551343 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:32.603030 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69b38b-16c0-4e3c-8ab7-5f6296157810 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:32.604290 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac93b2d-6924-4b8a-89ea-db479d1775dc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:32.664781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de057b-f679-4c59-8f0c-0c67261e0fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:32.666572 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b6b24-1cbd-4954-90f8-ff6d64dee438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:32.667250 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b6b24-1cbd-4954-90f8-ff6d64dee438 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:32.667534 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b6b24-1cbd-4954-90f8-ff6d64dee438 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:32.667830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b6b24-1cbd-4954-90f8-ff6d64dee438 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:32.668641 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b6b24-1cbd-4954-90f8-ff6d64dee438 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:32.668955 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b6b24-1cbd-4954-90f8-ff6d64dee438 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:32.670457 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b6b24-1cbd-4954-90f8-ff6d64dee438 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:32.673390 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de057b-f679-4c59-8f0c-0c67261e0fdd None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:32.673685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de057b-f679-4c59-8f0c-0c67261e0fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:32.673964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de057b-f679-4c59-8f0c-0c67261e0fdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:32.694478 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de057b-f679-4c59-8f0c-0c67261e0fdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:32.695980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de057b-f679-4c59-8f0c-0c67261e0fdd None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:32.712220 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 301/610] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:32.714291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b6b24-1cbd-4954-90f8-ff6d64dee438 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:32.732245 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:32.743369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-c4de057b-f679-4c59-8f0c-0c67261e0fdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:32.743369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:32.743369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:32.743369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:32.743369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:32.743369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:32.743369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:32.743369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:32.743369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:32.743369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:32.743369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:32.743369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:32.743369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:32.743369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:32.743369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:32.744524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:32.744524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:32.744524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:32.744524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:32.744524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:32.744524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:32.744524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:32.744524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:32.744524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:32.744524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:32.744524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:32.744524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:32.744524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:32.744524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:32.744524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:32.744524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:32.744524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:32.745613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:32.745613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:32.745613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:32.745613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:32.748287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 310/611] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:32.753023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de057b-f679-4c59-8f0c-0c67261e0fdd None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:32.874422 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b6b24-1cbd-4954-90f8-ff6d64dee438 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:32.895204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de057b-f679-4c59-8f0c-0c67261e0fdd None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:32.917392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:32.943073 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ebfcc-9eb4-48d6-a761-c804894f7940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:32.943992 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ebfcc-9eb4-48d6-a761-c804894f7940 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:32.944274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ebfcc-9eb4-48d6-a761-c804894f7940 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:32.944602 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ebfcc-9eb4-48d6-a761-c804894f7940 None admin] PATH_INFO: `/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/ae7bc0d4fd924bfb89f874d1c6fc3d4b/roles/dc57e0b7f67947e0b6b63c4ad0148358` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:32.968389 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a909b04-e3a3-452f-98e0-1087b7e67e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:32.969595 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909b04-e3a3-452f-98e0-1087b7e67e9b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:32.969883 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909b04-e3a3-452f-98e0-1087b7e67e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:32.970444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909b04-e3a3-452f-98e0-1087b7e67e9b None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:32.971208 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a909b04-e3a3-452f-98e0-1087b7e67e9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:32.971578 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a909b04-e3a3-452f-98e0-1087b7e67e9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:32.972593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ebfcc-9eb4-48d6-a761-c804894f7940 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e8426fd0e01433b8aa3a3797c687e03, user_id=ae7bc0d4fd924bfb89f874d1c6fc3d4b, role_id=dc57e0b7f67947e0b6b63c4ad0148358)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:32.973103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a909b04-e3a3-452f-98e0-1087b7e67e9b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:32.974278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ebfcc-9eb4-48d6-a761-c804894f7940 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:32.992479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 302/613] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:53:32 2022] PUT /identity/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/ae7bc0d4fd924bfb89f874d1c6fc3d4b/roles/dc57e0b7f67947e0b6b63c4ad0148358 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:53:32.992670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 311/613] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:32.997303 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ebfcc-9eb4-48d6-a761-c804894f7940 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:33.088404 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:33.144619 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ebfcc-9eb4-48d6-a761-c804894f7940 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:33.182809 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9edaba-1787-41c5-81b4-f5984b04e11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:33.183637 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9edaba-1787-41c5-81b4-f5984b04e11a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:33.183956 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9edaba-1787-41c5-81b4-f5984b04e11a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:33.184236 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9edaba-1787-41c5-81b4-f5984b04e11a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:33.192940 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9edaba-1787-41c5-81b4-f5984b04e11a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:33.194411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9edaba-1787-41c5-81b4-f5984b04e11a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:33.211693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-eb9edaba-1787-41c5-81b4-f5984b04e11a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 30 11:53:33.211693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:33.211693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:33.211693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:33.211693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:33.211693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:33.211693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:33.211693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:33.211693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:33.211693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:33.211693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:33.211693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:33.211693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:33.211693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:33.211693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:33.211693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:33.212699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:33.212699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:33.212699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:33.212699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:33.212699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:33.212699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:33.212699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:33.212699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:33.212699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:33.212699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:33.212699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:33.212699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:33.212699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:33.212699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:33.212699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:33.212699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:33.212699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:33.212699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:33.213614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:33.213614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:33.213614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:33.213614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:33.213614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:33.213614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:33.213614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:33.213614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:33.213614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 30 11:53:33.213614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:33.213614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 303/614] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:53:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:33.219201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a909b04-e3a3-452f-98e0-1087b7e67e9b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:33.327994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcab4b-2b02-44d4-9bf1-1389a8e1832f None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:33.328645 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcab4b-2b02-44d4-9bf1-1389a8e1832f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:33.328810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcab4b-2b02-44d4-9bf1-1389a8e1832f None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:33.330150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 304/615] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:33.335655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d19a43-c45c-45a1-9e7f-74a481ac6564 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:33.336257 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d19a43-c45c-45a1-9e7f-74a481ac6564 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:33.336762 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d19a43-c45c-45a1-9e7f-74a481ac6564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:33.364614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a909b04-e3a3-452f-98e0-1087b7e67e9b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:33.377136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c7d19a43-c45c-45a1-9e7f-74a481ac6564 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:33.378350 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c7d19a43-c45c-45a1-9e7f-74a481ac6564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:33.444229 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04750b77-bfd3-46be-b53d-8192238440e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:33.444917 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04750b77-bfd3-46be-b53d-8192238440e8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:33.445183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04750b77-bfd3-46be-b53d-8192238440e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:33.445459 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04750b77-bfd3-46be-b53d-8192238440e8 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:33.446301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04750b77-bfd3-46be-b53d-8192238440e8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:33.446612 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04750b77-bfd3-46be-b53d-8192238440e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:33.448058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04750b77-bfd3-46be-b53d-8192238440e8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:33.470488 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 312/616] 10.222.0.41 () {56 vars in 1135 bytes} [Mon May 30 11:53:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:33.478027 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04750b77-bfd3-46be-b53d-8192238440e8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:33.490028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 305/617] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:33.513010 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d19a43-c45c-45a1-9e7f-74a481ac6564 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:33.513891 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:33.600841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:33.657823 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04750b77-bfd3-46be-b53d-8192238440e8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:33.711126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d19a43-c45c-45a1-9e7f-74a481ac6564 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:33.731586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b13a6-b466-4cf4-b6dd-4928d38aec96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:33.732336 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b13a6-b466-4cf4-b6dd-4928d38aec96 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:33.734360 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b13a6-b466-4cf4-b6dd-4928d38aec96 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:33.734656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b13a6-b466-4cf4-b6dd-4928d38aec96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:33.755197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b13a6-b466-4cf4-b6dd-4928d38aec96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:33.757020 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b13a6-b466-4cf4-b6dd-4928d38aec96 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:33.772615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a850cab-50fe-452a-95fe-a8b00fc5ee00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:33.773746 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a850cab-50fe-452a-95fe-a8b00fc5ee00 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:33.774207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a850cab-50fe-452a-95fe-a8b00fc5ee00 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:33.774641 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a850cab-50fe-452a-95fe-a8b00fc5ee00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:33.783704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-194b13a6-b466-4cf4-b6dd-4928d38aec96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:33.783704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:33.783704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:33.783704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:33.783704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:33.783704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:33.783704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:33.783704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:33.783704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:33.783704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:33.783704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:33.783704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:33.783704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:33.783704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:33.783704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:33.784833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:33.784833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:33.784833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:33.784833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:33.784833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:33.784833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:33.784833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:33.784833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:33.784833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:33.784833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:33.784833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:33.784833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:33.784833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:33.784833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:33.784833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:33.784833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:33.784833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:33.786080 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:33.786080 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:33.786080 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:33.786080 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:33.789211 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a850cab-50fe-452a-95fe-a8b00fc5ee00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:33.791674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 313/618] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:53:33.792962 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b13a6-b466-4cf4-b6dd-4928d38aec96 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:33.798713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-4a850cab-50fe-452a-95fe-a8b00fc5ee00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:33.798713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:33.798713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:33.798713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:33.798713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:33.798713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:33.798713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:33.798713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:33.798713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:33.798713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:33.798713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:33.798713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:33.798713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:33.798713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:33.798713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:33.798713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:33.799853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:33.799853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:33.799853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:33.799853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:33.799853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:33.799853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:33.799853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:33.799853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:33.799853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:33.799853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:33.799853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:33.799853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:33.799853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:33.799853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:33.799853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:33.799853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:33.800928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:33.800928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:33.800928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:33.800928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:33.800928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:33.800928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:33.800928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:33.800928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:33.800928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:33.800928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:33.800928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:33.800928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:33.803366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 306/619] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:53:33.809351 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a850cab-50fe-452a-95fe-a8b00fc5ee00 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:33.928197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:33.947803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b13a6-b466-4cf4-b6dd-4928d38aec96 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:33.962730 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a850cab-50fe-452a-95fe-a8b00fc5ee00 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:33.977201 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:34.004722 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75b53b-9e53-49ad-9f65-928c6f0ce585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:34.005491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75b53b-9e53-49ad-9f65-928c6f0ce585 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:34.005974 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75b53b-9e53-49ad-9f65-928c6f0ce585 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:34.006364 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75b53b-9e53-49ad-9f65-928c6f0ce585 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:34.007226 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75b53b-9e53-49ad-9f65-928c6f0ce585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:34.007649 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75b53b-9e53-49ad-9f65-928c6f0ce585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:34.009237 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75b53b-9e53-49ad-9f65-928c6f0ce585 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:34.026060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 314/620] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:34.027505 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75b53b-9e53-49ad-9f65-928c6f0ce585 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:34.066287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26068a-e10c-4be7-9356-6dc89b131c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:34.066980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26068a-e10c-4be7-9356-6dc89b131c9f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:34.067266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26068a-e10c-4be7-9356-6dc89b131c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:34.067548 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26068a-e10c-4be7-9356-6dc89b131c9f None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:34.068336 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26068a-e10c-4be7-9356-6dc89b131c9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:34.068648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26068a-e10c-4be7-9356-6dc89b131c9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:34.070106 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26068a-e10c-4be7-9356-6dc89b131c9f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:34.093818 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 307/621] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:53:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:34.099473 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26068a-e10c-4be7-9356-6dc89b131c9f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:34.135375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75b53b-9e53-49ad-9f65-928c6f0ce585 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:34.171141 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24daaa-c638-40d7-8173-c40cc3077710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:34.172160 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24daaa-c638-40d7-8173-c40cc3077710 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:34.172573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24daaa-c638-40d7-8173-c40cc3077710 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:34.172961 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24daaa-c638-40d7-8173-c40cc3077710 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:34.180281 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24daaa-c638-40d7-8173-c40cc3077710 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:34.181982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24daaa-c638-40d7-8173-c40cc3077710 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:34.185193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:34.201655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-9c24daaa-c638-40d7-8173-c40cc3077710 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:34.201655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:34.201655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:34.201655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:34.201655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:34.201655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:34.201655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:34.201655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:34.201655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:34.201655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:34.201655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:34.201655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:34.201655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:34.201655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:34.201655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:34.202704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:34.202704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:34.202704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:34.202704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:34.202704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:34.202704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:34.202704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:34.202704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:34.202704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:34.202704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:34.202704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:34.202704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:34.202704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:34.202704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:34.202704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:34.202704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:34.202704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:34.203586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:34.203586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:34.203586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:34.203586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:34.203586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:34.203586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:34.203586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:34.203586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:34.207761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 315/622] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:53:34.211073 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24daaa-c638-40d7-8173-c40cc3077710 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:34.304024 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26068a-e10c-4be7-9356-6dc89b131c9f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:34.333415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24daaa-c638-40d7-8173-c40cc3077710 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:34.349075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b70f8a-fd42-4723-aa22-c125d079386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:34.349886 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b70f8a-fd42-4723-aa22-c125d079386c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:34.350176 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b70f8a-fd42-4723-aa22-c125d079386c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:34.350457 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b70f8a-fd42-4723-aa22-c125d079386c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:34.364952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b70f8a-fd42-4723-aa22-c125d079386c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:34.367077 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b70f8a-fd42-4723-aa22-c125d079386c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:34.369711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92f696-fc9b-4c3d-a402-3af20a7a911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:34.370482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92f696-fc9b-4c3d-a402-3af20a7a911e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:34.370874 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92f696-fc9b-4c3d-a402-3af20a7a911e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:34.371511 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92f696-fc9b-4c3d-a402-3af20a7a911e None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:34.372461 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92f696-fc9b-4c3d-a402-3af20a7a911e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:34.372880 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92f696-fc9b-4c3d-a402-3af20a7a911e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:34.375157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92f696-fc9b-4c3d-a402-3af20a7a911e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:34.387337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-76b70f8a-fd42-4723-aa22-c125d079386c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:34.387337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:34.387337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:34.387337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:34.387337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:34.387337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:34.387337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:34.387337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:34.387337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:34.387337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:34.387337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:34.387337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:34.387337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:34.387337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:34.387337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:34.388249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:34.388249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:34.388249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:34.388249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:34.388249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:34.388249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:34.388249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:34.388249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:34.388249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:34.388249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:34.388249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:34.388249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:34.388249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:34.388249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:34.388249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:34.388249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:34.388249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:34.389142 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:34.389142 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:34.389142 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:34.389142 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:34.393091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 308/623] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:34.394016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 316/624] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:34.394598 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb6704-9036-4b86-b579-1353407f01b3 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:34.394893 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb6704-9036-4b86-b579-1353407f01b3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:34.395165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92f696-fc9b-4c3d-a402-3af20a7a911e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:34.395285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb6704-9036-4b86-b579-1353407f01b3 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:34.396814 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 309/625] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:34.397511 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb6704-9036-4b86-b579-1353407f01b3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:34.424177 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:34.474452 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:34.510782 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb6704-9036-4b86-b579-1353407f01b3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:34.535210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92f696-fc9b-4c3d-a402-3af20a7a911e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:34.551646 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f16b5-1b85-491d-8ad1-4127b006dedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:34.553079 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f16b5-1b85-491d-8ad1-4127b006dedd None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:34.553706 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f16b5-1b85-491d-8ad1-4127b006dedd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:34.554250 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f16b5-1b85-491d-8ad1-4127b006dedd None admin] PATH_INFO: `/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/83e5f980cdb74227bb31c7e7e5eab74b/roles/dc57e0b7f67947e0b6b63c4ad0148358` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:34.573403 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f16b5-1b85-491d-8ad1-4127b006dedd None admin] RBAC: Authorizing `identity:create_grant(project_id=1e8426fd0e01433b8aa3a3797c687e03, user_id=83e5f980cdb74227bb31c7e7e5eab74b, role_id=dc57e0b7f67947e0b6b63c4ad0148358)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:34.575167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f16b5-1b85-491d-8ad1-4127b006dedd None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:34.576472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dca32d-751c-4957-9d2f-9a5b1e716d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:34.577989 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dca32d-751c-4957-9d2f-9a5b1e716d05 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:34.578485 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dca32d-751c-4957-9d2f-9a5b1e716d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:34.578968 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dca32d-751c-4957-9d2f-9a5b1e716d05 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:34.580014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dca32d-751c-4957-9d2f-9a5b1e716d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:34.580549 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dca32d-751c-4957-9d2f-9a5b1e716d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:34.582262 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dca32d-751c-4957-9d2f-9a5b1e716d05 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:34.599562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 310/626] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:53:34 2022] PUT /identity/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/83e5f980cdb74227bb31c7e7e5eab74b/roles/dc57e0b7f67947e0b6b63c4ad0148358 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:53:34.599562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4319ee-5026-4c64-ad04-b6fb7b53a554 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:34.599562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4319ee-5026-4c64-ad04-b6fb7b53a554 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:34.599562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4319ee-5026-4c64-ad04-b6fb7b53a554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:34.606006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 317/627] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:34.613718 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dca32d-751c-4957-9d2f-9a5b1e716d05 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:34.628473 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ef4319ee-5026-4c64-ad04-b6fb7b53a554 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:34.629708 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ef4319ee-5026-4c64-ad04-b6fb7b53a554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:34.773463 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:34.785172 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 311/628] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:34.809880 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dca32d-751c-4957-9d2f-9a5b1e716d05 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:34.832356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4319ee-5026-4c64-ad04-b6fb7b53a554 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:34.847318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:34.878583 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bcdca-87a3-40ec-b90c-eed503b5032c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:34.879415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bcdca-87a3-40ec-b90c-eed503b5032c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:34.879705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bcdca-87a3-40ec-b90c-eed503b5032c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:34.880013 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bcdca-87a3-40ec-b90c-eed503b5032c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:34.889233 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bcdca-87a3-40ec-b90c-eed503b5032c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:34.890715 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bcdca-87a3-40ec-b90c-eed503b5032c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:34.908763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-e02bcdca-87a3-40ec-b90c-eed503b5032c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 30 11:53:34.908763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:34.908763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:34.908763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:34.908763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:34.908763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:34.908763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:34.908763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:34.908763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:34.908763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:34.908763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:34.908763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:34.908763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:34.908763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:34.908763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:34.908763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:34.909881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:34.909881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:34.909881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:34.909881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:34.909881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:34.909881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:34.909881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:34.909881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:34.909881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:34.909881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:34.909881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:34.909881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:34.909881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:34.909881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:34.909881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:34.909881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:34.909881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:34.909881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:34.911993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:34.911993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:34.911993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:34.911993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:34.911993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:34.911993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:34.911993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:34.911993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:34.911993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 30 11:53:34.911993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:34.911993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 318/629] 10.222.0.41 () {56 vars in 1093 bytes} [Mon May 30 11:53:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:53:34.915647 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bcdca-87a3-40ec-b90c-eed503b5032c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:34.979225 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4319ee-5026-4c64-ad04-b6fb7b53a554 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:35.015526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710af75-59d2-425c-bb75-a9c5b6e5ab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:35.016417 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710af75-59d2-425c-bb75-a9c5b6e5ab9b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:35.016707 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710af75-59d2-425c-bb75-a9c5b6e5ab9b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:35.016995 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710af75-59d2-425c-bb75-a9c5b6e5ab9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:35.027745 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710af75-59d2-425c-bb75-a9c5b6e5ab9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:35.036145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-5710af75-59d2-425c-bb75-a9c5b6e5ab9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:35.036145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:35.036145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:35.036145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:35.036145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:35.036145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:35.036145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:35.036145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:35.036145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:35.036145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:35.036145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:35.036145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:35.036145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:35.036145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:35.036145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:35.036145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:35.037078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:35.037078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:35.037078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:35.037078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:35.037078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:35.037078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:35.037078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:35.037078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:35.037078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:35.037078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:35.037078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:35.037078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:35.037078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:35.037078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:35.037078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:35.037078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:35.039052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:35.039052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:35.039052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:35.039052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:35.039052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:35.039052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:35.039052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:35.039052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:35.039052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:35.039052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:35.039052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:35.039052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:35.039052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 312/630] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:53:35.042973 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710af75-59d2-425c-bb75-a9c5b6e5ab9b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:35.054418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bcdca-87a3-40ec-b90c-eed503b5032c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:35.102221 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba59b21-5b82-4c87-881b-4a88ea46efd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:35.102821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba59b21-5b82-4c87-881b-4a88ea46efd9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:35.103109 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba59b21-5b82-4c87-881b-4a88ea46efd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:35.103383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba59b21-5b82-4c87-881b-4a88ea46efd9 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:35.104960 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba59b21-5b82-4c87-881b-4a88ea46efd9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:35.105273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba59b21-5b82-4c87-881b-4a88ea46efd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:35.106930 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba59b21-5b82-4c87-881b-4a88ea46efd9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:35.146226 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 319/631] 10.222.0.41 () {56 vars in 1133 bytes} [Mon May 30 11:53:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:35.149537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:35.152444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba59b21-5b82-4c87-881b-4a88ea46efd9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:35.219471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:35.252397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710af75-59d2-425c-bb75-a9c5b6e5ab9b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:35.287300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba59b21-5b82-4c87-881b-4a88ea46efd9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:35.288026 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a0f0b-e9c4-4844-9f1a-2aa0aa6404ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:35.288961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a0f0b-e9c4-4844-9f1a-2aa0aa6404ca None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:35.289447 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a0f0b-e9c4-4844-9f1a-2aa0aa6404ca None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:35.289970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a0f0b-e9c4-4844-9f1a-2aa0aa6404ca None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:35.290922 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a0f0b-e9c4-4844-9f1a-2aa0aa6404ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:35.291446 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a0f0b-e9c4-4844-9f1a-2aa0aa6404ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:35.293097 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a0f0b-e9c4-4844-9f1a-2aa0aa6404ca None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:35.302937 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 313/632] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:53:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:35.304648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3c55f-763e-4424-975f-7f5da89d4185 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:35.305144 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3c55f-763e-4424-975f-7f5da89d4185 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:35.305633 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3c55f-763e-4424-975f-7f5da89d4185 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:35.311654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 314/633] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:35.312828 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3c55f-763e-4424-975f-7f5da89d4185 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:35.324883 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cde6e6-7d11-4cd2-8035-e7e0a3b88b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:35.325594 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cde6e6-7d11-4cd2-8035-e7e0a3b88b5a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:35.325880 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cde6e6-7d11-4cd2-8035-e7e0a3b88b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:35.326208 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cde6e6-7d11-4cd2-8035-e7e0a3b88b5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:35.415405 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cde6e6-7d11-4cd2-8035-e7e0a3b88b5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:35.417703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cde6e6-7d11-4cd2-8035-e7e0a3b88b5a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:35.440586 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3c55f-763e-4424-975f-7f5da89d4185 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:35.473716 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:35.476184 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:35.497354 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc8390-e6af-4eda-8741-979cb42a1aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:35.498164 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc8390-e6af-4eda-8741-979cb42a1aab None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:35.498625 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc8390-e6af-4eda-8741-979cb42a1aab None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:35.499031 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc8390-e6af-4eda-8741-979cb42a1aab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:35.513053 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc8390-e6af-4eda-8741-979cb42a1aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:35.515450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc8390-e6af-4eda-8741-979cb42a1aab None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:35.542938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-80bc8390-e6af-4eda-8741-979cb42a1aab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:35.542938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:35.542938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:35.542938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:35.542938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:35.542938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:35.542938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:35.542938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:35.542938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:35.542938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:35.542938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:35.542938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:35.542938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:35.542938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:35.542938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:35.543912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:35.543912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:35.543912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:35.543912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:35.543912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:35.543912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:35.543912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:35.543912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:35.543912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:35.543912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:35.543912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:35.543912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:35.543912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:35.543912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:35.543912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:35.543912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:35.543912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:35.544793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:35.544793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:35.544793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:35.544793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:35.546453 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 315/634] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:35.548021 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ce953-9c70-4b9d-b348-c04c35e31422 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:35.548310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ce953-9c70-4b9d-b348-c04c35e31422 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:35.548594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ce953-9c70-4b9d-b348-c04c35e31422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:35.563508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 320/635] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 30 11:53:35.564777 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cde6e6-7d11-4cd2-8035-e7e0a3b88b5a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:35.566669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-336ce953-9c70-4b9d-b348-c04c35e31422 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:35.567895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-336ce953-9c70-4b9d-b348-c04c35e31422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:35.655956 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 316/636] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:35.657163 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ce953-9c70-4b9d-b348-c04c35e31422 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:35.691006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cde6e6-7d11-4cd2-8035-e7e0a3b88b5a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:35.728385 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547e71e-937d-4fa4-827e-a6712d82c968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:35.729412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547e71e-937d-4fa4-827e-a6712d82c968 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:35.729914 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547e71e-937d-4fa4-827e-a6712d82c968 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:35.730404 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547e71e-937d-4fa4-827e-a6712d82c968 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:35.731344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547e71e-937d-4fa4-827e-a6712d82c968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:35.731920 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547e71e-937d-4fa4-827e-a6712d82c968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:35.733832 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547e71e-937d-4fa4-827e-a6712d82c968 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:35.741441 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:35.749000 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 321/637] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:35.750164 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547e71e-937d-4fa4-827e-a6712d82c968 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:35.795321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ce953-9c70-4b9d-b348-c04c35e31422 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:35.799220 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:35.832881 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b2d1f-258c-4178-bb25-2ecf26250d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:35.833669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b2d1f-258c-4178-bb25-2ecf26250d30 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:35.833960 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b2d1f-258c-4178-bb25-2ecf26250d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:35.834236 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b2d1f-258c-4178-bb25-2ecf26250d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:35.844905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b2d1f-258c-4178-bb25-2ecf26250d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:35.846368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b2d1f-258c-4178-bb25-2ecf26250d30 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:35.856762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547e71e-937d-4fa4-827e-a6712d82c968 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:35.866089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-066b2d1f-258c-4178-bb25-2ecf26250d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:35.866089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:35.866089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:35.866089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:35.866089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:35.866089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:35.866089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:35.866089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:35.866089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:35.866089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:35.866089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:35.866089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:35.866089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:35.866089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:35.866089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:35.866986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:35.866986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:35.866986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:35.866986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:35.866986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:35.866986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:35.866986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:35.866986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:35.866986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:35.866986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:35.866986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:35.866986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:35.866986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:35.866986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:35.866986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:35.866986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:35.866986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:35.867905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:35.867905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:35.867905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:35.867905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:35.867905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 317/638] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:35.868193 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b2d1f-258c-4178-bb25-2ecf26250d30 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:35.896871 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66807b5-4eef-4d2b-9282-a0fc0dd567f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:35.897670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66807b5-4eef-4d2b-9282-a0fc0dd567f7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:35.897948 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66807b5-4eef-4d2b-9282-a0fc0dd567f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:35.898220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66807b5-4eef-4d2b-9282-a0fc0dd567f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:35.909644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66807b5-4eef-4d2b-9282-a0fc0dd567f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:35.917377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-c66807b5-4eef-4d2b-9282-a0fc0dd567f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:35.917377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:35.917377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:35.917377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:35.917377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:35.917377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:35.917377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:35.917377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:35.917377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:35.917377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:35.917377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:35.917377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:35.917377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:35.917377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:35.917377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:35.917377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:35.918307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:35.918307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:35.918307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:35.918307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:35.918307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:35.918307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:35.918307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:35.918307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:35.918307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:35.918307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:35.918307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:35.918307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:35.918307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:35.918307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:35.918307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:35.918307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:35.919156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:35.919156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:35.919156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:35.919156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:35.919156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:35.919156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:35.919156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:35.919156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:35.919156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:35.919156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:35.919156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:35.919156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:35.919156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 322/639] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:35.924510 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ec6e-556b-48e4-a9ba-c080dfca18fe None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:35.924808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ec6e-556b-48e4-a9ba-c080dfca18fe None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:35.925089 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ec6e-556b-48e4-a9ba-c080dfca18fe None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:35.927952 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 323/640] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:35.927952 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0ec6e-556b-48e4-a9ba-c080dfca18fe None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:35.982304 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b2d1f-258c-4178-bb25-2ecf26250d30 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:35.993006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:36.021308 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bffdb-bc50-471e-a60e-3b11535151a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:36.022225 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bffdb-bc50-471e-a60e-3b11535151a2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:36.022542 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bffdb-bc50-471e-a60e-3b11535151a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:36.022788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bffdb-bc50-471e-a60e-3b11535151a2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:36.030894 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bffdb-bc50-471e-a60e-3b11535151a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:36.032401 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bffdb-bc50-471e-a60e-3b11535151a2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:36.041626 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0ec6e-556b-48e4-a9ba-c080dfca18fe None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:36.047484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-272bffdb-bc50-471e-a60e-3b11535151a2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 30 11:53:36.047484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:36.047484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:36.047484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:36.047484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:36.047484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:36.047484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:36.047484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:36.047484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:36.047484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:36.047484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:36.047484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:36.047484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:36.047484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:36.047484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:36.047484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:36.048687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:36.048687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:36.048687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:36.048687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:36.048687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:36.048687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:36.048687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:36.048687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:36.048687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:36.048687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:36.048687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:36.048687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:36.048687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:36.048687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:36.048687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:36.048687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:36.048687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:36.048687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:36.054297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:36.054297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:36.054297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:36.054297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:36.054297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:36.054297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:36.054297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:36.054297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:36.054297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 30 11:53:36.054297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:36.054297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 318/641] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:36.054297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bffdb-bc50-471e-a60e-3b11535151a2 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:36.070243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:36.085510 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cee6b8-f5f3-4697-bd65-36e06374c80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:36.086224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee6b8-f5f3-4697-bd65-36e06374c80a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:36.086461 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee6b8-f5f3-4697-bd65-36e06374c80a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:36.086726 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee6b8-f5f3-4697-bd65-36e06374c80a None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:36.087438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cee6b8-f5f3-4697-bd65-36e06374c80a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:36.087747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cee6b8-f5f3-4697-bd65-36e06374c80a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:36.089128 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cee6b8-f5f3-4697-bd65-36e06374c80a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:36.103126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 324/642] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:36.108819 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30576e27-3f09-4166-a8df-10371f4a29c3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:36.109113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30576e27-3f09-4166-a8df-10371f4a29c3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:36.109391 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30576e27-3f09-4166-a8df-10371f4a29c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:36.126936 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-30576e27-3f09-4166-a8df-10371f4a29c3 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:36.128821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-30576e27-3f09-4166-a8df-10371f4a29c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:36.161272 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bffdb-bc50-471e-a60e-3b11535151a2 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:36.196627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5eafa-e48e-4c49-ad32-c8d669b87d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:36.197323 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5eafa-e48e-4c49-ad32-c8d669b87d18 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:36.197613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5eafa-e48e-4c49-ad32-c8d669b87d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:36.197893 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5eafa-e48e-4c49-ad32-c8d669b87d18 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:36.198644 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5eafa-e48e-4c49-ad32-c8d669b87d18 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:36.198954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5eafa-e48e-4c49-ad32-c8d669b87d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:36.204037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 325/643] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:36.204037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30576e27-3f09-4166-a8df-10371f4a29c3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:36.204232 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5eafa-e48e-4c49-ad32-c8d669b87d18 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:36.211890 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 319/644] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:53:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:36.212959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5eafa-e48e-4c49-ad32-c8d669b87d18 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:36.268521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:36.302125 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:36.323577 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30576e27-3f09-4166-a8df-10371f4a29c3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:36.326496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5eafa-e48e-4c49-ad32-c8d669b87d18 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:36.362689 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e44f3-5acc-4e20-b915-af2310da3690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:36.362898 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d3a31-136b-4ecc-b2c1-a598f26c92ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:36.363491 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e44f3-5acc-4e20-b915-af2310da3690 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:36.363613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d3a31-136b-4ecc-b2c1-a598f26c92ca None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:36.363785 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e44f3-5acc-4e20-b915-af2310da3690 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:36.363907 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d3a31-136b-4ecc-b2c1-a598f26c92ca None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:36.364082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d3a31-136b-4ecc-b2c1-a598f26c92ca None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:36.364178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e44f3-5acc-4e20-b915-af2310da3690 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:36.364927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d3a31-136b-4ecc-b2c1-a598f26c92ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:36.365237 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d3a31-136b-4ecc-b2c1-a598f26c92ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:36.367137 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d3a31-136b-4ecc-b2c1-a598f26c92ca None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:36.370957 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e44f3-5acc-4e20-b915-af2310da3690 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:36.372697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e44f3-5acc-4e20-b915-af2310da3690 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:36.385636 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 326/645] 10.222.0.41 () {56 vars in 1137 bytes} [Mon May 30 11:53:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:36.386283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d3a31-136b-4ecc-b2c1-a598f26c92ca None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:36.388086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-364e44f3-5acc-4e20-b915-af2310da3690 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:36.388086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:36.388086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:36.388086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:36.388086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:36.388086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:36.388086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:36.388086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:36.388086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:36.388086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:36.388086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:36.388086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:36.388086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:36.388086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:36.388086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:36.388978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:36.388978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:36.388978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:36.388978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:36.388978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:36.388978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:36.388978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:36.388978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:36.388978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:36.388978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:36.388978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:36.388978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:36.388978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:36.388978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:36.388978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:36.388978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:36.388978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:36.394895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:36.394895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:36.394895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:36.394895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:36.394895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:36.394895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:36.394895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:36.394895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:36.394895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 320/646] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:36.394895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e44f3-5acc-4e20-b915-af2310da3690 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:36.500254 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d3a31-136b-4ecc-b2c1-a598f26c92ca None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:36.500493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e44f3-5acc-4e20-b915-af2310da3690 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:36.508831 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:36.539471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040e1cd-f98e-454d-885f-dd8e81691c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:36.539659 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b56750-584c-40c4-b8ce-18c6df329c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:36.540216 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040e1cd-f98e-454d-885f-dd8e81691c91 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:36.540437 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b56750-584c-40c4-b8ce-18c6df329c44 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:36.540538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040e1cd-f98e-454d-885f-dd8e81691c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:36.540720 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b56750-584c-40c4-b8ce-18c6df329c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:36.540817 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040e1cd-f98e-454d-885f-dd8e81691c91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:36.540994 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b56750-584c-40c4-b8ce-18c6df329c44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:36.548698 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:36.552392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b56750-584c-40c4-b8ce-18c6df329c44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:36.553175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040e1cd-f98e-454d-885f-dd8e81691c91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:36.554428 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b56750-584c-40c4-b8ce-18c6df329c44 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:36.561519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b040e1cd-f98e-454d-885f-dd8e81691c91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:36.561519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:36.561519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:36.561519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:36.561519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:36.561519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:36.561519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:36.561519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:36.561519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:36.561519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:36.561519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:36.561519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:36.561519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:36.561519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:36.561519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:36.561519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:36.562445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:36.562445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:36.562445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:36.562445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:36.562445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:36.562445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:36.562445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:36.562445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:36.562445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:36.562445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:36.562445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:36.562445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:36.562445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:36.562445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:36.562445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:36.562445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:36.563270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:36.563270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:36.563270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:36.563270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:36.563270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:36.563270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:36.563270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:36.563270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:36.563270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:36.563270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:36.563270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:36.563270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:36.563270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 321/647] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:36.564954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040e1cd-f98e-454d-885f-dd8e81691c91 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:36.579361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-52b56750-584c-40c4-b8ce-18c6df329c44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:36.579361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:36.579361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:36.579361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:36.579361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:36.579361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:36.579361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:36.579361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:36.579361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:36.579361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:36.579361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:36.579361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:36.579361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:36.579361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:36.579361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:36.580350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:36.580350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:36.580350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:36.580350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:36.580350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:36.580350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:36.580350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:36.580350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:36.580350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:36.580350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:36.580350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:36.580350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:36.580350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:36.580350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:36.580350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:36.580350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:36.580350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:36.581223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:36.581223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:36.581223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:36.581223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:36.581223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 327/648] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:36.581529 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b56750-584c-40c4-b8ce-18c6df329c44 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:36.680459 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040e1cd-f98e-454d-885f-dd8e81691c91 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:36.684716 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b56750-584c-40c4-b8ce-18c6df329c44 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:36.716869 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568d053-6c42-4819-9564-83d1c6cdc7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:36.718483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568d053-6c42-4819-9564-83d1c6cdc7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:36.718953 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568d053-6c42-4819-9564-83d1c6cdc7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:36.719409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568d053-6c42-4819-9564-83d1c6cdc7d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:36.720183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c48bd-c2c0-4c25-ace7-35991a2886e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:36.720841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c48bd-c2c0-4c25-ace7-35991a2886e6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:36.721124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c48bd-c2c0-4c25-ace7-35991a2886e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:36.721402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c48bd-c2c0-4c25-ace7-35991a2886e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:36.722194 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c48bd-c2c0-4c25-ace7-35991a2886e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:36.722504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c48bd-c2c0-4c25-ace7-35991a2886e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:36.723960 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c48bd-c2c0-4c25-ace7-35991a2886e6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:36.735739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 328/649] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:36.736593 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c48bd-c2c0-4c25-ace7-35991a2886e6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:36.759544 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:36.802237 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:36.806113 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568d053-6c42-4819-9564-83d1c6cdc7d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:36.808713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568d053-6c42-4819-9564-83d1c6cdc7d4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:36.860486 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c48bd-c2c0-4c25-ace7-35991a2886e6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:36.896020 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0d35a-8c52-494e-9672-d468fb47e939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:36.896959 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0d35a-8c52-494e-9672-d468fb47e939 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:36.897250 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0d35a-8c52-494e-9672-d468fb47e939 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:36.897589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0d35a-8c52-494e-9672-d468fb47e939 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:36.898352 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0d35a-8c52-494e-9672-d468fb47e939 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:36.898672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0d35a-8c52-494e-9672-d468fb47e939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:36.900069 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0d35a-8c52-494e-9672-d468fb47e939 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:36.909096 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 329/650] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:53:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:36.909898 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0d35a-8c52-494e-9672-d468fb47e939 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:36.928046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 322/651] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:36.928046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568d053-6c42-4819-9564-83d1c6cdc7d4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:37.004721 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:37.025281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:37.027312 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0d35a-8c52-494e-9672-d468fb47e939 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:37.031739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568d053-6c42-4819-9564-83d1c6cdc7d4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:37.063765 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca7a46-ced0-49e8-a5c4-73017099528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:37.064384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca7a46-ced0-49e8-a5c4-73017099528b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:37.064673 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca7a46-ced0-49e8-a5c4-73017099528b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:37.064956 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca7a46-ced0-49e8-a5c4-73017099528b None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:37.065716 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca7a46-ced0-49e8-a5c4-73017099528b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:37.066034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca7a46-ced0-49e8-a5c4-73017099528b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:37.067411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca7a46-ced0-49e8-a5c4-73017099528b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:37.073151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a8d5a-513c-4a10-a217-eef4a9fa671d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:37.074068 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a8d5a-513c-4a10-a217-eef4a9fa671d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:37.074588 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a8d5a-513c-4a10-a217-eef4a9fa671d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:37.075044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a8d5a-513c-4a10-a217-eef4a9fa671d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:37.076204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a8d5a-513c-4a10-a217-eef4a9fa671d None admin] RBAC: Adding query filter params (role.id=dc57e0b7f67947e0b6b63c4ad0148358, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=bb3820a613744c15b840681fe6b6e808) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:37.076563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a8d5a-513c-4a10-a217-eef4a9fa671d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:37.078002 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a8d5a-513c-4a10-a217-eef4a9fa671d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:37.083865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 330/652] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:37.083865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca7a46-ced0-49e8-a5c4-73017099528b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:37.089369 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 323/653] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:53:36 2022] GET /identity/v3/role_assignments?user.id=bb3820a613744c15b840681fe6b6e808&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=dc57e0b7f67947e0b6b63c4ad0148358 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:37.090077 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a8d5a-513c-4a10-a217-eef4a9fa671d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:37.194707 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca7a46-ced0-49e8-a5c4-73017099528b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:37.202551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a8d5a-513c-4a10-a217-eef4a9fa671d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:37.234483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a6293-b31c-497f-b54d-b82ae83d9e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:37.235312 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a6293-b31c-497f-b54d-b82ae83d9e45 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:37.235607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a6293-b31c-497f-b54d-b82ae83d9e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:37.235917 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a6293-b31c-497f-b54d-b82ae83d9e45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:37.239113 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e81558-46e7-4e6c-898b-bc13ed90243f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:37.239962 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e81558-46e7-4e6c-898b-bc13ed90243f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:37.240250 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e81558-46e7-4e6c-898b-bc13ed90243f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:37.240526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e81558-46e7-4e6c-898b-bc13ed90243f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:37.247028 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:37.250454 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a6293-b31c-497f-b54d-b82ae83d9e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:37.252374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a6293-b31c-497f-b54d-b82ae83d9e45 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:37.253322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e81558-46e7-4e6c-898b-bc13ed90243f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:37.254877 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e81558-46e7-4e6c-898b-bc13ed90243f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:37.273068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b47a6293-b31c-497f-b54d-b82ae83d9e45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:37.273068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:37.273068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:37.273068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:37.273068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:37.273068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:37.273068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:37.273068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:37.273068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:37.273068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:37.273068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:37.273068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:37.273068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:37.273068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:37.273068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:37.274273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:37.274273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:37.274273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:37.274273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:37.274273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:37.274273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:37.274273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:37.274273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:37.274273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:37.274273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:37.274273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:37.274273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:37.274273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:37.274273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:37.274273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:37.274273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:37.274273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:37.275224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:37.275224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:37.275224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:37.275224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:37.275440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d8e81558-46e7-4e6c-898b-bc13ed90243f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:37.275440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:37.275440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:37.275440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:37.275440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:37.275440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:37.275440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:37.275440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:37.275440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:37.275440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:37.275440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:37.275440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:37.275440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:37.275440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:37.275440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:37.276258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:37.276258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:37.276258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:37.276258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:37.276258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:37.276258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:37.276258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:37.276258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:37.276258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:37.276258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:37.276258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:37.276258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:37.276258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:37.276258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:37.276258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:37.276258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:37.276258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:37.277108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:37.277108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:37.277108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:37.277108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:37.277108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 324/654] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:37.277108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e81558-46e7-4e6c-898b-bc13ed90243f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:37.278751 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 331/655] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:37.280839 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a0c5-c320-449a-a1f0-8e8f5d1ece33 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:37.281311 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a0c5-c320-449a-a1f0-8e8f5d1ece33 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:37.281739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a0c5-c320-449a-a1f0-8e8f5d1ece33 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:37.283186 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 332/656] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:37.284070 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a0c5-c320-449a-a1f0-8e8f5d1ece33 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:37.304567 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:37.397433 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a0c5-c320-449a-a1f0-8e8f5d1ece33 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:37.400319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e81558-46e7-4e6c-898b-bc13ed90243f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:37.433458 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e0a30-534b-49fd-8107-0f5d2a921be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:37.434130 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e0a30-534b-49fd-8107-0f5d2a921be6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:37.434416 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e0a30-534b-49fd-8107-0f5d2a921be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:37.434693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e0a30-534b-49fd-8107-0f5d2a921be6 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:37.435412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e0a30-534b-49fd-8107-0f5d2a921be6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:37.435729 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e0a30-534b-49fd-8107-0f5d2a921be6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:37.436725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f15203-fd4a-4117-ad00-e349a97fc788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:37.437197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e0a30-534b-49fd-8107-0f5d2a921be6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:37.437528 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f15203-fd4a-4117-ad00-e349a97fc788 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:37.437814 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f15203-fd4a-4117-ad00-e349a97fc788 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:37.438091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f15203-fd4a-4117-ad00-e349a97fc788 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:37.449739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 333/657] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:37.450236 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f15203-fd4a-4117-ad00-e349a97fc788 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:37.450553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e0a30-534b-49fd-8107-0f5d2a921be6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:37.452999 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f15203-fd4a-4117-ad00-e349a97fc788 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:37.470065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-06f15203-fd4a-4117-ad00-e349a97fc788 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 30 11:53:37.470065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:37.470065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:37.470065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:37.470065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:37.470065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:37.470065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:37.470065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:37.470065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:37.470065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:37.470065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:37.470065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:37.470065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:37.470065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:37.470065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:37.470065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:37.471076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:37.471076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:37.471076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:37.471076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:37.471076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:37.471076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:37.471076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:37.471076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:37.471076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:37.471076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:37.471076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:37.471076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:37.471076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:37.471076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:37.471076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:37.471076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:37.471076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:37.471076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:37.472038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:37.472038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:37.472038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:37.472038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:37.472038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:37.472038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:37.472038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:37.472038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:37.472038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 30 11:53:37.472038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:37.472038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 325/658] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:37.472628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fcbd6-cc5f-4297-8f00-ad9c3a0f7a31 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:37.473384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fcbd6-cc5f-4297-8f00-ad9c3a0f7a31 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:37.473384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fcbd6-cc5f-4297-8f00-ad9c3a0f7a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:37.490564 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0a4fcbd6-cc5f-4297-8f00-ad9c3a0f7a31 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:37.491754 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0a4fcbd6-cc5f-4297-8f00-ad9c3a0f7a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:37.516973 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:37.571885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 326/659] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:37.571885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fcbd6-cc5f-4297-8f00-ad9c3a0f7a31 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:37.572493 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e0a30-534b-49fd-8107-0f5d2a921be6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:37.578283 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:37.610118 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf549db2-92a2-4960-b63c-ba3770067ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:37.610799 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf549db2-92a2-4960-b63c-ba3770067ccc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:37.611091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf549db2-92a2-4960-b63c-ba3770067ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:37.611358 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf549db2-92a2-4960-b63c-ba3770067ccc None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:37.612120 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf549db2-92a2-4960-b63c-ba3770067ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:37.612455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf549db2-92a2-4960-b63c-ba3770067ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:37.613804 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf549db2-92a2-4960-b63c-ba3770067ccc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:37.627105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 334/660] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:37.627859 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf549db2-92a2-4960-b63c-ba3770067ccc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:37.689510 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fcbd6-cc5f-4297-8f00-ad9c3a0f7a31 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:37.726483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb15fdd-247f-4437-a121-b558cd7dd924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:37.727796 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb15fdd-247f-4437-a121-b558cd7dd924 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:37.728335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb15fdd-247f-4437-a121-b558cd7dd924 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:37.728848 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb15fdd-247f-4437-a121-b558cd7dd924 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:37.730032 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf549db2-92a2-4960-b63c-ba3770067ccc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:37.736895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb15fdd-247f-4437-a121-b558cd7dd924 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:37.738734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb15fdd-247f-4437-a121-b558cd7dd924 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:37.743749 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:37.754448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-afb15fdd-247f-4437-a121-b558cd7dd924 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:37.754448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:37.754448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:37.754448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:37.754448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:37.754448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:37.754448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:37.754448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:37.754448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:37.754448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:37.754448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:37.754448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:37.754448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:37.754448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:37.754448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:37.755576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:37.755576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:37.755576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:37.755576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:37.755576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:37.755576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:37.755576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:37.755576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:37.755576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:37.755576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:37.755576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:37.755576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:37.755576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:37.755576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:37.755576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:37.755576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:37.755576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:37.756738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:37.756738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:37.756738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:37.756738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:37.756738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:37.756738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:37.756738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:37.756738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:37.760325 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 327/661] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:37.761165 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb15fdd-247f-4437-a121-b558cd7dd924 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:37.777760 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22d0a0-10af-4159-b23b-db4ce340496c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:37.778442 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22d0a0-10af-4159-b23b-db4ce340496c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:37.778732 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22d0a0-10af-4159-b23b-db4ce340496c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:37.779012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22d0a0-10af-4159-b23b-db4ce340496c None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:37.780476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22d0a0-10af-4159-b23b-db4ce340496c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:37.780476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22d0a0-10af-4159-b23b-db4ce340496c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:37.782156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22d0a0-10af-4159-b23b-db4ce340496c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:37.804992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 335/662] 10.222.0.41 () {56 vars in 1137 bytes} [Mon May 30 11:53:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:37.804992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22d0a0-10af-4159-b23b-db4ce340496c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:37.837936 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:37.883526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb15fdd-247f-4437-a121-b558cd7dd924 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:37.911618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22d0a0-10af-4159-b23b-db4ce340496c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:37.921080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae4162-6d74-4a36-a275-b8e1d1d69ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:37.922016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae4162-6d74-4a36-a275-b8e1d1d69ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:37.922136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae4162-6d74-4a36-a275-b8e1d1d69ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:37.922489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae4162-6d74-4a36-a275-b8e1d1d69ec4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:37.934535 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae4162-6d74-4a36-a275-b8e1d1d69ec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:37.942998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-02ae4162-6d74-4a36-a275-b8e1d1d69ec4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:37.942998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:37.942998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:37.942998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:37.942998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:37.942998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:37.942998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:37.942998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:37.942998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:37.942998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:37.942998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:37.942998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:37.942998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:37.942998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:37.942998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:37.942998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:37.943944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:37.943944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:37.943944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:37.943944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:37.943944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:37.943944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:37.943944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:37.943944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:37.943944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:37.943944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:37.943944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:37.943944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:37.943944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:37.943944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:37.943944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:37.943944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:37.944862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:37.944862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:37.944862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:37.944862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:37.944862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:37.944862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:37.944862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:37.944862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:37.944862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:37.944862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:37.944862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:37.944862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:37.944862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 328/663] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:37.945527 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae4162-6d74-4a36-a275-b8e1d1d69ec4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:37.954766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069868dd-734f-4e49-8322-1325b5ca42ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:37.955575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069868dd-734f-4e49-8322-1325b5ca42ad None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:37.956123 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069868dd-734f-4e49-8322-1325b5ca42ad None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:37.956228 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069868dd-734f-4e49-8322-1325b5ca42ad None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:37.964141 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069868dd-734f-4e49-8322-1325b5ca42ad None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:37.965705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069868dd-734f-4e49-8322-1325b5ca42ad None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:37.981737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-069868dd-734f-4e49-8322-1325b5ca42ad None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 30 11:53:37.981737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:37.981737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:37.981737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:37.981737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:37.981737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:37.981737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:37.981737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:37.981737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:37.981737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:37.981737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:37.981737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:37.981737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:37.981737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:37.981737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:37.981737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:37.983317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:37.983317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:37.983317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:37.983317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:37.983317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:37.983317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:37.983317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:37.983317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:37.983317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:37.983317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:37.983317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:37.983317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:37.983317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:37.983317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:37.983317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:37.983317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:37.983317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:37.983317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:37.985473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:37.985473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:37.985473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:37.985473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:37.985473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:37.985473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:37.985473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:37.985473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:37.985473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 30 11:53:37.985473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:37.985473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 336/664] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:37.985473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069868dd-734f-4e49-8322-1325b5ca42ad None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:38.016805 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:38.059709 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae4162-6d74-4a36-a275-b8e1d1d69ec4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:38.084606 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:38.091641 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069868dd-734f-4e49-8322-1325b5ca42ad None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:38.097197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486c80e-271c-41d9-a657-5a3bc18ed7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:38.097858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486c80e-271c-41d9-a657-5a3bc18ed7ca None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:38.098140 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486c80e-271c-41d9-a657-5a3bc18ed7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:38.098414 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486c80e-271c-41d9-a657-5a3bc18ed7ca None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:38.099202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486c80e-271c-41d9-a657-5a3bc18ed7ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:38.099511 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486c80e-271c-41d9-a657-5a3bc18ed7ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:38.100985 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486c80e-271c-41d9-a657-5a3bc18ed7ca None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:38.119471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 329/665] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:38.119471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486c80e-271c-41d9-a657-5a3bc18ed7ca None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:38.132902 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05182636-467b-4544-989a-21f020f1ae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:38.133557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05182636-467b-4544-989a-21f020f1ae87 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:38.133845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05182636-467b-4544-989a-21f020f1ae87 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:38.134341 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05182636-467b-4544-989a-21f020f1ae87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:38.207327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05182636-467b-4544-989a-21f020f1ae87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:38.209150 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05182636-467b-4544-989a-21f020f1ae87 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:38.225688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486c80e-271c-41d9-a657-5a3bc18ed7ca None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:38.240844 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:38.268449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb5325-884e-4fa1-8db4-e2d55eb36ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:38.269144 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5325-884e-4fa1-8db4-e2d55eb36ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:38.269427 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5325-884e-4fa1-8db4-e2d55eb36ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:38.269708 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5325-884e-4fa1-8db4-e2d55eb36ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:38.270468 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb5325-884e-4fa1-8db4-e2d55eb36ec1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:38.270780 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb5325-884e-4fa1-8db4-e2d55eb36ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:38.272232 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb5325-884e-4fa1-8db4-e2d55eb36ec1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:38.281970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 330/666] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:53:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:38.282814 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb5325-884e-4fa1-8db4-e2d55eb36ec1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:38.323225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 337/667] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:38.324342 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05182636-467b-4544-989a-21f020f1ae87 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:38.336801 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:38.396405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb5325-884e-4fa1-8db4-e2d55eb36ec1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:38.432783 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260c0c3-39fc-4c74-ac77-7b0f81fb9ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:38.433458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260c0c3-39fc-4c74-ac77-7b0f81fb9ffd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:38.433563 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05182636-467b-4544-989a-21f020f1ae87 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:38.433739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260c0c3-39fc-4c74-ac77-7b0f81fb9ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:38.434014 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260c0c3-39fc-4c74-ac77-7b0f81fb9ffd None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:38.434845 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260c0c3-39fc-4c74-ac77-7b0f81fb9ffd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:38.435155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260c0c3-39fc-4c74-ac77-7b0f81fb9ffd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:38.437693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260c0c3-39fc-4c74-ac77-7b0f81fb9ffd None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:38.459928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 331/668] 10.222.0.41 () {56 vars in 1139 bytes} [Mon May 30 11:53:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:38.459928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260c0c3-39fc-4c74-ac77-7b0f81fb9ffd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:38.469952 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:38.476895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec8903-76c5-49d4-aa3f-e319356a4256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:38.477662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec8903-76c5-49d4-aa3f-e319356a4256 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:38.478059 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec8903-76c5-49d4-aa3f-e319356a4256 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:38.478340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec8903-76c5-49d4-aa3f-e319356a4256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:38.479180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec8903-76c5-49d4-aa3f-e319356a4256 None admin] RBAC: Adding query filter params (role.id=dc57e0b7f67947e0b6b63c4ad0148358, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=2ffa6d38c01f4820a705c06991654bb4) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:38.479667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec8903-76c5-49d4-aa3f-e319356a4256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:38.481254 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec8903-76c5-49d4-aa3f-e319356a4256 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:38.495902 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 338/669] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:53:38 2022] GET /identity/v3/role_assignments?user.id=2ffa6d38c01f4820a705c06991654bb4&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=dc57e0b7f67947e0b6b63c4ad0148358 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:38.495902 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec8903-76c5-49d4-aa3f-e319356a4256 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:38.595553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260c0c3-39fc-4c74-ac77-7b0f81fb9ffd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:38.599319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:38.638250 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec8903-76c5-49d4-aa3f-e319356a4256 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:38.639747 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e1e1e-8a4e-4d1e-8f1f-8cd02df66232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:38.641457 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e1e1e-8a4e-4d1e-8f1f-8cd02df66232 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:38.641843 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e1e1e-8a4e-4d1e-8f1f-8cd02df66232 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:38.642216 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e1e1e-8a4e-4d1e-8f1f-8cd02df66232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:38.654436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e1e1e-8a4e-4d1e-8f1f-8cd02df66232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:38.657581 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e1e1e-8a4e-4d1e-8f1f-8cd02df66232 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:38.679515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-aa5e1e1e-8a4e-4d1e-8f1f-8cd02df66232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:38.679515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:38.679515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:38.679515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:38.679515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:38.679515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:38.679515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:38.679515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:38.679515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:38.679515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:38.679515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:38.679515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:38.679515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:38.679515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:38.679515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:38.680822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:38.680822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:38.680822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:38.680822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:38.680822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:38.680822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:38.680822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:38.680822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:38.680822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:38.680822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:38.680822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:38.680822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:38.680822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:38.680822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:38.680822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:38.680822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:38.680822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:38.682129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:38.682129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:38.682129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:38.682129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:38.688205 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 332/670] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:38.689371 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e1e1e-8a4e-4d1e-8f1f-8cd02df66232 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:38.691094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bcc44-71e4-4608-a0d1-7093333b0227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:38.691963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bcc44-71e4-4608-a0d1-7093333b0227 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:38.692252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bcc44-71e4-4608-a0d1-7093333b0227 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:38.692902 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bcc44-71e4-4608-a0d1-7093333b0227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:38.711958 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bcc44-71e4-4608-a0d1-7093333b0227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:38.713119 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bcc44-71e4-4608-a0d1-7093333b0227 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:38.737506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-322bcc44-71e4-4608-a0d1-7093333b0227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:38.737506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:38.737506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:38.737506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:38.737506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:38.737506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:38.737506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:38.737506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:38.737506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:38.737506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:38.737506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:38.737506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:38.737506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:38.737506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:38.737506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:38.738463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:38.738463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:38.738463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:38.738463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:38.738463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:38.738463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:38.738463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:38.738463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:38.738463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:38.738463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:38.738463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:38.738463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:38.738463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:38.738463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:38.738463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:38.738463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:38.738463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:38.739350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:38.739350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:38.739350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:38.739350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:38.739350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 339/671] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:38.740668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bcc44-71e4-4608-a0d1-7093333b0227 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:38.813469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:38.833300 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e1e1e-8a4e-4d1e-8f1f-8cd02df66232 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:38.879868 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15114f-23ae-4628-8b90-94ed268452a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:38.881054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15114f-23ae-4628-8b90-94ed268452a1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:38.881482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15114f-23ae-4628-8b90-94ed268452a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:38.881918 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15114f-23ae-4628-8b90-94ed268452a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:38.882935 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bcc44-71e4-4608-a0d1-7093333b0227 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:38.914603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:38.927502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250d3e0-7d71-45d6-8291-d3552ec1c90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:38.928389 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250d3e0-7d71-45d6-8291-d3552ec1c90a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:38.928785 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250d3e0-7d71-45d6-8291-d3552ec1c90a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:38.929318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250d3e0-7d71-45d6-8291-d3552ec1c90a None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:38.930954 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250d3e0-7d71-45d6-8291-d3552ec1c90a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:38.931384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250d3e0-7d71-45d6-8291-d3552ec1c90a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:38.932918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250d3e0-7d71-45d6-8291-d3552ec1c90a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:38.948197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 340/672] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:38.949533 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250d3e0-7d71-45d6-8291-d3552ec1c90a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:38.973166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15114f-23ae-4628-8b90-94ed268452a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:38.975194 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15114f-23ae-4628-8b90-94ed268452a1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:39.074124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250d3e0-7d71-45d6-8291-d3552ec1c90a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:39.086745 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:39.111605 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 333/673] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:39.112979 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15114f-23ae-4628-8b90-94ed268452a1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:39.127160 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd479e-c6ad-4c39-bc0a-05f828240190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:39.128246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd479e-c6ad-4c39-bc0a-05f828240190 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:39.128629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd479e-c6ad-4c39-bc0a-05f828240190 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:39.128984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd479e-c6ad-4c39-bc0a-05f828240190 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:39.129956 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd479e-c6ad-4c39-bc0a-05f828240190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:39.130342 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd479e-c6ad-4c39-bc0a-05f828240190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:39.132480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd479e-c6ad-4c39-bc0a-05f828240190 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:39.151938 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 341/674] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:39.151938 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd479e-c6ad-4c39-bc0a-05f828240190 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:39.179943 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:39.227124 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15114f-23ae-4628-8b90-94ed268452a1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:39.267260 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af7bb1-7d3c-49da-988f-92744fa6563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:39.268866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af7bb1-7d3c-49da-988f-92744fa6563c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:39.269613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af7bb1-7d3c-49da-988f-92744fa6563c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:39.270046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af7bb1-7d3c-49da-988f-92744fa6563c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:39.280017 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af7bb1-7d3c-49da-988f-92744fa6563c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:39.281750 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af7bb1-7d3c-49da-988f-92744fa6563c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:39.285019 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd479e-c6ad-4c39-bc0a-05f828240190 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:39.297054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-60af7bb1-7d3c-49da-988f-92744fa6563c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 30 11:53:39.297054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:39.297054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:39.297054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:39.297054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:39.297054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:39.297054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:39.297054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:39.297054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:39.297054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:39.297054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:39.297054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:39.297054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:39.297054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:39.297054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:39.297054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:39.298229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:39.298229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:39.298229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:39.298229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:39.298229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:39.298229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:39.298229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:39.298229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:39.298229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:39.298229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:39.298229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:39.298229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:39.298229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:39.298229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:39.298229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:39.298229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:39.298229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:39.298229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:39.299393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:39.299393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:39.299393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:39.299393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:39.299393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:39.299393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:39.299393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:39.299393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:39.299393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 30 11:53:39.299393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:39.301336 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 334/675] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:53:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:39.302269 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af7bb1-7d3c-49da-988f-92744fa6563c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:39.332832 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57619257-e50f-4554-aed2-28085876a3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:39.334175 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57619257-e50f-4554-aed2-28085876a3ac None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:39.334615 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57619257-e50f-4554-aed2-28085876a3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:39.335290 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57619257-e50f-4554-aed2-28085876a3ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:39.349699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57619257-e50f-4554-aed2-28085876a3ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:39.351472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57619257-e50f-4554-aed2-28085876a3ac None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:39.370224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-57619257-e50f-4554-aed2-28085876a3ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:39.370224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:39.370224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:39.370224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:39.370224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:39.370224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:39.370224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:39.370224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:39.370224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:39.370224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:39.370224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:39.370224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:39.370224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:39.370224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:39.370224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:39.371604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:39.371604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:39.371604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:39.371604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:39.371604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:39.371604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:39.371604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:39.371604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:39.371604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:39.371604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:39.371604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:39.371604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:39.371604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:39.371604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:39.371604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:39.371604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:39.371604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:39.372700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:39.372700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:39.372700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:39.372700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:39.380098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 342/676] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:39.381129 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57619257-e50f-4554-aed2-28085876a3ac None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:39.415912 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:39.429842 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af7bb1-7d3c-49da-988f-92744fa6563c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:39.449183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:39.469925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b0846-579e-4349-94cb-cbb3f593725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:39.470722 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0846-579e-4349-94cb-cbb3f593725c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:39.471006 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0846-579e-4349-94cb-cbb3f593725c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:39.472039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0846-579e-4349-94cb-cbb3f593725c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:39.478937 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b0846-579e-4349-94cb-cbb3f593725c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:39.480081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b0846-579e-4349-94cb-cbb3f593725c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:39.495048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-232b0846-579e-4349-94cb-cbb3f593725c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:39.495048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:39.495048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:39.495048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:39.495048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:39.495048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:39.495048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:39.495048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:39.495048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:39.495048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:39.495048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:39.495048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:39.495048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:39.495048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:39.495048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:39.496271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:39.496271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:39.496271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:39.496271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:39.496271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:39.496271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:39.496271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:39.496271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:39.496271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:39.496271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:39.496271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:39.496271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:39.496271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:39.496271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:39.496271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:39.496271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:39.496271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:39.497147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:39.497147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:39.497147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:39.497147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:39.497147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:39.497147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:39.497147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:39.497147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:39.497147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 335/677] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:39.497625 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b0846-579e-4349-94cb-cbb3f593725c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:39.505766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57619257-e50f-4554-aed2-28085876a3ac None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:39.541114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef8106-1116-40ce-bea4-89cbe52dfb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:39.541808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef8106-1116-40ce-bea4-89cbe52dfb03 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:39.542098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef8106-1116-40ce-bea4-89cbe52dfb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:39.542371 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef8106-1116-40ce-bea4-89cbe52dfb03 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:39.543212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef8106-1116-40ce-bea4-89cbe52dfb03 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:39.543524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef8106-1116-40ce-bea4-89cbe52dfb03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:39.544988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef8106-1116-40ce-bea4-89cbe52dfb03 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:39.567828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 343/678] 10.222.0.41 () {56 vars in 1135 bytes} [Mon May 30 11:53:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:39.567828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781bf0f-2a36-4af7-9f81-e7825181cee8 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:39.567828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781bf0f-2a36-4af7-9f81-e7825181cee8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:39.567828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781bf0f-2a36-4af7-9f81-e7825181cee8 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:39.570733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 344/679] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:39.571536 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781bf0f-2a36-4af7-9f81-e7825181cee8 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:39.613468 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b0846-579e-4349-94cb-cbb3f593725c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:39.650569 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd480db2-cb88-4228-9234-0135f1265065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:39.651240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd480db2-cb88-4228-9234-0135f1265065 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:39.651525 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd480db2-cb88-4228-9234-0135f1265065 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:39.651802 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd480db2-cb88-4228-9234-0135f1265065 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:39.652542 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd480db2-cb88-4228-9234-0135f1265065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:39.653054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:39.653834 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd480db2-cb88-4228-9234-0135f1265065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:39.656161 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd480db2-cb88-4228-9234-0135f1265065 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:39.672995 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 336/680] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:39.672995 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd480db2-cb88-4228-9234-0135f1265065 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:39.686471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781bf0f-2a36-4af7-9f81-e7825181cee8 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:39.706950 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:39.727784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc392a-bf3e-443b-be3d-a6759fa28b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:39.728484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc392a-bf3e-443b-be3d-a6759fa28b3e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:39.728762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc392a-bf3e-443b-be3d-a6759fa28b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:39.729098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc392a-bf3e-443b-be3d-a6759fa28b3e None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:39.729822 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc392a-bf3e-443b-be3d-a6759fa28b3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:39.730131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc392a-bf3e-443b-be3d-a6759fa28b3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:39.731553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc392a-bf3e-443b-be3d-a6759fa28b3e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:39.743481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 345/681] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:39.744723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c05cc-beb9-4506-83b5-225e799d799e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:39.745011 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c05cc-beb9-4506-83b5-225e799d799e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:39.745288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c05cc-beb9-4506-83b5-225e799d799e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:39.762849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-184c05cc-beb9-4506-83b5-225e799d799e None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:39.764771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-184c05cc-beb9-4506-83b5-225e799d799e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:39.789747 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd480db2-cb88-4228-9234-0135f1265065 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:39.828310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b22c4f-3223-410a-a825-d18bd119be71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:39.828971 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b22c4f-3223-410a-a825-d18bd119be71 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:39.829258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b22c4f-3223-410a-a825-d18bd119be71 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:39.829537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b22c4f-3223-410a-a825-d18bd119be71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:39.845391 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 346/682] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:39.846568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c05cc-beb9-4506-83b5-225e799d799e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:39.914812 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b22c4f-3223-410a-a825-d18bd119be71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:39.916807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b22c4f-3223-410a-a825-d18bd119be71 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:39.926183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:39.953199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:39.963616 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c05cc-beb9-4506-83b5-225e799d799e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:40.004430 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50e395-1b8d-4d69-b189-7eae16d19eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:40.009891 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50e395-1b8d-4d69-b189-7eae16d19eaf None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:40.010367 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50e395-1b8d-4d69-b189-7eae16d19eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:40.012824 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50e395-1b8d-4d69-b189-7eae16d19eaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:40.020508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50e395-1b8d-4d69-b189-7eae16d19eaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:40.022067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50e395-1b8d-4d69-b189-7eae16d19eaf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:40.035440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 337/683] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:40.035440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b22c4f-3223-410a-a825-d18bd119be71 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:40.036012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-5c50e395-1b8d-4d69-b189-7eae16d19eaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:40.036012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:40.036012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:40.036012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:40.036012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:40.036012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:40.036012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:40.036012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:40.036012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:40.036012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:40.036012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:40.036012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:40.036012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:40.036012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:40.036012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:40.036970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:40.036970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:40.036970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:40.036970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:40.036970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:40.036970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:40.036970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:40.036970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:40.036970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:40.036970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:40.036970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:40.036970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:40.036970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:40.036970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:40.036970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:40.036970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:40.036970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:40.042561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:40.042561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:40.042561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:40.042561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:40.042561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:40.042561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:40.042561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:40.042561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:40.042561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 347/684] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:40.042561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50e395-1b8d-4d69-b189-7eae16d19eaf None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:40.144097 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50e395-1b8d-4d69-b189-7eae16d19eaf None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:40.146888 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b22c4f-3223-410a-a825-d18bd119be71 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:40.170490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:40.180225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d223f36-4890-4cb3-a842-c1ca98cf6517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:40.181210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d223f36-4890-4cb3-a842-c1ca98cf6517 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:40.181643 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d223f36-4890-4cb3-a842-c1ca98cf6517 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:40.182088 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d223f36-4890-4cb3-a842-c1ca98cf6517 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:40.185158 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fc2b7-1cbc-4631-9340-7317de218ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:40.186352 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fc2b7-1cbc-4631-9340-7317de218ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:40.186641 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fc2b7-1cbc-4631-9340-7317de218ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:40.186919 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fc2b7-1cbc-4631-9340-7317de218ab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:40.187762 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fc2b7-1cbc-4631-9340-7317de218ab1 None admin] RBAC: Adding query filter params (role.id=dc57e0b7f67947e0b6b63c4ad0148358, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=ca1110aeeded4ab0b6fa2aedfa8740c3) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:40.188124 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fc2b7-1cbc-4631-9340-7317de218ab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:40.189579 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fc2b7-1cbc-4631-9340-7317de218ab1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:40.192928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:40.195393 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d223f36-4890-4cb3-a842-c1ca98cf6517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:40.204211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-0d223f36-4890-4cb3-a842-c1ca98cf6517 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:53:40.204211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:40.204211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:40.204211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:40.204211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:40.204211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:40.204211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:40.204211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:40.204211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:40.204211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:40.204211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:40.204211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:40.204211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:40.204211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:40.204211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:40.204211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:40.205214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:40.205214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:40.205214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:40.205214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:40.205214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:40.205214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:40.205214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:40.205214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:40.205214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:40.205214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:40.205214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:40.205214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:40.205214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:40.205214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:40.205214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:40.205214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:40.206045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:40.206045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:40.206045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:40.206045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:40.206045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:40.206045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:40.206045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:40.206045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:40.206045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:40.206045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:40.206045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:53:40.206045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:40.207493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 338/685] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:53:40 2022] GET /identity/v3/role_assignments?user.id=ca1110aeeded4ab0b6fa2aedfa8740c3&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=dc57e0b7f67947e0b6b63c4ad0148358 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:40.208753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fc2b7-1cbc-4631-9340-7317de218ab1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:40.210199 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 348/686] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:53:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:40.220235 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d223f36-4890-4cb3-a842-c1ca98cf6517 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:40.351972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d223f36-4890-4cb3-a842-c1ca98cf6517 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:40.362544 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fc2b7-1cbc-4631-9340-7317de218ab1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:40.402386 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736f7e7-52c6-4792-a3d0-21c9c440c97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:40.403114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736f7e7-52c6-4792-a3d0-21c9c440c97a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:40.403351 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736f7e7-52c6-4792-a3d0-21c9c440c97a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:40.403470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea54a49-36bf-41f5-88fc-4a9452390e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:40.403631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736f7e7-52c6-4792-a3d0-21c9c440c97a None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:40.404396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea54a49-36bf-41f5-88fc-4a9452390e67 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:40.404538 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736f7e7-52c6-4792-a3d0-21c9c440c97a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:40.404869 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736f7e7-52c6-4792-a3d0-21c9c440c97a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:40.405102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea54a49-36bf-41f5-88fc-4a9452390e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:40.405328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea54a49-36bf-41f5-88fc-4a9452390e67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:40.406401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736f7e7-52c6-4792-a3d0-21c9c440c97a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:40.419764 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea54a49-36bf-41f5-88fc-4a9452390e67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:40.421930 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea54a49-36bf-41f5-88fc-4a9452390e67 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:40.422774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 349/687] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:40.427645 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736f7e7-52c6-4792-a3d0-21c9c440c97a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:40.447285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-5ea54a49-36bf-41f5-88fc-4a9452390e67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:40.447285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:40.447285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:40.447285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:40.447285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:40.447285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:40.447285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:40.447285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:40.447285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:40.447285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:40.447285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:40.447285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:40.447285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:40.447285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:40.447285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:40.448295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:40.448295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:40.448295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:40.448295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:40.448295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:40.448295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:40.448295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:40.448295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:40.448295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:40.448295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:40.448295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:40.448295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:40.448295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:40.448295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:40.448295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:40.448295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:40.448295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:40.449188 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:40.449188 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:40.449188 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:40.449188 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:40.449188 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 339/688] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:40.449471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea54a49-36bf-41f5-88fc-4a9452390e67 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:40.489510 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:40.519173 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:40.556041 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736f7e7-52c6-4792-a3d0-21c9c440c97a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:40.578673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea54a49-36bf-41f5-88fc-4a9452390e67 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:40.594734 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0437a5-b384-4fc6-9d19-341f9b3d002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:40.595575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0437a5-b384-4fc6-9d19-341f9b3d002f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:40.596043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0437a5-b384-4fc6-9d19-341f9b3d002f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:40.596426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0437a5-b384-4fc6-9d19-341f9b3d002f None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:40.597323 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0437a5-b384-4fc6-9d19-341f9b3d002f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:40.597745 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0437a5-b384-4fc6-9d19-341f9b3d002f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:40.599385 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0437a5-b384-4fc6-9d19-341f9b3d002f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:40.610561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 350/689] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:40.611772 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0437a5-b384-4fc6-9d19-341f9b3d002f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:40.634246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93763ab4-10c7-4de6-9081-3886b04cd074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:40.634911 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93763ab4-10c7-4de6-9081-3886b04cd074 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:40.635199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93763ab4-10c7-4de6-9081-3886b04cd074 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:40.635474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93763ab4-10c7-4de6-9081-3886b04cd074 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:40.636364 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93763ab4-10c7-4de6-9081-3886b04cd074 None admin] RBAC: Adding query filter params (role.id=dc57e0b7f67947e0b6b63c4ad0148358, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=ae7bc0d4fd924bfb89f874d1c6fc3d4b) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:40.636775 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93763ab4-10c7-4de6-9081-3886b04cd074 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:40.639202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93763ab4-10c7-4de6-9081-3886b04cd074 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:40.647795 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 340/690] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:53:40 2022] GET /identity/v3/role_assignments?user.id=ae7bc0d4fd924bfb89f874d1c6fc3d4b&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=dc57e0b7f67947e0b6b63c4ad0148358 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:40.648722 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93763ab4-10c7-4de6-9081-3886b04cd074 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:40.777469 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93763ab4-10c7-4de6-9081-3886b04cd074 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:40.816222 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:40.832461 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0437a5-b384-4fc6-9d19-341f9b3d002f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:40.852675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:40.854624 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fa220-806d-432a-b9f0-6db4c7f2d27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:40.855560 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fa220-806d-432a-b9f0-6db4c7f2d27d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:40.856896 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fa220-806d-432a-b9f0-6db4c7f2d27d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:40.856896 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fa220-806d-432a-b9f0-6db4c7f2d27d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:40.885100 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fa220-806d-432a-b9f0-6db4c7f2d27d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:40.886508 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fa220-806d-432a-b9f0-6db4c7f2d27d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:40.902108 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf0fe3-67ef-451d-9a78-f069f6c3f986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:40.902788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf0fe3-67ef-451d-9a78-f069f6c3f986 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:40.903070 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf0fe3-67ef-451d-9a78-f069f6c3f986 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:40.903344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf0fe3-67ef-451d-9a78-f069f6c3f986 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:40.904111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf0fe3-67ef-451d-9a78-f069f6c3f986 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:40.904925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf0fe3-67ef-451d-9a78-f069f6c3f986 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:40.906684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf0fe3-67ef-451d-9a78-f069f6c3f986 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:40.906952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-2f8fa220-806d-432a-b9f0-6db4c7f2d27d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:40.906952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:40.906952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:40.906952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:40.906952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:40.906952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:40.906952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:40.906952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:40.906952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:40.906952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:40.906952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:40.906952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:40.906952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:40.906952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:40.906952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:40.907797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:40.907797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:40.907797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:40.907797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:40.907797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:40.907797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:40.907797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:40.907797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:40.907797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:40.907797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:40.907797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:40.907797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:40.907797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:40.907797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:40.907797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:40.907797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:40.907797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:40.908847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:40.908847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:40.908847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:40.908847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:40.908847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 341/691] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:40.913847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fa220-806d-432a-b9f0-6db4c7f2d27d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:40.931676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 351/692] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:40.934176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf0fe3-67ef-451d-9a78-f069f6c3f986 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:41.042996 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fa220-806d-432a-b9f0-6db4c7f2d27d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:41.059246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf0fe3-67ef-451d-9a78-f069f6c3f986 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:41.082705 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa9dcd-766b-4ecb-a329-9abe90be65f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:41.083622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa9dcd-766b-4ecb-a329-9abe90be65f9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:41.084085 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa9dcd-766b-4ecb-a329-9abe90be65f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:41.084513 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa9dcd-766b-4ecb-a329-9abe90be65f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:41.085391 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa9dcd-766b-4ecb-a329-9abe90be65f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:41.085874 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa9dcd-766b-4ecb-a329-9abe90be65f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:41.087395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa9dcd-766b-4ecb-a329-9abe90be65f9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:41.097536 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab493d-0320-4622-9f95-0434ebef20f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:41.098569 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab493d-0320-4622-9f95-0434ebef20f5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:41.098741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab493d-0320-4622-9f95-0434ebef20f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:41.099077 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab493d-0320-4622-9f95-0434ebef20f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:41.106646 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab493d-0320-4622-9f95-0434ebef20f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:41.106849 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 342/693] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:41.108444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab493d-0320-4622-9f95-0434ebef20f5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:41.108628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac1d06-f9ea-4cad-94a7-1ea2e954b9fc None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:41.109280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac1d06-f9ea-4cad-94a7-1ea2e954b9fc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:41.109739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac1d06-f9ea-4cad-94a7-1ea2e954b9fc None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:41.111242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 343/694] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:41.112186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac1d06-f9ea-4cad-94a7-1ea2e954b9fc None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:41.124060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-30ab493d-0320-4622-9f95-0434ebef20f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:41.124060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:41.124060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:41.124060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:41.124060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:41.124060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:41.124060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:41.124060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:41.124060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:41.124060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:41.124060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:41.124060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:41.124060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:41.124060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:41.124060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:41.125006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:41.125006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:41.125006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:41.125006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:41.125006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:41.125006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:41.125006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:41.125006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:41.125006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:41.125006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:41.125006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:41.125006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:41.125006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:41.125006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:41.125006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:41.125006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:41.125006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:41.125882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:41.125882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:41.125882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:41.125882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:41.125882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:41.125882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:41.125882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:41.125882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:41.130031 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 352/695] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:41.131572 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44377c-406a-4e50-aec2-cd18d9422937 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:41.131886 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44377c-406a-4e50-aec2-cd18d9422937 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:41.132173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44377c-406a-4e50-aec2-cd18d9422937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:41.148610 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:41.151963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9f44377c-406a-4e50-aec2-cd18d9422937 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:41.153426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9f44377c-406a-4e50-aec2-cd18d9422937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:41.204223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:41.227969 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac1d06-f9ea-4cad-94a7-1ea2e954b9fc None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:41.229001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 353/696] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:41.230174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44377c-406a-4e50-aec2-cd18d9422937 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:41.264874 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627e3fd-96be-40fa-a987-cd61587a1149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:41.265986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627e3fd-96be-40fa-a987-cd61587a1149 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:41.266471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627e3fd-96be-40fa-a987-cd61587a1149 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:41.266940 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627e3fd-96be-40fa-a987-cd61587a1149 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:41.274663 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627e3fd-96be-40fa-a987-cd61587a1149 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:41.276164 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627e3fd-96be-40fa-a987-cd61587a1149 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:41.291046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-6627e3fd-96be-40fa-a987-cd61587a1149 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 30 11:53:41.291046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:41.291046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:41.291046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:41.291046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:41.291046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:41.291046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:41.291046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:41.291046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:41.291046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:41.291046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:41.291046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:41.291046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:41.291046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:41.291046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:41.291046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:41.292214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:41.292214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:41.292214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:41.292214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:41.292214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:41.292214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:41.292214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:41.292214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:41.292214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:41.292214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:41.292214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:41.292214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:41.292214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:41.292214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:41.292214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:41.292214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:41.292214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:41.292214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:41.293182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:41.293182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:41.293182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:41.293182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:41.293182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:41.293182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:41.293182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:41.293182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:41.293182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 30 11:53:41.293182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:41.293182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 344/697] 10.222.0.41 () {56 vars in 1093 bytes} [Mon May 30 11:53:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:41.293762 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627e3fd-96be-40fa-a987-cd61587a1149 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:41.344603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44377c-406a-4e50-aec2-cd18d9422937 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:41.382859 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ec452-96e1-4839-8441-2cc07f445c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:41.383701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ec452-96e1-4839-8441-2cc07f445c19 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:41.384079 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ec452-96e1-4839-8441-2cc07f445c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:41.384425 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ec452-96e1-4839-8441-2cc07f445c19 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:41.385401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ec452-96e1-4839-8441-2cc07f445c19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:41.385780 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ec452-96e1-4839-8441-2cc07f445c19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:41.387512 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ec452-96e1-4839-8441-2cc07f445c19 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:41.395551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:41.406837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 354/698] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:41.407729 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ec452-96e1-4839-8441-2cc07f445c19 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:41.408600 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627e3fd-96be-40fa-a987-cd61587a1149 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:41.429609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:41.449082 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee4ff2-da7d-45e7-aeb9-5392746f7bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:41.450243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee4ff2-da7d-45e7-aeb9-5392746f7bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:41.450738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee4ff2-da7d-45e7-aeb9-5392746f7bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:41.451213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee4ff2-da7d-45e7-aeb9-5392746f7bf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:41.462495 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee4ff2-da7d-45e7-aeb9-5392746f7bf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:41.464258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee4ff2-da7d-45e7-aeb9-5392746f7bf5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:41.484539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d1ee4ff2-da7d-45e7-aeb9-5392746f7bf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:41.484539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:41.484539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:41.484539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:41.484539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:41.484539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:41.484539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:41.484539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:41.484539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:41.484539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:41.484539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:41.484539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:41.484539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:41.484539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:41.484539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:41.485458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:41.485458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:41.485458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:41.485458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:41.485458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:41.485458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:41.485458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:41.485458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:41.485458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:41.485458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:41.485458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:41.485458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:41.485458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:41.485458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:41.485458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:41.485458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:41.485458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:41.486358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:41.486358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:41.486358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:41.486358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:41.488721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 345/699] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:41.489791 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee4ff2-da7d-45e7-aeb9-5392746f7bf5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:41.522891 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ec452-96e1-4839-8441-2cc07f445c19 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:41.560496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cd8a0-8022-47a0-8471-1d3d80a813bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:41.561749 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cd8a0-8022-47a0-8471-1d3d80a813bd None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:41.562031 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cd8a0-8022-47a0-8471-1d3d80a813bd None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:41.562308 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cd8a0-8022-47a0-8471-1d3d80a813bd None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:41.563270 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cd8a0-8022-47a0-8471-1d3d80a813bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:41.563594 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cd8a0-8022-47a0-8471-1d3d80a813bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:41.565185 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cd8a0-8022-47a0-8471-1d3d80a813bd None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:41.589896 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 355/700] 10.222.0.41 () {56 vars in 1133 bytes} [Mon May 30 11:53:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:41.589896 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cd8a0-8022-47a0-8471-1d3d80a813bd None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:41.615479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee4ff2-da7d-45e7-aeb9-5392746f7bf5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:41.655963 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8fe50-eac9-42a6-822d-a01116b63a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:41.657572 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8fe50-eac9-42a6-822d-a01116b63a37 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:41.658134 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8fe50-eac9-42a6-822d-a01116b63a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:41.658617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8fe50-eac9-42a6-822d-a01116b63a37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:41.659654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8fe50-eac9-42a6-822d-a01116b63a37 None admin] RBAC: Adding query filter params (role.id=dc57e0b7f67947e0b6b63c4ad0148358, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=83e5f980cdb74227bb31c7e7e5eab74b) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:41.660243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8fe50-eac9-42a6-822d-a01116b63a37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:41.662067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8fe50-eac9-42a6-822d-a01116b63a37 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:41.671928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 346/701] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:53:41 2022] GET /identity/v3/role_assignments?user.id=83e5f980cdb74227bb31c7e7e5eab74b&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=dc57e0b7f67947e0b6b63c4ad0148358 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:41.673111 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8fe50-eac9-42a6-822d-a01116b63a37 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:41.677761 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:41.678383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:41.733407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cd8a0-8022-47a0-8471-1d3d80a813bd None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:41.814098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc545f-f200-4176-952f-3352738fef56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:41.814786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc545f-f200-4176-952f-3352738fef56 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:41.815073 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc545f-f200-4176-952f-3352738fef56 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:41.815351 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc545f-f200-4176-952f-3352738fef56 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:41.816125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc545f-f200-4176-952f-3352738fef56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:41.816439 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc545f-f200-4176-952f-3352738fef56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:41.817842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc545f-f200-4176-952f-3352738fef56 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:41.846937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 356/702] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:41.853585 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc545f-f200-4176-952f-3352738fef56 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:41.861547 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8fe50-eac9-42a6-822d-a01116b63a37 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:41.902513 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98e61f-f3a3-4cd4-940d-79c781493150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:41.903448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98e61f-f3a3-4cd4-940d-79c781493150 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:41.903740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98e61f-f3a3-4cd4-940d-79c781493150 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:41.904055 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98e61f-f3a3-4cd4-940d-79c781493150 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:41.998541 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98e61f-f3a3-4cd4-940d-79c781493150 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:42.000521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98e61f-f3a3-4cd4-940d-79c781493150 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:42.004922 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:42.012820 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc545f-f200-4176-952f-3352738fef56 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:42.051692 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c88db9-2ebc-4e7d-bc3c-bdd6d2b41bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:42.052409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c88db9-2ebc-4e7d-bc3c-bdd6d2b41bb6 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:42.052700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c88db9-2ebc-4e7d-bc3c-bdd6d2b41bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:42.052983 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c88db9-2ebc-4e7d-bc3c-bdd6d2b41bb6 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:42.053987 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c88db9-2ebc-4e7d-bc3c-bdd6d2b41bb6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:42.055384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c88db9-2ebc-4e7d-bc3c-bdd6d2b41bb6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:42.065575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:42.085551 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 357/703] 10.222.0.41 () {60 vars in 1132 bytes} [Mon May 30 11:53:41 2022] POST /identity/v3/users => generated 254 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:53:42.134754 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 347/704] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:42.140782 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c88db9-2ebc-4e7d-bc3c-bdd6d2b41bb6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:42.278673 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c88db9-2ebc-4e7d-bc3c-bdd6d2b41bb6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:42.330688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b80271-6687-4b94-ab8a-5f39ece2202b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:42.331507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b80271-6687-4b94-ab8a-5f39ece2202b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:42.331794 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b80271-6687-4b94-ab8a-5f39ece2202b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:42.332099 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b80271-6687-4b94-ab8a-5f39ece2202b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:42.346785 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b80271-6687-4b94-ab8a-5f39ece2202b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:42.352632 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b80271-6687-4b94-ab8a-5f39ece2202b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:42.373015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f0b80271-6687-4b94-ab8a-5f39ece2202b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:42.373015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:42.373015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:42.373015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:42.373015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:42.373015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:42.373015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:42.373015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:42.373015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:42.373015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:42.373015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:42.373015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:42.373015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:42.373015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:42.373015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:42.374030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:42.374030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:42.374030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:42.374030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:42.374030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:42.374030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:42.374030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:42.374030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:42.374030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:42.374030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:42.374030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:42.374030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:42.374030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:42.374030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:42.374030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:42.374030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:42.374030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:42.375149 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:42.375149 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:42.375149 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:42.375149 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:42.375149 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 358/705] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:42.380134 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98e61f-f3a3-4cd4-940d-79c781493150 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:42.534410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98e61f-f3a3-4cd4-940d-79c781493150 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:42.538659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:42.590528 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a062b-f8b9-47b0-92f0-a0b982b0af27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:42.591212 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a062b-f8b9-47b0-92f0-a0b982b0af27 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:42.591499 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a062b-f8b9-47b0-92f0-a0b982b0af27 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:42.591780 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a062b-f8b9-47b0-92f0-a0b982b0af27 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:42.592716 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a062b-f8b9-47b0-92f0-a0b982b0af27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:42.593031 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a062b-f8b9-47b0-92f0-a0b982b0af27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:42.594433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a062b-f8b9-47b0-92f0-a0b982b0af27 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:42.609903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 348/706] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:42.615022 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b80271-6687-4b94-ab8a-5f39ece2202b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:42.674172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:42.734201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b80271-6687-4b94-ab8a-5f39ece2202b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:42.781444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6361eee-a204-4fc3-8e19-b16dd063bb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:42.787918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6361eee-a204-4fc3-8e19-b16dd063bb2e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:42.787918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6361eee-a204-4fc3-8e19-b16dd063bb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:42.787918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6361eee-a204-4fc3-8e19-b16dd063bb2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:42.791192 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6361eee-a204-4fc3-8e19-b16dd063bb2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:42.792689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6361eee-a204-4fc3-8e19-b16dd063bb2e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:42.794207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22ffc5-6d73-4396-bd6b-63a324c201e3 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:42.794659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22ffc5-6d73-4396-bd6b-63a324c201e3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:42.794823 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22ffc5-6d73-4396-bd6b-63a324c201e3 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:42.797179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 349/707] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:42.802447 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3641bb-4048-4d3d-aacc-3aa5db023e62 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:42.802745 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3641bb-4048-4d3d-aacc-3aa5db023e62 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:42.803031 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3641bb-4048-4d3d-aacc-3aa5db023e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:42.811482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-e6361eee-a204-4fc3-8e19-b16dd063bb2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:42.811482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:42.811482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:42.811482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:42.811482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:42.811482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:42.811482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:42.811482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:42.811482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:42.811482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:42.811482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:42.811482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:42.811482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:42.811482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:42.811482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:42.812412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:42.812412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:42.812412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:42.812412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:42.812412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:42.812412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:42.812412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:42.812412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:42.812412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:42.812412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:42.812412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:42.812412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:42.812412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:42.812412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:42.812412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:42.812412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:42.812412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:42.813743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:42.813743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:42.813743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:42.813743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:42.813743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:42.813743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:42.813743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:42.813743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:42.813743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 359/708] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:42.820712 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6361eee-a204-4fc3-8e19-b16dd063bb2e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:42.825048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1f3641bb-4048-4d3d-aacc-3aa5db023e62 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:42.826771 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1f3641bb-4048-4d3d-aacc-3aa5db023e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:42.899653 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 350/709] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:42.924456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3641bb-4048-4d3d-aacc-3aa5db023e62 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:43.036551 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6361eee-a204-4fc3-8e19-b16dd063bb2e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:43.039022 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:43.075143 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ca259-9486-4b42-bec1-80400397f571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:43.075938 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ca259-9486-4b42-bec1-80400397f571 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:43.076127 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ca259-9486-4b42-bec1-80400397f571 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:43.076466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ca259-9486-4b42-bec1-80400397f571 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:43.077327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ca259-9486-4b42-bec1-80400397f571 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:43.077649 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ca259-9486-4b42-bec1-80400397f571 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:43.079388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ca259-9486-4b42-bec1-80400397f571 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:43.091517 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 360/710] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:43.096190 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:43.097910 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ca259-9486-4b42-bec1-80400397f571 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:43.111549 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3641bb-4048-4d3d-aacc-3aa5db023e62 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:43.201578 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3a361-2505-44fc-b3ae-2c8b9cd70cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:43.202379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3a361-2505-44fc-b3ae-2c8b9cd70cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:43.202667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3a361-2505-44fc-b3ae-2c8b9cd70cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:43.202945 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3a361-2505-44fc-b3ae-2c8b9cd70cf3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:43.203607 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3a361-2505-44fc-b3ae-2c8b9cd70cf3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:43.204184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ca259-9486-4b42-bec1-80400397f571 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:43.205080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3a361-2505-44fc-b3ae-2c8b9cd70cf3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:43.233466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d6b3a361-2505-44fc-b3ae-2c8b9cd70cf3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 30 11:53:43.233466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:43.233466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:53:43.233466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:53:43.233466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:53:43.233466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:53:43.233466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:53:43.233466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:53:43.233466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 30 11:53:43.233466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:43.233466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:53:43.233466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:43.233466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:43.233466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:43.233466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:43.233466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:43.234471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:43.234471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:43.234471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:43.234471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:43.234471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:43.234471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:43.234471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:43.234471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:53:43.234471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:53:43.234471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:53:43.234471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:53:43.234471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:43.234471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:43.234471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:43.234471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:43.234471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:43.235309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:43.235309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:43.235309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:43.235309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:43.235309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:43.235309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:43.235309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:43.235309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:43.235309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:43.235309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:43.235309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:43.235309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:53:43.235309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:53:43.235309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 30 11:53:43.235309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:43.239972 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 351/711] 10.222.0.41 () {56 vars in 1129 bytes} [Mon May 30 11:53:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:53:43.247481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dea0e2-5b6b-4dca-b0fe-dfcc47a2ca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:43.248704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dea0e2-5b6b-4dca-b0fe-dfcc47a2ca87 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:43.248990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dea0e2-5b6b-4dca-b0fe-dfcc47a2ca87 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:43.249277 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dea0e2-5b6b-4dca-b0fe-dfcc47a2ca87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:43.250124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dea0e2-5b6b-4dca-b0fe-dfcc47a2ca87 None admin] RBAC: Adding query filter params (role.id=8196ef570097443bac15d3cf39878486, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=bb3820a613744c15b840681fe6b6e808) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:43.250489 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dea0e2-5b6b-4dca-b0fe-dfcc47a2ca87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:43.252128 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dea0e2-5b6b-4dca-b0fe-dfcc47a2ca87 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:43.258580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 361/712] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:53:43 2022] GET /identity/v3/role_assignments?user.id=bb3820a613744c15b840681fe6b6e808&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=8196ef570097443bac15d3cf39878486 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:43.265645 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3a361-2505-44fc-b3ae-2c8b9cd70cf3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:43.376327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f66505-50b8-4d1a-afd1-fffc88f6be14 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:43.376521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f66505-50b8-4d1a-afd1-fffc88f6be14 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:43.376816 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f66505-50b8-4d1a-afd1-fffc88f6be14 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:43.378584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 362/713] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:43.387218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd77c6d-78c9-4827-95b2-2699e8b131ba None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:43.387751 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd77c6d-78c9-4827-95b2-2699e8b131ba None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:43.388209 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd77c6d-78c9-4827-95b2-2699e8b131ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:43.417495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2cd77c6d-78c9-4827-95b2-2699e8b131ba None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:43.420636 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2cd77c6d-78c9-4827-95b2-2699e8b131ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:43.458396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3a361-2505-44fc-b3ae-2c8b9cd70cf3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:43.470818 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:43.520240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fde51a-73cc-4178-9dce-782752bc4f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:43.521275 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fde51a-73cc-4178-9dce-782752bc4f2c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:43.521754 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fde51a-73cc-4178-9dce-782752bc4f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:43.522207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fde51a-73cc-4178-9dce-782752bc4f2c None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:43.523098 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fde51a-73cc-4178-9dce-782752bc4f2c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:43.523585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fde51a-73cc-4178-9dce-782752bc4f2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:43.525177 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fde51a-73cc-4178-9dce-782752bc4f2c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:43.530620 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 352/714] 10.222.0.41 () {56 vars in 1124 bytes} [Mon May 30 11:53:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:43.536044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fde51a-73cc-4178-9dce-782752bc4f2c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:43.542294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 363/715] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:53:43.562831 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:43.582715 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd77c6d-78c9-4827-95b2-2699e8b131ba None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:43.647142 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fde51a-73cc-4178-9dce-782752bc4f2c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:43.686579 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f6f2f-cf24-4094-a43f-0cd2ed95624c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:43.687744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f6f2f-cf24-4094-a43f-0cd2ed95624c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:43.688234 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f6f2f-cf24-4094-a43f-0cd2ed95624c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:43.688691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f6f2f-cf24-4094-a43f-0cd2ed95624c None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:43.689593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f6f2f-cf24-4094-a43f-0cd2ed95624c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:43.690077 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f6f2f-cf24-4094-a43f-0cd2ed95624c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:43.691620 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f6f2f-cf24-4094-a43f-0cd2ed95624c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:43.698662 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 353/716] 10.222.0.41 () {56 vars in 1124 bytes} [Mon May 30 11:53:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:43.750944 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd77c6d-78c9-4827-95b2-2699e8b131ba None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:43.788956 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6baa4c-b9d9-47bb-b7d5-d86ed8167a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:43.789769 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6baa4c-b9d9-47bb-b7d5-d86ed8167a17 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:43.790051 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6baa4c-b9d9-47bb-b7d5-d86ed8167a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:43.790328 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6baa4c-b9d9-47bb-b7d5-d86ed8167a17 None admin] PATH_INFO: `/v3/services/network` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:43.791004 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6baa4c-b9d9-47bb-b7d5-d86ed8167a17 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:43.792417 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6baa4c-b9d9-47bb-b7d5-d86ed8167a17 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:43.807318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-6d6baa4c-b9d9-47bb-b7d5-d86ed8167a17 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 30 11:53:43.807318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:43.807318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:53:43.807318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:53:43.807318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:53:43.807318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:53:43.807318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:53:43.807318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:53:43.807318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 30 11:53:43.807318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:43.807318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:53:43.807318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:43.807318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:43.807318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:43.807318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:43.807318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:43.807318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:43.808443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:43.808443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:43.808443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:43.808443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:43.808443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:43.808443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:43.808443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:53:43.808443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:53:43.808443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:53:43.808443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:53:43.808443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:43.808443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:43.808443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:43.808443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:43.808443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:43.808443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:43.809273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:43.809273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:43.809273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:43.809273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:43.809273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:43.809273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:43.809273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:43.809273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:43.809273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:43.809273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:43.809273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:53:43.809273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:53:43.809273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 30 11:53:43.809273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:43.809273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 364/717] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:43 2022] GET /identity/v3/services/network => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:43.817017 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f6f2f-cf24-4094-a43f-0cd2ed95624c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:43.956295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:43.970590 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f6f2f-cf24-4094-a43f-0cd2ed95624c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:44.017324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48654c54-6399-4e33-89d5-996a234d2d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:44.018009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48654c54-6399-4e33-89d5-996a234d2d5e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:44.018292 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48654c54-6399-4e33-89d5-996a234d2d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:44.018573 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48654c54-6399-4e33-89d5-996a234d2d5e None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:44.019289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48654c54-6399-4e33-89d5-996a234d2d5e None admin] RBAC: Adding query filter params (name=network) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:44.019600 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48654c54-6399-4e33-89d5-996a234d2d5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:44.021019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48654c54-6399-4e33-89d5-996a234d2d5e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:44.026297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 354/718] 10.222.0.41 () {56 vars in 1112 bytes} [Mon May 30 11:53:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:44.032483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6baa4c-b9d9-47bb-b7d5-d86ed8167a17 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:44.066895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:44.166206 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6baa4c-b9d9-47bb-b7d5-d86ed8167a17 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:44.206915 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc82ae-6fac-46c0-944f-40302a974cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:44.207519 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc82ae-6fac-46c0-944f-40302a974cea None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:44.207808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc82ae-6fac-46c0-944f-40302a974cea None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:44.208116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc82ae-6fac-46c0-944f-40302a974cea None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:44.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc82ae-6fac-46c0-944f-40302a974cea None admin] RBAC: Adding query filter params (type=network) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:44.209149 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc82ae-6fac-46c0-944f-40302a974cea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:44.210542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc82ae-6fac-46c0-944f-40302a974cea None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:44.216656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 365/719] 10.222.0.41 () {56 vars in 1112 bytes} [Mon May 30 11:53:44 2022] GET /identity/v3/services?type=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:44.692720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b13fb3-0303-4487-a27f-f0735d378f88 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:44.693011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b13fb3-0303-4487-a27f-f0735d378f88 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:44.693573 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b13fb3-0303-4487-a27f-f0735d378f88 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:44.695394 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 355/720] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:44.700990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7b523-fc40-4333-8ee5-cd842ea92b60 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:44.701593 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7b523-fc40-4333-8ee5-cd842ea92b60 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:44.702081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7b523-fc40-4333-8ee5-cd842ea92b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:44.719857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-51b7b523-fc40-4333-8ee5-cd842ea92b60 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:44.721409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-51b7b523-fc40-4333-8ee5-cd842ea92b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:44.799434 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 366/721] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:44.823694 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b13fb3-0303-4487-a27f-f0735d378f88 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:44.952575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b13fb3-0303-4487-a27f-f0735d378f88 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:45.004013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d305de-cc9a-4e2c-8d78-b342f4e39c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:45.005064 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d305de-cc9a-4e2c-8d78-b342f4e39c16 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:45.005501 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d305de-cc9a-4e2c-8d78-b342f4e39c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:45.005929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d305de-cc9a-4e2c-8d78-b342f4e39c16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:45.024717 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d305de-cc9a-4e2c-8d78-b342f4e39c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:45.032910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-54d305de-cc9a-4e2c-8d78-b342f4e39c16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:53:45.032910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:45.032910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:45.032910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:45.032910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:45.032910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:45.032910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:45.032910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:45.032910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:45.032910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:45.032910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:45.032910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:45.032910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:45.032910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:45.032910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:45.032910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:45.034028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:45.034028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:45.034028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:45.034028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:45.034028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:45.034028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:45.034028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:45.034028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:45.034028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:45.034028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:45.034028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:45.034028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:45.034028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:45.034028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:45.034028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:45.034028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:45.035094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:45.035094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:45.035094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:45.035094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:45.035094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:45.035094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:45.035094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:45.035094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:45.035094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:45.035094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:45.035094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:53:45.035094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:45.037398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 356/722] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:53:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:45.043252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7b523-fc40-4333-8ee5-cd842ea92b60 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:45.066403 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:45.184425 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7b523-fc40-4333-8ee5-cd842ea92b60 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:45.234070 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d68c0d-16c0-49f5-aa4e-bba0bea1207a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:45.234980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d68c0d-16c0-49f5-aa4e-bba0bea1207a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:45.235415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d68c0d-16c0-49f5-aa4e-bba0bea1207a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:45.235867 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d68c0d-16c0-49f5-aa4e-bba0bea1207a None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:45.236789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d68c0d-16c0-49f5-aa4e-bba0bea1207a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:45.237248 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d68c0d-16c0-49f5-aa4e-bba0bea1207a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:45.238767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d68c0d-16c0-49f5-aa4e-bba0bea1207a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:45.252186 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 367/723] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:45.257732 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d305de-cc9a-4e2c-8d78-b342f4e39c16 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:45.272028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:45.289655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdf2ac-5e0b-4fcc-811d-9a1933dce296 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:45.289964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdf2ac-5e0b-4fcc-811d-9a1933dce296 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:45.290223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdf2ac-5e0b-4fcc-811d-9a1933dce296 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:45.291855 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 368/724] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:53:45.301616 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1409ff5-36a8-4a14-b482-9c07be3cee0c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:45.301925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1409ff5-36a8-4a14-b482-9c07be3cee0c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:45.302185 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1409ff5-36a8-4a14-b482-9c07be3cee0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:45.324740 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e1409ff5-36a8-4a14-b482-9c07be3cee0c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:45.325950 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e1409ff5-36a8-4a14-b482-9c07be3cee0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:45.442505 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d305de-cc9a-4e2c-8d78-b342f4e39c16 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:45.457712 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 369/725] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:53:45.499751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147ab06-1cd2-4bf4-8147-a509ba61f1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:45.500508 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147ab06-1cd2-4bf4-8147-a509ba61f1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:45.500795 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147ab06-1cd2-4bf4-8147-a509ba61f1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:45.501076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147ab06-1cd2-4bf4-8147-a509ba61f1d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:45.515034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1409ff5-36a8-4a14-b482-9c07be3cee0c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:45.527208 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:45.533803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147ab06-1cd2-4bf4-8147-a509ba61f1d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:45.535324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147ab06-1cd2-4bf4-8147-a509ba61f1d1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:45.565214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-1147ab06-1cd2-4bf4-8147-a509ba61f1d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:45.565214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:45.565214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:45.565214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:45.565214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:45.565214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:45.565214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:45.565214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:45.565214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:45.565214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:45.565214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:45.565214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:45.565214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:45.565214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:45.565214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:45.566265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:45.566265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:45.566265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:45.566265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:45.566265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:45.566265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:45.566265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:45.566265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:45.566265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:45.566265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:45.566265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:45.566265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:45.566265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:45.566265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:45.566265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:45.566265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:45.566265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:45.567151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:45.567151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:45.567151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:45.567151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:45.573465 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 357/726] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:45.578814 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147ab06-1cd2-4bf4-8147-a509ba61f1d1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:45.639343 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1409ff5-36a8-4a14-b482-9c07be3cee0c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:45.676447 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02dea6-142d-495b-af3f-72bcbd07bc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:45.677265 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02dea6-142d-495b-af3f-72bcbd07bc88 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:45.677556 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02dea6-142d-495b-af3f-72bcbd07bc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:45.677838 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02dea6-142d-495b-af3f-72bcbd07bc88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:45.690134 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02dea6-142d-495b-af3f-72bcbd07bc88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:45.698470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-fe02dea6-142d-495b-af3f-72bcbd07bc88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:45.698470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:45.698470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:45.698470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:45.698470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:45.698470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:45.698470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:45.698470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:45.698470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:45.698470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:45.698470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:45.698470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:45.698470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:45.698470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:45.698470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:45.698470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:45.699456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:45.699456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:45.699456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:45.699456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:45.699456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:45.699456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:45.699456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:45.699456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:45.699456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:45.699456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:45.699456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:45.699456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:45.699456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:45.699456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:45.699456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:45.699456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:45.700327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:45.700327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:45.700327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:45.700327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:45.700327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:45.700327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:45.700327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:45.700327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:45.700327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:45.700327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:45.700327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:45.700327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:45.700327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 370/727] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:53:45.706489 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02dea6-142d-495b-af3f-72bcbd07bc88 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:45.737410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:45.786623 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147ab06-1cd2-4bf4-8147-a509ba61f1d1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:45.795840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:45.831406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02dea6-142d-495b-af3f-72bcbd07bc88 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:45.858357 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029651b-3350-4e34-9cad-c47fd79612cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:45.859107 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029651b-3350-4e34-9cad-c47fd79612cb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:45.859475 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029651b-3350-4e34-9cad-c47fd79612cb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:45.859851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029651b-3350-4e34-9cad-c47fd79612cb None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:45.860667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029651b-3350-4e34-9cad-c47fd79612cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:45.861083 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029651b-3350-4e34-9cad-c47fd79612cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:45.862743 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029651b-3350-4e34-9cad-c47fd79612cb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:45.870335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4a518-dc1a-4799-90f4-9bfb7a743a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:45.871548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4a518-dc1a-4799-90f4-9bfb7a743a14 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:45.872182 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4a518-dc1a-4799-90f4-9bfb7a743a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:45.872669 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4a518-dc1a-4799-90f4-9bfb7a743a14 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:45.874287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4a518-dc1a-4799-90f4-9bfb7a743a14 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:45.874821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4a518-dc1a-4799-90f4-9bfb7a743a14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:45.876423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4a518-dc1a-4799-90f4-9bfb7a743a14 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:45.885977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 371/728] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:53:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:45.890140 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 358/729] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:45.895269 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4a518-dc1a-4799-90f4-9bfb7a743a14 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:45.895519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029651b-3350-4e34-9cad-c47fd79612cb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:46.059263 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4a518-dc1a-4799-90f4-9bfb7a743a14 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:46.065203 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029651b-3350-4e34-9cad-c47fd79612cb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:46.095865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:46.096499 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:46.108016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfafbc3-d83b-4cf2-a2f5-f6dbd102ebe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:46.109100 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfafbc3-d83b-4cf2-a2f5-f6dbd102ebe3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:46.109442 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfafbc3-d83b-4cf2-a2f5-f6dbd102ebe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:46.109823 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfafbc3-d83b-4cf2-a2f5-f6dbd102ebe3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:46.111162 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d0f4f-5bcc-4e5d-8791-2322c5660794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:46.112328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d0f4f-5bcc-4e5d-8791-2322c5660794 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:46.112761 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d0f4f-5bcc-4e5d-8791-2322c5660794 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:46.113689 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d0f4f-5bcc-4e5d-8791-2322c5660794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:46.119075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfafbc3-d83b-4cf2-a2f5-f6dbd102ebe3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:46.120779 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfafbc3-d83b-4cf2-a2f5-f6dbd102ebe3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:46.126781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d0f4f-5bcc-4e5d-8791-2322c5660794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:46.128463 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d0f4f-5bcc-4e5d-8791-2322c5660794 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:46.139934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-1dfafbc3-d83b-4cf2-a2f5-f6dbd102ebe3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 30 11:53:46.139934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:46.139934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:46.139934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:46.139934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:46.139934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:46.139934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:46.139934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:46.139934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:46.139934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:46.139934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:46.139934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:46.139934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:46.139934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:46.139934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:46.139934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:46.140946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:46.140946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:46.140946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:46.140946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:46.140946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:46.140946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:46.140946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:46.140946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:46.140946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:46.140946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:46.140946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:46.140946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:46.140946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:46.140946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:46.140946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:46.140946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:46.140946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:46.140946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:46.141868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:46.141868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:46.141868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:46.141868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:46.141868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:46.141868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:46.141868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:46.141868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:46.141868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 30 11:53:46.141868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:46.147553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 372/730] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:53:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:46.148960 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc03188-556f-44b8-9478-51be1ed3b552 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:46.149260 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc03188-556f-44b8-9478-51be1ed3b552 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:46.149542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc03188-556f-44b8-9478-51be1ed3b552 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:46.155629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 373/731] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:46.155629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc03188-556f-44b8-9478-51be1ed3b552 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:46.156152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d53d0f4f-5bcc-4e5d-8791-2322c5660794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:46.156152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:46.156152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:46.156152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:46.156152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:46.156152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:46.156152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:46.156152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:46.156152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:46.156152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:46.156152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:46.156152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:46.156152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:46.156152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:46.156152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:46.157011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:46.157011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:46.157011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:46.157011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:46.157011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:46.157011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:46.157011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:46.157011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:46.157011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:46.157011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:46.157011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:46.157011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:46.157011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:46.157011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:46.157011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:46.157011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:46.157011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:46.157888 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:46.157888 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:46.157888 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:46.157888 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:46.159358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 359/732] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:46.164150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac5041-3744-4e26-b41d-56a85a672853 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:46.165123 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac5041-3744-4e26-b41d-56a85a672853 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:46.165836 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac5041-3744-4e26-b41d-56a85a672853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:46.188327 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a8ac5041-3744-4e26-b41d-56a85a672853 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:46.190201 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a8ac5041-3744-4e26-b41d-56a85a672853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:46.277225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc03188-556f-44b8-9478-51be1ed3b552 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:46.287875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 360/733] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:46.287875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac5041-3744-4e26-b41d-56a85a672853 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:46.338167 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bd347-a6e1-4c85-9fee-8e0a326a34d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:46.339193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bd347-a6e1-4c85-9fee-8e0a326a34d6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:46.339677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bd347-a6e1-4c85-9fee-8e0a326a34d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:46.340197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bd347-a6e1-4c85-9fee-8e0a326a34d6 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:46.341264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bd347-a6e1-4c85-9fee-8e0a326a34d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:46.341816 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bd347-a6e1-4c85-9fee-8e0a326a34d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:46.343461 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bd347-a6e1-4c85-9fee-8e0a326a34d6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:46.362708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 374/734] 10.222.0.41 () {56 vars in 1135 bytes} [Mon May 30 11:53:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:46.363961 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bd347-a6e1-4c85-9fee-8e0a326a34d6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:46.417252 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac5041-3744-4e26-b41d-56a85a672853 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:46.420613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:46.421929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:46.472592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0c604-c7d4-4d91-8846-3128939cb7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:46.473306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0c604-c7d4-4d91-8846-3128939cb7cc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:46.473593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0c604-c7d4-4d91-8846-3128939cb7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:46.473872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0c604-c7d4-4d91-8846-3128939cb7cc None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:46.474879 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0c604-c7d4-4d91-8846-3128939cb7cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:46.475609 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0c604-c7d4-4d91-8846-3128939cb7cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:46.477318 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0c604-c7d4-4d91-8846-3128939cb7cc None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:46.486548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bd347-a6e1-4c85-9fee-8e0a326a34d6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:46.493850 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 361/735] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:46.494702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0c604-c7d4-4d91-8846-3128939cb7cc None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:46.528444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e517df-6031-42ab-abf4-e5e0474b9193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:46.530117 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e517df-6031-42ab-abf4-e5e0474b9193 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:46.530695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e517df-6031-42ab-abf4-e5e0474b9193 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:46.531139 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e517df-6031-42ab-abf4-e5e0474b9193 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:46.545797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e517df-6031-42ab-abf4-e5e0474b9193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:46.555741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f0e517df-6031-42ab-abf4-e5e0474b9193 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:53:46.555741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:46.555741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:46.555741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:46.555741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:46.555741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:46.555741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:46.555741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:46.555741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:46.555741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:46.555741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:46.555741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:46.555741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:46.555741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:46.555741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:46.555741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:46.556723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:46.556723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:46.556723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:46.556723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:46.556723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:46.556723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:46.556723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:46.556723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:46.556723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:46.556723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:46.556723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:46.556723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:46.556723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:46.556723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:46.556723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:46.556723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:46.557559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:46.557559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:46.557559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:46.557559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:46.557559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:46.557559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:46.557559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:46.557559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:46.557559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:46.557559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:46.557559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:53:46.557559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:46.565288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 375/736] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:53:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:46.565288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e517df-6031-42ab-abf4-e5e0474b9193 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:46.628301 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0c604-c7d4-4d91-8846-3128939cb7cc None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:46.672556 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814916c-33f8-4fc4-81ed-34890a21665d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:46.673803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814916c-33f8-4fc4-81ed-34890a21665d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:46.674289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814916c-33f8-4fc4-81ed-34890a21665d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:46.674795 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814916c-33f8-4fc4-81ed-34890a21665d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:46.679673 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e517df-6031-42ab-abf4-e5e0474b9193 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:46.689808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:46.712988 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:46.718976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f5287-9ddd-497b-9b73-686ba0883852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:46.719383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f5287-9ddd-497b-9b73-686ba0883852 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:46.719878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f5287-9ddd-497b-9b73-686ba0883852 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:46.720301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f5287-9ddd-497b-9b73-686ba0883852 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:46.728538 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f5287-9ddd-497b-9b73-686ba0883852 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:46.729977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f5287-9ddd-497b-9b73-686ba0883852 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:46.746613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-dd3f5287-9ddd-497b-9b73-686ba0883852 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:53:46.746613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:46.746613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:46.746613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:46.746613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:46.746613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:46.746613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:46.746613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:46.746613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:46.746613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:46.746613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:46.746613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:46.746613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:46.746613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:46.746613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:46.746613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:46.747613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:46.747613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:46.747613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:46.747613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:46.747613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:46.747613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:46.747613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:46.747613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:46.747613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:46.747613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:46.747613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:46.747613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:46.747613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:46.747613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:46.747613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:46.747613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:46.747613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:46.747613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:46.748624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:46.748624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:46.748624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:46.748624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:46.748624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:46.748624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:46.748624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:46.748624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:46.748624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:53:46.748624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:46.748624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 376/737] 10.222.0.41 () {56 vars in 1117 bytes} [Mon May 30 11:53:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:46.749909 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f5287-9ddd-497b-9b73-686ba0883852 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:46.761137 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814916c-33f8-4fc4-81ed-34890a21665d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:46.763030 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814916c-33f8-4fc4-81ed-34890a21665d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:46.867941 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f5287-9ddd-497b-9b73-686ba0883852 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:46.878192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 362/738] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:46.879794 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814916c-33f8-4fc4-81ed-34890a21665d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:46.907955 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5eafb-49a0-444e-b7a8-62cde4f3fb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:46.908633 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5eafb-49a0-444e-b7a8-62cde4f3fb1f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:46.908919 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5eafb-49a0-444e-b7a8-62cde4f3fb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:46.909199 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5eafb-49a0-444e-b7a8-62cde4f3fb1f None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:46.909953 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5eafb-49a0-444e-b7a8-62cde4f3fb1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:46.910267 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5eafb-49a0-444e-b7a8-62cde4f3fb1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:46.911648 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5eafb-49a0-444e-b7a8-62cde4f3fb1f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:46.919772 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 377/739] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:46.921343 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95487d-7fbf-49c4-a719-564f3195a24d None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:46.921639 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95487d-7fbf-49c4-a719-564f3195a24d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:46.921922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95487d-7fbf-49c4-a719-564f3195a24d None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:46.927865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 378/740] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:46.927865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95487d-7fbf-49c4-a719-564f3195a24d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:46.957552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:46.960381 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:47.008825 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814916c-33f8-4fc4-81ed-34890a21665d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:47.049081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95487d-7fbf-49c4-a719-564f3195a24d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:47.049722 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc637c-ba71-42c2-9228-fdb3152ffaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:47.050753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc637c-ba71-42c2-9228-fdb3152ffaec None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:47.051049 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc637c-ba71-42c2-9228-fdb3152ffaec None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:47.051334 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc637c-ba71-42c2-9228-fdb3152ffaec None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:47.052223 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc637c-ba71-42c2-9228-fdb3152ffaec None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:47.052537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc637c-ba71-42c2-9228-fdb3152ffaec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:47.054310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc637c-ba71-42c2-9228-fdb3152ffaec None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:47.074324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 363/741] 10.222.0.41 () {56 vars in 1149 bytes} [Mon May 30 11:53:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:47.075177 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc637c-ba71-42c2-9228-fdb3152ffaec None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:47.091776 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d982c8-9708-4178-9165-fd9b38a1fe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:47.092928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d982c8-9708-4178-9165-fd9b38a1fe4a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:47.093220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d982c8-9708-4178-9165-fd9b38a1fe4a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:47.093657 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d982c8-9708-4178-9165-fd9b38a1fe4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:47.108132 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d982c8-9708-4178-9165-fd9b38a1fe4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:47.109584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d982c8-9708-4178-9165-fd9b38a1fe4a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:47.130607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-37d982c8-9708-4178-9165-fd9b38a1fe4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:47.130607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:47.130607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:47.130607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:47.130607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:47.130607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:47.130607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:47.130607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:47.130607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:47.130607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:47.130607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:47.130607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:47.130607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:47.130607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:47.130607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:47.131528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:47.131528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:47.131528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:47.131528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:47.131528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:47.131528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:47.131528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:47.131528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:47.131528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:47.131528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:47.131528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:47.131528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:47.131528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:47.131528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:47.131528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:47.131528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:47.131528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:47.132887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:47.132887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:47.132887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:47.132887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:47.132887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 379/742] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:47.133158 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d139e4-449e-4a26-bf9c-57fa34a451b4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:47.133493 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d139e4-449e-4a26-bf9c-57fa34a451b4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:47.133711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d139e4-449e-4a26-bf9c-57fa34a451b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:47.151665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-30d139e4-449e-4a26-bf9c-57fa34a451b4 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:47.152904 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-30d139e4-449e-4a26-bf9c-57fa34a451b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:47.190312 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc637c-ba71-42c2-9228-fdb3152ffaec None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:47.213152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:47.226130 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 380/743] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:47.226309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874f2b7-aedb-460c-9a39-8145c9e83ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:47.227045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874f2b7-aedb-460c-9a39-8145c9e83ddc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:47.227330 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874f2b7-aedb-460c-9a39-8145c9e83ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:47.227607 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874f2b7-aedb-460c-9a39-8145c9e83ddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:47.227740 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1598e5-cdf5-4941-9f24-a1d1fb27bfe9 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:47.228225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1598e5-cdf5-4941-9f24-a1d1fb27bfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:47.228442 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1598e5-cdf5-4941-9f24-a1d1fb27bfe9 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:47.234672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 381/744] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:47.234672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1598e5-cdf5-4941-9f24-a1d1fb27bfe9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:47.249688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874f2b7-aedb-460c-9a39-8145c9e83ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:47.251080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874f2b7-aedb-460c-9a39-8145c9e83ddc None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:47.251974 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:47.270744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-3874f2b7-aedb-460c-9a39-8145c9e83ddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:47.270744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:47.270744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:47.270744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:47.270744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:47.270744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:47.270744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:47.270744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:47.270744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:47.270744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:47.270744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:47.270744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:47.270744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:47.270744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:47.270744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:47.272280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:47.272280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:47.272280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:47.272280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:47.272280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:47.272280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:47.272280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:47.272280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:47.272280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:47.272280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:47.272280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:47.272280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:47.272280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:47.272280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:47.272280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:47.272280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:47.272280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:47.274021 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:47.274021 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:47.274021 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:47.274021 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:47.274021 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 364/745] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:47.274021 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874f2b7-aedb-460c-9a39-8145c9e83ddc None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:47.359964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1598e5-cdf5-4941-9f24-a1d1fb27bfe9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:47.382299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874f2b7-aedb-460c-9a39-8145c9e83ddc None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:47.399244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521e715-1bd3-4fea-8759-38a52702c8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:47.399600 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521e715-1bd3-4fea-8759-38a52702c8ac None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:47.399916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521e715-1bd3-4fea-8759-38a52702c8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:47.400202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521e715-1bd3-4fea-8759-38a52702c8ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:47.422069 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7b7da-4ae8-41f2-ad61-37c0d97eb233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:47.422490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7b7da-4ae8-41f2-ad61-37c0d97eb233 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:47.422779 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7b7da-4ae8-41f2-ad61-37c0d97eb233 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:47.423054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7b7da-4ae8-41f2-ad61-37c0d97eb233 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:47.423783 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7b7da-4ae8-41f2-ad61-37c0d97eb233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:47.424124 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7b7da-4ae8-41f2-ad61-37c0d97eb233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:47.426311 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7b7da-4ae8-41f2-ad61-37c0d97eb233 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:47.442012 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 365/746] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:47.443293 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131ad49-f585-4e26-9ddd-75f3d078fa09 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:47.443587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131ad49-f585-4e26-9ddd-75f3d078fa09 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:47.443900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131ad49-f585-4e26-9ddd-75f3d078fa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:47.461440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b131ad49-f585-4e26-9ddd-75f3d078fa09 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:47.462850 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b131ad49-f585-4e26-9ddd-75f3d078fa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:47.482253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521e715-1bd3-4fea-8759-38a52702c8ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:47.485419 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521e715-1bd3-4fea-8759-38a52702c8ac None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:47.493862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:47.501656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:47.541967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 366/747] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:53:47.542805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131ad49-f585-4e26-9ddd-75f3d078fa09 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:47.603358 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 382/748] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:53:47.604536 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521e715-1bd3-4fea-8759-38a52702c8ac None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:47.656202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131ad49-f585-4e26-9ddd-75f3d078fa09 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:47.696171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d1a72-64ce-4929-8a22-4feebb0a9b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:47.696842 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d1a72-64ce-4929-8a22-4feebb0a9b52 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:47.697126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d1a72-64ce-4929-8a22-4feebb0a9b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:47.697400 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d1a72-64ce-4929-8a22-4feebb0a9b52 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:47.698145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d1a72-64ce-4929-8a22-4feebb0a9b52 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:47.699523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d1a72-64ce-4929-8a22-4feebb0a9b52 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:47.724214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 367/749] 10.222.0.41 () {60 vars in 1141 bytes} [Mon May 30 11:53:47 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:53:47.724214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d1a72-64ce-4929-8a22-4feebb0a9b52 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:47.733619 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521e715-1bd3-4fea-8759-38a52702c8ac None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:47.745029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:47.750385 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:47.802307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45f010-754b-43ec-8955-94a772daad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:47.803513 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45f010-754b-43ec-8955-94a772daad4d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:47.804049 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45f010-754b-43ec-8955-94a772daad4d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:47.805064 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45f010-754b-43ec-8955-94a772daad4d None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:47.806022 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45f010-754b-43ec-8955-94a772daad4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:47.806491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45f010-754b-43ec-8955-94a772daad4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:47.808088 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45f010-754b-43ec-8955-94a772daad4d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:47.823612 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 383/750] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:47.824734 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45f010-754b-43ec-8955-94a772daad4d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:47.849882 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d1a72-64ce-4929-8a22-4feebb0a9b52 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:47.892512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46921b0d-9126-414d-902e-dae7773abeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:47.893334 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46921b0d-9126-414d-902e-dae7773abeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:47.893622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46921b0d-9126-414d-902e-dae7773abeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:47.893900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46921b0d-9126-414d-902e-dae7773abeb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:47.901576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46921b0d-9126-414d-902e-dae7773abeb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:47.903052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46921b0d-9126-414d-902e-dae7773abeb6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:47.919282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-46921b0d-9126-414d-902e-dae7773abeb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:47.919282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:47.919282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:47.919282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:47.919282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:47.919282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:47.919282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:47.919282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:47.919282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:47.919282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:47.919282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:47.919282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:47.919282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:47.919282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:47.919282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:47.921202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:47.921202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:47.921202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:47.921202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:47.921202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:47.921202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:47.921202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:47.921202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:47.921202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:47.921202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:47.921202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:47.921202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:47.921202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:47.921202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:47.921202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:47.921202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:47.921202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:47.922410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:47.922410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:47.922410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:47.922410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:47.922410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:47.922410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:47.922410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:47.922410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:47.922410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 368/751] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:47.922410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46921b0d-9126-414d-902e-dae7773abeb6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:47.944304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45f010-754b-43ec-8955-94a772daad4d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:47.981854 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c22de6-d350-46a8-af4f-21f919d3b519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:47.983090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c22de6-d350-46a8-af4f-21f919d3b519 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:47.983366 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c22de6-d350-46a8-af4f-21f919d3b519 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:47.983649 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c22de6-d350-46a8-af4f-21f919d3b519 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:47.984532 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c22de6-d350-46a8-af4f-21f919d3b519 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:47.985912 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c22de6-d350-46a8-af4f-21f919d3b519 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:48.007858 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 384/752] 10.222.0.41 () {60 vars in 1141 bytes} [Mon May 30 11:53:47 2022] POST /identity/v3/services => generated 240 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:53:48.007858 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c22de6-d350-46a8-af4f-21f919d3b519 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:48.019260 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:48.038907 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46921b0d-9126-414d-902e-dae7773abeb6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:48.043643 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:48.087124 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513591f-cb12-47b9-98c3-abf743da9cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:48.087967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513591f-cb12-47b9-98c3-abf743da9cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:48.088254 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513591f-cb12-47b9-98c3-abf743da9cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:48.088530 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513591f-cb12-47b9-98c3-abf743da9cc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:48.101589 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513591f-cb12-47b9-98c3-abf743da9cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:48.103091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513591f-cb12-47b9-98c3-abf743da9cc6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:48.125405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b513591f-cb12-47b9-98c3-abf743da9cc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:48.125405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:48.125405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:48.125405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:48.125405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:48.125405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:48.125405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:48.125405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:48.125405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:48.125405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:48.125405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:48.125405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:48.125405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:48.125405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:48.125405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:48.126359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:48.126359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:48.126359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:48.126359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:48.126359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:48.126359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:48.126359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:48.126359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:48.126359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:48.126359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:48.126359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:48.126359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:48.126359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:48.126359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:48.126359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:48.126359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:48.126359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:48.127250 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:48.127250 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:48.127250 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:48.127250 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:48.127250 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 369/753] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:48.128061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513591f-cb12-47b9-98c3-abf743da9cc6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:48.141052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c22de6-d350-46a8-af4f-21f919d3b519 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:48.178934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ca4eb-51c7-4888-a5af-ae0ed3ff03ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:48.179667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ca4eb-51c7-4888-a5af-ae0ed3ff03ff None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:48.179990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ca4eb-51c7-4888-a5af-ae0ed3ff03ff None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:48.180275 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ca4eb-51c7-4888-a5af-ae0ed3ff03ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:48.189379 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ca4eb-51c7-4888-a5af-ae0ed3ff03ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:48.190870 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ca4eb-51c7-4888-a5af-ae0ed3ff03ff None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:48.206562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-9b2ca4eb-51c7-4888-a5af-ae0ed3ff03ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 30 11:53:48.206562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:48.206562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:48.206562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:48.206562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:48.206562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:48.206562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:48.206562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:48.206562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:48.206562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:48.206562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:48.206562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:48.206562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:48.206562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:48.206562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:48.206562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:48.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:48.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:48.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:48.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:48.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:48.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:48.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:48.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:48.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:48.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:48.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:48.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:48.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:48.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:48.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:48.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:48.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:48.208837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:48.211266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:48.211266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:48.211266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:48.211266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:48.211266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:48.211266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:48.211266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:48.211266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:48.211266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 30 11:53:48.211266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:48.211266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 385/754] 10.222.0.41 () {56 vars in 1093 bytes} [Mon May 30 11:53:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:48.211266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ca4eb-51c7-4888-a5af-ae0ed3ff03ff None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:48.254693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513591f-cb12-47b9-98c3-abf743da9cc6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:48.289906 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:48.299094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1ae98-67db-4569-a4b3-a2ebcb5743c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:48.300074 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1ae98-67db-4569-a4b3-a2ebcb5743c4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:48.300520 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1ae98-67db-4569-a4b3-a2ebcb5743c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:48.300802 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1ae98-67db-4569-a4b3-a2ebcb5743c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:48.301610 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1ae98-67db-4569-a4b3-a2ebcb5743c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:48.301925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1ae98-67db-4569-a4b3-a2ebcb5743c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:48.303399 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1ae98-67db-4569-a4b3-a2ebcb5743c4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:48.308491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:48.322653 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 370/755] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:48.323801 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1ae98-67db-4569-a4b3-a2ebcb5743c4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:48.334744 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ca4eb-51c7-4888-a5af-ae0ed3ff03ff None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:48.379505 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602816ba-228a-4c13-a54f-fd717d2dd61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:48.380359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602816ba-228a-4c13-a54f-fd717d2dd61b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:48.380638 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602816ba-228a-4c13-a54f-fd717d2dd61b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:48.380921 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602816ba-228a-4c13-a54f-fd717d2dd61b None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:48.381958 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602816ba-228a-4c13-a54f-fd717d2dd61b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:48.382270 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602816ba-228a-4c13-a54f-fd717d2dd61b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:48.383641 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602816ba-228a-4c13-a54f-fd717d2dd61b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:48.399728 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 386/756] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:48.401125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602816ba-228a-4c13-a54f-fd717d2dd61b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:48.443939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1ae98-67db-4569-a4b3-a2ebcb5743c4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:48.485514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d972ab-9556-4553-81ea-97061ebbc623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:48.486228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d972ab-9556-4553-81ea-97061ebbc623 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:48.486574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d972ab-9556-4553-81ea-97061ebbc623 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:48.486859 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d972ab-9556-4553-81ea-97061ebbc623 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:48.487760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d972ab-9556-4553-81ea-97061ebbc623 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:48.488124 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d972ab-9556-4553-81ea-97061ebbc623 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:48.489582 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d972ab-9556-4553-81ea-97061ebbc623 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:48.510763 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 371/757] 10.222.0.41 () {56 vars in 1133 bytes} [Mon May 30 11:53:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:48.511690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d972ab-9556-4553-81ea-97061ebbc623 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:48.531769 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602816ba-228a-4c13-a54f-fd717d2dd61b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:48.567526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16890ba-5367-4d99-946d-7e1a7d490dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:48.568320 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16890ba-5367-4d99-946d-7e1a7d490dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:48.568608 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16890ba-5367-4d99-946d-7e1a7d490dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:48.568889 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16890ba-5367-4d99-946d-7e1a7d490dc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:48.569741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16890ba-5367-4d99-946d-7e1a7d490dc4 None admin] RBAC: Adding query filter params (role.id=8196ef570097443bac15d3cf39878486, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=83e5f980cdb74227bb31c7e7e5eab74b) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:48.570059 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16890ba-5367-4d99-946d-7e1a7d490dc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:48.571511 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16890ba-5367-4d99-946d-7e1a7d490dc4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:48.576558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:48.582447 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 387/758] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:53:48 2022] GET /identity/v3/role_assignments?user.id=83e5f980cdb74227bb31c7e7e5eab74b&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=8196ef570097443bac15d3cf39878486 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:48.582447 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16890ba-5367-4d99-946d-7e1a7d490dc4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:48.622708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:48.680361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d972ab-9556-4553-81ea-97061ebbc623 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:48.728040 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16890ba-5367-4d99-946d-7e1a7d490dc4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:48.756983 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff62c29-f801-42bf-9d0e-91ee29e02f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:48.757791 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff62c29-f801-42bf-9d0e-91ee29e02f62 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:48.758079 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff62c29-f801-42bf-9d0e-91ee29e02f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:48.758394 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff62c29-f801-42bf-9d0e-91ee29e02f62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:48.769704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fe0e8-ae65-4d24-8bda-50552c0e37c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:48.770933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fe0e8-ae65-4d24-8bda-50552c0e37c6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:48.771428 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fe0e8-ae65-4d24-8bda-50552c0e37c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:48.771935 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fe0e8-ae65-4d24-8bda-50552c0e37c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:48.775767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff62c29-f801-42bf-9d0e-91ee29e02f62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:48.777379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff62c29-f801-42bf-9d0e-91ee29e02f62 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:48.785997 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fe0e8-ae65-4d24-8bda-50552c0e37c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:48.787882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fe0e8-ae65-4d24-8bda-50552c0e37c6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:48.806737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b41fe0e8-ae65-4d24-8bda-50552c0e37c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:48.806737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:48.806737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:48.806737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:48.806737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:48.806737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:48.806737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:48.806737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:48.806737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:48.806737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:48.806737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:48.806737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:48.806737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:48.806737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:48.806737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:48.807678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:48.807678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:48.807678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:48.807678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:48.807678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:48.807678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:48.807678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:48.807678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:48.807678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:48.807678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:48.807678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:48.807678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:48.807678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:48.807678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:48.807678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:48.807678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:48.807678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:48.808602 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:48.808602 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:48.808602 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:48.808602 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:48.811093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 388/759] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:48.813166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-fff62c29-f801-42bf-9d0e-91ee29e02f62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:48.813166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:48.813166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:48.813166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:48.813166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:48.813166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:48.813166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:48.813166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:48.813166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:48.813166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:48.813166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:48.813166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:48.813166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:48.813166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:48.813166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:48.814039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:48.814039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:48.814039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:48.814039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:48.814039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:48.814039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:48.814039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:48.814039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:48.814039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:48.814039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:48.814039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:48.814039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:48.814039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:48.814039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:48.814039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:48.814039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:48.814039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:48.814928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:48.814928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:48.814928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:48.814928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:48.814928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:48.814928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:48.814928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:48.814928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:48.814928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 372/760] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:48.819959 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fe0e8-ae65-4d24-8bda-50552c0e37c6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:48.823155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff62c29-f801-42bf-9d0e-91ee29e02f62 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:48.911444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:48.955930 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fe0e8-ae65-4d24-8bda-50552c0e37c6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:49.001328 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159540e-306d-4d51-93b2-548ba5c0965e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:49.001925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159540e-306d-4d51-93b2-548ba5c0965e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:49.002207 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159540e-306d-4d51-93b2-548ba5c0965e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:49.002485 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159540e-306d-4d51-93b2-548ba5c0965e None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:49.003218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159540e-306d-4d51-93b2-548ba5c0965e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:49.003526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159540e-306d-4d51-93b2-548ba5c0965e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:49.004932 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159540e-306d-4d51-93b2-548ba5c0965e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:49.025260 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 389/761] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:49.033559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159540e-306d-4d51-93b2-548ba5c0965e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:49.065304 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff62c29-f801-42bf-9d0e-91ee29e02f62 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:49.084183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:49.132364 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d27e77-4a0c-4706-9d00-5c1717f825d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:49.133041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d27e77-4a0c-4706-9d00-5c1717f825d6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:49.133326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d27e77-4a0c-4706-9d00-5c1717f825d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:49.133708 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d27e77-4a0c-4706-9d00-5c1717f825d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:49.134509 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d27e77-4a0c-4706-9d00-5c1717f825d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:49.134822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d27e77-4a0c-4706-9d00-5c1717f825d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:49.136400 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d27e77-4a0c-4706-9d00-5c1717f825d6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:49.156670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159540e-306d-4d51-93b2-548ba5c0965e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:49.168343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 373/762] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:49.174070 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d27e77-4a0c-4706-9d00-5c1717f825d6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:49.183023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:49.198233 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a0664-8571-43d4-9f01-0cc1645c2f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:49.201689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a0664-8571-43d4-9f01-0cc1645c2f8a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:49.202007 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a0664-8571-43d4-9f01-0cc1645c2f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:49.202292 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a0664-8571-43d4-9f01-0cc1645c2f8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:49.217311 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a0664-8571-43d4-9f01-0cc1645c2f8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:49.219304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a0664-8571-43d4-9f01-0cc1645c2f8a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:49.238112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-9f3a0664-8571-43d4-9f01-0cc1645c2f8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:49.238112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:49.238112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:49.238112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:49.238112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:49.238112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:49.238112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:49.238112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:49.238112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:49.238112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:49.238112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:49.238112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:49.238112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:49.238112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:49.238112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:49.239017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:49.239017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:49.239017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:49.239017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:49.239017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:49.239017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:49.239017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:49.239017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:49.239017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:49.239017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:49.239017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:49.239017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:49.239017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:49.239017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:49.239017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:49.239017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:49.239017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:49.239949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:49.239949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:49.239949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:49.239949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:49.239949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:49.239949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:49.239949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:49.239949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:49.239949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 390/763] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:49.249075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a0664-8571-43d4-9f01-0cc1645c2f8a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:49.396122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d27e77-4a0c-4706-9d00-5c1717f825d6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:49.439173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a0664-8571-43d4-9f01-0cc1645c2f8a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:49.485390 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d76c3-ba92-4ac2-b40e-1da34a628de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:49.486065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d76c3-ba92-4ac2-b40e-1da34a628de5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:49.486344 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d76c3-ba92-4ac2-b40e-1da34a628de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:49.486615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d76c3-ba92-4ac2-b40e-1da34a628de5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:49.487453 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d76c3-ba92-4ac2-b40e-1da34a628de5 None admin] RBAC: Adding query filter params (role.id=dc57e0b7f67947e0b6b63c4ad0148358, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=a63dd78421064bbe838b1ed0261c13bb) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:49.487766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d76c3-ba92-4ac2-b40e-1da34a628de5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:49.489232 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d76c3-ba92-4ac2-b40e-1da34a628de5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:49.503229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 374/764] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:53:49 2022] GET /identity/v3/role_assignments?user.id=a63dd78421064bbe838b1ed0261c13bb&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=dc57e0b7f67947e0b6b63c4ad0148358 => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:49.510483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd83216-9cb6-4456-8c01-997b500c949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:49.511161 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd83216-9cb6-4456-8c01-997b500c949d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:49.511444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd83216-9cb6-4456-8c01-997b500c949d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:49.511718 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd83216-9cb6-4456-8c01-997b500c949d None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:49.512658 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd83216-9cb6-4456-8c01-997b500c949d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:49.512973 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd83216-9cb6-4456-8c01-997b500c949d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:49.515620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd83216-9cb6-4456-8c01-997b500c949d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:49.530698 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 391/765] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:49.536961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d76c3-ba92-4ac2-b40e-1da34a628de5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:49.600217 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:49.690576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d76c3-ba92-4ac2-b40e-1da34a628de5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:49.735971 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dd2fb-e986-4f08-9a85-d2fc8f043843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:49.736874 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dd2fb-e986-4f08-9a85-d2fc8f043843 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:49.737156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dd2fb-e986-4f08-9a85-d2fc8f043843 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:49.737434 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dd2fb-e986-4f08-9a85-d2fc8f043843 None admin] PATH_INFO: `/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/bb3820a613744c15b840681fe6b6e808/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:49.739421 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7dd2fb-e986-4f08-9a85-d2fc8f043843 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e8426fd0e01433b8aa3a3797c687e03, user_id=bb3820a613744c15b840681fe6b6e808, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:49.740917 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7dd2fb-e986-4f08-9a85-d2fc8f043843 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:49.764242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 375/766] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:53:49 2022] PUT /identity/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/bb3820a613744c15b840681fe6b6e808/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:53:50.192670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3194af4-ada9-4eb0-be81-9a01a5a4e24a None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:50.193081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3194af4-ada9-4eb0-be81-9a01a5a4e24a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:50.193259 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3194af4-ada9-4eb0-be81-9a01a5a4e24a None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:50.194863 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 392/767] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:50.200094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b5554-8614-4ee3-8fb3-89fb9f4dd471 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:50.200533 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b5554-8614-4ee3-8fb3-89fb9f4dd471 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:50.200707 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b5554-8614-4ee3-8fb3-89fb9f4dd471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:50.219417 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f11b5554-8614-4ee3-8fb3-89fb9f4dd471 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:50.220642 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f11b5554-8614-4ee3-8fb3-89fb9f4dd471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:50.295857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 376/768] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:53:50.318332 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3194af4-ada9-4eb0-be81-9a01a5a4e24a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:50.398017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:50.485415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3194af4-ada9-4eb0-be81-9a01a5a4e24a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:50.534126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025161fa-cf92-4f27-8a34-82bb67178909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:50.534944 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025161fa-cf92-4f27-8a34-82bb67178909 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:50.535230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025161fa-cf92-4f27-8a34-82bb67178909 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:50.535510 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025161fa-cf92-4f27-8a34-82bb67178909 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:50.536194 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025161fa-cf92-4f27-8a34-82bb67178909 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:50.537684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025161fa-cf92-4f27-8a34-82bb67178909 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:50.554607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-025161fa-cf92-4f27-8a34-82bb67178909 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 30 11:53:50.554607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:50.554607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:53:50.554607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:53:50.554607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:53:50.554607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:53:50.554607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:53:50.554607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:53:50.554607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 30 11:53:50.554607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:50.554607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:53:50.554607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:50.554607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:50.554607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:50.554607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:50.554607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:50.555552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:50.555552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:50.555552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:50.555552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:50.555552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:50.555552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:50.555552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:50.555552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:53:50.555552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:53:50.555552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:53:50.555552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:53:50.555552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:50.555552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:50.555552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:50.555552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:50.555552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:50.556409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:50.556409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:50.556409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:50.556409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:50.556409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:50.556409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:50.556409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:50.556409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:50.556409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:50.556409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:50.556409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:50.556409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:53:50.556409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:53:50.556409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 30 11:53:50.556409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:50.556409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 393/769] 10.222.0.41 () {56 vars in 1129 bytes} [Mon May 30 11:53:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:50.564393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b5554-8614-4ee3-8fb3-89fb9f4dd471 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:50.605192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:50.712152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b5554-8614-4ee3-8fb3-89fb9f4dd471 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:50.756059 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f5e37-4695-41a3-ac70-e9819ea98a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:50.756651 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f5e37-4695-41a3-ac70-e9819ea98a25 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:50.757104 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f5e37-4695-41a3-ac70-e9819ea98a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:50.757544 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f5e37-4695-41a3-ac70-e9819ea98a25 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:50.758409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f5e37-4695-41a3-ac70-e9819ea98a25 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:50.758865 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f5e37-4695-41a3-ac70-e9819ea98a25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:50.760419 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f5e37-4695-41a3-ac70-e9819ea98a25 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:50.766184 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 377/770] 10.222.0.41 () {56 vars in 1124 bytes} [Mon May 30 11:53:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:50.779653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025161fa-cf92-4f27-8a34-82bb67178909 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:50.847927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907d91d-136a-452b-a733-c606ce1aeaa3 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:50.848561 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907d91d-136a-452b-a733-c606ce1aeaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:50.849034 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907d91d-136a-452b-a733-c606ce1aeaa3 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:50.850581 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 378/771] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:50.868380 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df838f65-1c7d-4d4e-9239-2d96bd051f14 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:50.868990 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df838f65-1c7d-4d4e-9239-2d96bd051f14 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:50.869466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df838f65-1c7d-4d4e-9239-2d96bd051f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:50.903713 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025161fa-cf92-4f27-8a34-82bb67178909 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:50.905639 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-df838f65-1c7d-4d4e-9239-2d96bd051f14 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:50.906963 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-df838f65-1c7d-4d4e-9239-2d96bd051f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:50.942331 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d6b04-8c9c-4ad3-8528-d471625f9ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:50.943285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d6b04-8c9c-4ad3-8528-d471625f9ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:50.943777 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d6b04-8c9c-4ad3-8528-d471625f9ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:50.944340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d6b04-8c9c-4ad3-8528-d471625f9ef8 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:50.945193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d6b04-8c9c-4ad3-8528-d471625f9ef8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:50.945648 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d6b04-8c9c-4ad3-8528-d471625f9ef8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:50.947195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d6b04-8c9c-4ad3-8528-d471625f9ef8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:50.953674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 394/772] 10.222.0.41 () {56 vars in 1124 bytes} [Mon May 30 11:53:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:50.954495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:50.960420 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d6b04-8c9c-4ad3-8528-d471625f9ef8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:51.064323 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 379/773] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:53:51.099111 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df838f65-1c7d-4d4e-9239-2d96bd051f14 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:51.132333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:51.145047 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d6b04-8c9c-4ad3-8528-d471625f9ef8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:51.181602 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fa427-625b-4db5-9f58-b739514d624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:51.182669 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fa427-625b-4db5-9f58-b739514d624e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:51.183101 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fa427-625b-4db5-9f58-b739514d624e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:51.183567 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fa427-625b-4db5-9f58-b739514d624e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:51.184552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fa427-625b-4db5-9f58-b739514d624e None admin] RBAC: Adding query filter params (interface=public, service_id=90bed382ad9244a58bb7a80a46765daf, region_id=RegionOne) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:51.185017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fa427-625b-4db5-9f58-b739514d624e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:51.186687 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fa427-625b-4db5-9f58-b739514d624e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:51.195109 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 395/774] 10.222.0.41 () {56 vars in 1251 bytes} [Mon May 30 11:53:50 2022] GET /identity/v3/endpoints?service_id=90bed382ad9244a58bb7a80a46765daf&interface=public®ion_id=RegionOne => generated 194 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:51.203615 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fa427-625b-4db5-9f58-b739514d624e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:51.256231 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:51.312467 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fa427-625b-4db5-9f58-b739514d624e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:51.350966 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea4c88-bde6-45d9-8b28-e1c996088ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:51.351974 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea4c88-bde6-45d9-8b28-e1c996088ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:51.352412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea4c88-bde6-45d9-8b28-e1c996088ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:51.352840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea4c88-bde6-45d9-8b28-e1c996088ae6 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:51.353674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea4c88-bde6-45d9-8b28-e1c996088ae6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:51.355213 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea4c88-bde6-45d9-8b28-e1c996088ae6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:51.362427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 396/775] 10.222.0.41 () {56 vars in 1087 bytes} [Mon May 30 11:53:51 2022] GET /identity/v3/services => generated 772 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:51.374506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89537e40-8c3c-49e5-a632-a889bd5c1033 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:51.374797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89537e40-8c3c-49e5-a632-a889bd5c1033 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:51.375081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89537e40-8c3c-49e5-a632-a889bd5c1033 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:51.376837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 397/776] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:53:51.382386 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce3cae-d7b9-41af-bab7-e036391fb7da None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:51.382679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce3cae-d7b9-41af-bab7-e036391fb7da None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:51.382960 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce3cae-d7b9-41af-bab7-e036391fb7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:51.400870 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3fce3cae-d7b9-41af-bab7-e036391fb7da None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:51.402102 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3fce3cae-d7b9-41af-bab7-e036391fb7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:51.410159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df838f65-1c7d-4d4e-9239-2d96bd051f14 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:51.483509 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 398/777] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:53:51.500139 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c351e-c5fe-475b-842c-4424ca16c7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:51.500948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c351e-c5fe-475b-842c-4424ca16c7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:51.501246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c351e-c5fe-475b-842c-4424ca16c7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:51.501527 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c351e-c5fe-475b-842c-4424ca16c7e5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:51.502196 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c351e-c5fe-475b-842c-4424ca16c7e5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:51.503572 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c351e-c5fe-475b-842c-4424ca16c7e5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:51.509307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce3cae-d7b9-41af-bab7-e036391fb7da None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:51.528395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-ba7c351e-c5fe-475b-842c-4424ca16c7e5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 30 11:53:51.528395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:51.528395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:53:51.528395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:53:51.528395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:53:51.528395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:53:51.528395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:53:51.528395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:53:51.528395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 30 11:53:51.528395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:51.528395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:53:51.528395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:51.528395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:51.528395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:51.528395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:51.528395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:51.528395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:51.530543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:51.530543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:51.530543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:51.530543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:51.530543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:51.530543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:51.530543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:53:51.530543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:53:51.530543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:53:51.530543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:53:51.530543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:51.530543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:51.530543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:51.530543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:51.530543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:51.530543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:51.531408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:51.531408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:51.531408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:51.531408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:51.531408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:51.531408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:51.531408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:51.531408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:51.531408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:51.531408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:51.531408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:53:51.531408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:53:51.531408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 30 11:53:51.531408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:51.531408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 380/778] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:51 2022] GET /identity/v3/services/network => generated 88 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:51.540869 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c351e-c5fe-475b-842c-4424ca16c7e5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:51.559998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:51.668176 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:51.683281 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce3cae-d7b9-41af-bab7-e036391fb7da None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:51.692455 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c351e-c5fe-475b-842c-4424ca16c7e5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:51.724462 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb4664-d941-4ae8-aa95-650bd99b068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:51.725662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb4664-d941-4ae8-aa95-650bd99b068b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:51.726130 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb4664-d941-4ae8-aa95-650bd99b068b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:51.726409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb4664-d941-4ae8-aa95-650bd99b068b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:51.739333 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb4664-d941-4ae8-aa95-650bd99b068b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:51.739843 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549310b6-1661-449d-babd-f398a2b7c3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:51.740768 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549310b6-1661-449d-babd-f398a2b7c3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:51.741256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549310b6-1661-449d-babd-f398a2b7c3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:51.741743 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549310b6-1661-449d-babd-f398a2b7c3e5 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:51.742654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549310b6-1661-449d-babd-f398a2b7c3e5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:51.743195 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549310b6-1661-449d-babd-f398a2b7c3e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:51.744909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549310b6-1661-449d-babd-f398a2b7c3e5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:51.750703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-86eb4664-d941-4ae8-aa95-650bd99b068b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:53:51.750703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:51.750703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:51.750703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:51.750703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:51.750703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:51.750703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:51.750703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:51.750703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:51.750703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:51.750703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:51.750703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:51.750703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:51.750703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:51.750703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:51.750703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:51.751640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:51.751640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:51.751640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:51.751640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:51.751640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:51.751640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:51.751640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:51.751640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:51.751640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:51.751640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:51.751640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:51.751640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:51.751640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:51.751640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:51.751640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:51.751640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:51.752525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:51.752525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:51.752525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:51.752525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:51.752525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:51.752525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:51.752525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:51.752525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:51.752525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:51.752525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:51.752525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:53:51.752525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:51.753909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 381/779] 10.222.0.41 () {56 vars in 1112 bytes} [Mon May 30 11:53:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:51.755970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 399/780] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:53:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:51.761970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb4664-d941-4ae8-aa95-650bd99b068b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:51.762415 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549310b6-1661-449d-babd-f398a2b7c3e5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:51.875360 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:51.886226 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb4664-d941-4ae8-aa95-650bd99b068b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:51.921414 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549310b6-1661-449d-babd-f398a2b7c3e5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:51.962458 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69d211-f007-4a5a-8362-dcd030c8c983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:51.963132 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69d211-f007-4a5a-8362-dcd030c8c983 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:51.963420 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69d211-f007-4a5a-8362-dcd030c8c983 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:51.963702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69d211-f007-4a5a-8362-dcd030c8c983 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:51.964526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69d211-f007-4a5a-8362-dcd030c8c983 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:51.964918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69d211-f007-4a5a-8362-dcd030c8c983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:51.966305 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69d211-f007-4a5a-8362-dcd030c8c983 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:51.975916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 400/781] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:51.981255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69d211-f007-4a5a-8362-dcd030c8c983 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:51.986429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ec4ca-3ec3-4de2-8d8a-d48162c9570f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:51.987326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ec4ca-3ec3-4de2-8d8a-d48162c9570f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:51.988670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ec4ca-3ec3-4de2-8d8a-d48162c9570f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:51.989102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ec4ca-3ec3-4de2-8d8a-d48162c9570f None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:51.990052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ec4ca-3ec3-4de2-8d8a-d48162c9570f None admin] RBAC: Adding query filter params (type=network) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:51.990658 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ec4ca-3ec3-4de2-8d8a-d48162c9570f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:51.992218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ec4ca-3ec3-4de2-8d8a-d48162c9570f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:52.005847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 382/782] 10.222.0.41 () {56 vars in 1112 bytes} [Mon May 30 11:53:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:52.015609 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ec4ca-3ec3-4de2-8d8a-d48162c9570f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:52.039540 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:52.106565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69d211-f007-4a5a-8362-dcd030c8c983 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:52.146024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce31c79-7408-4f2c-a789-f134f03fe0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:52.147102 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce31c79-7408-4f2c-a789-f134f03fe0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:52.148166 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce31c79-7408-4f2c-a789-f134f03fe0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:52.148762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce31c79-7408-4f2c-a789-f134f03fe0a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:52.171520 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce31c79-7408-4f2c-a789-f134f03fe0a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:52.173250 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce31c79-7408-4f2c-a789-f134f03fe0a4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:52.197739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-dce31c79-7408-4f2c-a789-f134f03fe0a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:52.197739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:52.197739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:52.197739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:52.197739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:52.197739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:52.197739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:52.197739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:52.197739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:52.197739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:52.197739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:52.197739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:52.197739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:52.197739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:52.197739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:52.198865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:52.198865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:52.198865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:52.198865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:52.198865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:52.198865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:52.198865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:52.198865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:52.198865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:52.198865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:52.198865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:52.198865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:52.198865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:52.198865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:52.198865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:52.198865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:52.198865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:52.199990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:52.199990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:52.199990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:52.199990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:52.202377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 401/783] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:52.208152 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c92082-0621-440f-b56e-781d6dafbb09 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:52.208777 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c92082-0621-440f-b56e-781d6dafbb09 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:52.209217 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c92082-0621-440f-b56e-781d6dafbb09 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:52.210984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 402/784] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:52.211932 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c92082-0621-440f-b56e-781d6dafbb09 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:52.217249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ec4ca-3ec3-4de2-8d8a-d48162c9570f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:52.217745 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:52.260919 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f63d1-fe85-4d1c-a921-d2ff7f73a8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:52.261708 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f63d1-fe85-4d1c-a921-d2ff7f73a8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:52.262054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f63d1-fe85-4d1c-a921-d2ff7f73a8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:52.262435 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f63d1-fe85-4d1c-a921-d2ff7f73a8d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:52.264105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f63d1-fe85-4d1c-a921-d2ff7f73a8d6 None admin] RBAC: Adding query filter params (interface=public, service_id=82cb4ac9cd6246a0a7e1e69091f3dcf6, region_id=RegionOne) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:52.264512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f63d1-fe85-4d1c-a921-d2ff7f73a8d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:52.266291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f63d1-fe85-4d1c-a921-d2ff7f73a8d6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:52.281643 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 383/785] 10.222.0.41 () {56 vars in 1251 bytes} [Mon May 30 11:53:52 2022] GET /identity/v3/endpoints?service_id=82cb4ac9cd6246a0a7e1e69091f3dcf6&interface=public®ion_id=RegionOne => generated 194 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:52.281643 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3892005-7790-4134-bde7-3bacc10f69b6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:52.281643 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3892005-7790-4134-bde7-3bacc10f69b6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:52.281643 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3892005-7790-4134-bde7-3bacc10f69b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:52.301408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d3892005-7790-4134-bde7-3bacc10f69b6 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:52.303189 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d3892005-7790-4134-bde7-3bacc10f69b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:52.330428 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c92082-0621-440f-b56e-781d6dafbb09 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:52.371479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654a0e7-2e1c-4c78-98b6-f5d3e0f54935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:52.372476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654a0e7-2e1c-4c78-98b6-f5d3e0f54935 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:52.373029 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654a0e7-2e1c-4c78-98b6-f5d3e0f54935 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:52.373487 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654a0e7-2e1c-4c78-98b6-f5d3e0f54935 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:52.374409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654a0e7-2e1c-4c78-98b6-f5d3e0f54935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:52.374787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654a0e7-2e1c-4c78-98b6-f5d3e0f54935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:52.376376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654a0e7-2e1c-4c78-98b6-f5d3e0f54935 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:52.393538 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 403/786] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:52.393538 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654a0e7-2e1c-4c78-98b6-f5d3e0f54935 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:52.410099 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 384/787] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:53:52.411384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3892005-7790-4134-bde7-3bacc10f69b6 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:52.423004 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:52.495411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:52.540684 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3892005-7790-4134-bde7-3bacc10f69b6 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:52.541265 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654a0e7-2e1c-4c78-98b6-f5d3e0f54935 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:52.578349 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1811ae2-3912-4383-99bc-b81983b22fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:52.579460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1811ae2-3912-4383-99bc-b81983b22fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:52.579975 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1811ae2-3912-4383-99bc-b81983b22fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:52.580432 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1811ae2-3912-4383-99bc-b81983b22fb7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:52.583620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff38bf-69d9-4771-ae80-56c365162caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:52.584082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff38bf-69d9-4771-ae80-56c365162caa None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:52.584438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff38bf-69d9-4771-ae80-56c365162caa None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:52.584791 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff38bf-69d9-4771-ae80-56c365162caa None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:52.585556 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff38bf-69d9-4771-ae80-56c365162caa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:52.587014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff38bf-69d9-4771-ae80-56c365162caa None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:52.589205 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1811ae2-3912-4383-99bc-b81983b22fb7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:52.590842 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1811ae2-3912-4383-99bc-b81983b22fb7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:52.593236 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 404/788] 10.222.0.41 () {56 vars in 1087 bytes} [Mon May 30 11:53:52 2022] GET /identity/v3/services => generated 772 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:52.594357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff38bf-69d9-4771-ae80-56c365162caa None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:52.607086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b1811ae2-3912-4383-99bc-b81983b22fb7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 30 11:53:52.607086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:52.607086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:52.607086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:52.607086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:52.607086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:52.607086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:52.607086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:52.607086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:52.607086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:52.607086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:52.607086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:52.607086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:52.607086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:52.607086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:52.607086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:52.608807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:52.608807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:52.608807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:52.608807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:52.608807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:52.608807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:52.608807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:52.608807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:52.608807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:52.608807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:52.608807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:52.608807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:52.608807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:52.608807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:52.608807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:52.608807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:52.608807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:52.608807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:52.609788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:52.609788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:52.609788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:52.609788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:52.609788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:52.609788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:52.609788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:52.609788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:52.609788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 30 11:53:52.609788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:52.620366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 385/789] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:53:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:52.635276 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1811ae2-3912-4383-99bc-b81983b22fb7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:52.704738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:52.746591 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1811ae2-3912-4383-99bc-b81983b22fb7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:52.787078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512c4a3-9f0b-4ddd-b451-a02cc7d2cc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:52.788106 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512c4a3-9f0b-4ddd-b451-a02cc7d2cc14 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:52.788578 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512c4a3-9f0b-4ddd-b451-a02cc7d2cc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:52.789039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512c4a3-9f0b-4ddd-b451-a02cc7d2cc14 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:52.790066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512c4a3-9f0b-4ddd-b451-a02cc7d2cc14 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:52.790249 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff38bf-69d9-4771-ae80-56c365162caa None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:52.790734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512c4a3-9f0b-4ddd-b451-a02cc7d2cc14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:52.792393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512c4a3-9f0b-4ddd-b451-a02cc7d2cc14 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:52.813012 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 386/790] 10.222.0.41 () {56 vars in 1135 bytes} [Mon May 30 11:53:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:52.818923 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512c4a3-9f0b-4ddd-b451-a02cc7d2cc14 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:52.842190 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:52.854706 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fc57e-feb7-4078-868e-62162eed82c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:52.856027 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fc57e-feb7-4078-868e-62162eed82c8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:52.856322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fc57e-feb7-4078-868e-62162eed82c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:52.856605 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fc57e-feb7-4078-868e-62162eed82c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:52.872600 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fc57e-feb7-4078-868e-62162eed82c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:52.884466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-502fc57e-feb7-4078-868e-62162eed82c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:52.884466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:52.884466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:52.884466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:52.884466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:52.884466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:52.884466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:52.884466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:52.884466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:52.884466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:52.884466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:52.884466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:52.884466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:52.884466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:52.884466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:52.884466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:52.885482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:52.885482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:52.885482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:52.885482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:52.885482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:52.885482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:52.885482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:52.885482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:52.885482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:52.885482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:52.885482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:52.885482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:52.885482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:52.885482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:52.885482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:52.885482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:52.886324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:52.886324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:52.886324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:52.886324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:52.886324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:52.886324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:52.886324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:52.886324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:52.886324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:52.886324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:52.886324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:52.886324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:52.886324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 405/791] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:52.887548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12df5d-e682-4372-9fc7-72b6f8d72b08 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:52.887862 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12df5d-e682-4372-9fc7-72b6f8d72b08 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:52.888151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12df5d-e682-4372-9fc7-72b6f8d72b08 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:52.891889 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 406/792] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:52.893009 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12df5d-e682-4372-9fc7-72b6f8d72b08 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:52.959436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512c4a3-9f0b-4ddd-b451-a02cc7d2cc14 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:52.994740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:53.012483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c6e78-eae8-456f-b95c-f997eeab7e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:53.014041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6e78-eae8-456f-b95c-f997eeab7e7f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:53.014947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6e78-eae8-456f-b95c-f997eeab7e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:53.015712 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6e78-eae8-456f-b95c-f997eeab7e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:53.028433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c6e78-eae8-456f-b95c-f997eeab7e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:53.028892 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12df5d-e682-4372-9fc7-72b6f8d72b08 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:53.030481 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c6e78-eae8-456f-b95c-f997eeab7e7f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:53.049168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-fd3c6e78-eae8-456f-b95c-f997eeab7e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:53.049168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:53.049168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:53.049168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:53.049168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:53.049168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:53.049168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:53.049168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:53.049168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:53.049168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:53.049168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:53.049168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:53.049168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:53.049168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:53.049168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:53.050117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:53.050117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:53.050117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:53.050117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:53.050117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:53.050117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:53.050117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:53.050117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:53.050117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:53.050117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:53.050117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:53.050117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:53.050117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:53.050117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:53.050117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:53.050117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:53.050117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:53.050994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:53.050994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:53.050994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:53.050994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:53.050994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 387/793] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:53:53.056453 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08183ecb-eecc-4e04-8c56-ae49637c9d1f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:53.056780 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08183ecb-eecc-4e04-8c56-ae49637c9d1f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:53.057070 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08183ecb-eecc-4e04-8c56-ae49637c9d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:53.072559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f881497-bb45-4908-b6bd-e0539c39b5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:53.073564 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f881497-bb45-4908-b6bd-e0539c39b5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:53.074056 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f881497-bb45-4908-b6bd-e0539c39b5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:53.074668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f881497-bb45-4908-b6bd-e0539c39b5b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:53.075729 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f881497-bb45-4908-b6bd-e0539c39b5b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:53.076427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f881497-bb45-4908-b6bd-e0539c39b5b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:53.078078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f881497-bb45-4908-b6bd-e0539c39b5b7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:53.079173 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-08183ecb-eecc-4e04-8c56-ae49637c9d1f None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:53.080561 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-08183ecb-eecc-4e04-8c56-ae49637c9d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:53.090196 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 407/794] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:53:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:53.091707 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f881497-bb45-4908-b6bd-e0539c39b5b7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:53.157108 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:53.165819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 388/795] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:53:53.166929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08183ecb-eecc-4e04-8c56-ae49637c9d1f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:53.241872 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f881497-bb45-4908-b6bd-e0539c39b5b7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:53.285839 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278e4d2-630e-4858-82bf-901e9ec05ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:53.286848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278e4d2-630e-4858-82bf-901e9ec05ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:53.287373 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278e4d2-630e-4858-82bf-901e9ec05ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:53.287869 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278e4d2-630e-4858-82bf-901e9ec05ab4 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:53.288790 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278e4d2-630e-4858-82bf-901e9ec05ab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:53.289293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278e4d2-630e-4858-82bf-901e9ec05ab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:53.290838 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278e4d2-630e-4858-82bf-901e9ec05ab4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:53.302780 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08183ecb-eecc-4e04-8c56-ae49637c9d1f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:53.304078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 408/796] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:53.305140 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278e4d2-630e-4858-82bf-901e9ec05ab4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:53.310566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:53.348876 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a20af8-aec8-4bd4-ba3b-d8a6981cf91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:53.350139 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a20af8-aec8-4bd4-ba3b-d8a6981cf91c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:53.350628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a20af8-aec8-4bd4-ba3b-d8a6981cf91c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:53.351137 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a20af8-aec8-4bd4-ba3b-d8a6981cf91c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:53.363543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a20af8-aec8-4bd4-ba3b-d8a6981cf91c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:53.365663 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a20af8-aec8-4bd4-ba3b-d8a6981cf91c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:53.385667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-59a20af8-aec8-4bd4-ba3b-d8a6981cf91c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:53.385667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:53.385667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:53.385667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:53.385667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:53.385667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:53.385667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:53.385667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:53.385667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:53.385667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:53.385667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:53.385667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:53.385667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:53.385667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:53.385667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:53.386575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:53.386575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:53.386575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:53.386575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:53.386575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:53.386575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:53.386575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:53.386575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:53.386575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:53.386575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:53.386575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:53.386575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:53.386575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:53.386575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:53.386575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:53.386575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:53.386575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:53.387482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:53.387482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:53.387482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:53.387482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:53.390418 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 389/797] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:53.391671 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a20af8-aec8-4bd4-ba3b-d8a6981cf91c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:53.415195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278e4d2-630e-4858-82bf-901e9ec05ab4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:53.427086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:53.452544 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7284dd-e51d-40ec-913e-5e3439c13bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:53.453344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7284dd-e51d-40ec-913e-5e3439c13bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:53.453629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7284dd-e51d-40ec-913e-5e3439c13bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:53.453906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7284dd-e51d-40ec-913e-5e3439c13bf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:53.464850 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7284dd-e51d-40ec-913e-5e3439c13bf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:53.474043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-3e7284dd-e51d-40ec-913e-5e3439c13bf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:53:53.474043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:53.474043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:53.474043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:53.474043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:53.474043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:53.474043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:53.474043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:53.474043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:53.474043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:53.474043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:53.474043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:53.474043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:53.474043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:53.474043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:53.474043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:53.474991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:53.474991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:53.474991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:53.474991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:53.474991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:53.474991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:53.474991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:53.474991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:53.474991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:53.474991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:53.474991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:53.474991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:53.474991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:53.474991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:53.474991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:53.474991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:53.475857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:53.475857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:53.475857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:53.475857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:53.475857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:53.475857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:53.475857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:53.475857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:53.475857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:53.475857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:53.475857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:53:53.475857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:53.480161 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 409/798] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:53:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:53.481467 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7284dd-e51d-40ec-913e-5e3439c13bf5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:53.515752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a20af8-aec8-4bd4-ba3b-d8a6981cf91c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:53.554907 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adaee29-b406-47a8-ba58-4abae4e0781f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:53.556244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaee29-b406-47a8-ba58-4abae4e0781f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:53.556782 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaee29-b406-47a8-ba58-4abae4e0781f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:53.557348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaee29-b406-47a8-ba58-4abae4e0781f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:53.565894 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adaee29-b406-47a8-ba58-4abae4e0781f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:53.567979 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adaee29-b406-47a8-ba58-4abae4e0781f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:53.584045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7adaee29-b406-47a8-ba58-4abae4e0781f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:53.584045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:53.584045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:53.584045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:53.584045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:53.584045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:53.584045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:53.584045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:53.584045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:53.584045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:53.584045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:53.584045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:53.584045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:53.584045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:53.584045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:53.585045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:53.585045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:53.585045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:53.585045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:53.585045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:53.585045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:53.585045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:53.585045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:53.585045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:53.585045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:53.585045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:53.585045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:53.585045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:53.585045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:53.585045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:53.585045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:53.585045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:53.585944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:53.585944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:53.585944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:53.585944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:53.585944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:53.585944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:53.585944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:53.585944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:53.593238 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7284dd-e51d-40ec-913e-5e3439c13bf5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:53.593720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 390/799] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:53.593720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adaee29-b406-47a8-ba58-4abae4e0781f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:53.617324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:53.644181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dde90a-735f-4b57-9bfb-0066d95fbbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:53.645703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dde90a-735f-4b57-9bfb-0066d95fbbdc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:53.646196 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dde90a-735f-4b57-9bfb-0066d95fbbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:53.646702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dde90a-735f-4b57-9bfb-0066d95fbbdc None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:53.648133 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dde90a-735f-4b57-9bfb-0066d95fbbdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:53.649059 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dde90a-735f-4b57-9bfb-0066d95fbbdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:53.651244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dde90a-735f-4b57-9bfb-0066d95fbbdc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:53.669107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 410/800] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:53.671220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dde90a-735f-4b57-9bfb-0066d95fbbdc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:53.714100 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:53.723487 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adaee29-b406-47a8-ba58-4abae4e0781f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:53.777678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714db19f-842d-47cc-bf75-e35cbebc1fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:53.778361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714db19f-842d-47cc-bf75-e35cbebc1fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:53.778645 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714db19f-842d-47cc-bf75-e35cbebc1fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:53.778919 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714db19f-842d-47cc-bf75-e35cbebc1fc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:53.780927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714db19f-842d-47cc-bf75-e35cbebc1fc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:53.781224 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714db19f-842d-47cc-bf75-e35cbebc1fc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:53.782598 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714db19f-842d-47cc-bf75-e35cbebc1fc4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:53.799332 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 391/801] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:53.800596 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714db19f-842d-47cc-bf75-e35cbebc1fc4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:53.825446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dde90a-735f-4b57-9bfb-0066d95fbbdc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:53.873876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae2ae9-a343-4acb-ac16-d4ee9a8b588a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:53.875164 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae2ae9-a343-4acb-ac16-d4ee9a8b588a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:53.876236 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae2ae9-a343-4acb-ac16-d4ee9a8b588a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:53.876590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae2ae9-a343-4acb-ac16-d4ee9a8b588a None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:53.877553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae2ae9-a343-4acb-ac16-d4ee9a8b588a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:53.877883 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae2ae9-a343-4acb-ac16-d4ee9a8b588a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:53.879442 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae2ae9-a343-4acb-ac16-d4ee9a8b588a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:53.892408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:53.899755 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 411/802] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:53.899755 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae2ae9-a343-4acb-ac16-d4ee9a8b588a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:53.927762 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714db19f-842d-47cc-bf75-e35cbebc1fc4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:53.965522 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a3b6c-f1ec-43ef-a62a-5fb073982633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:53.966464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a3b6c-f1ec-43ef-a62a-5fb073982633 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:53.967509 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a3b6c-f1ec-43ef-a62a-5fb073982633 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:53.967830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a3b6c-f1ec-43ef-a62a-5fb073982633 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:53.976158 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a3b6c-f1ec-43ef-a62a-5fb073982633 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:53.977699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a3b6c-f1ec-43ef-a62a-5fb073982633 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:53.993964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-a95a3b6c-f1ec-43ef-a62a-5fb073982633 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:53:53.993964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:53.993964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:53.993964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:53.993964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:53.993964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:53.993964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:53.993964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:53.993964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:53.993964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:53.993964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:53.993964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:53.993964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:53.993964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:53.993964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:53.993964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:53.994938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:53.994938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:53.994938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:53.994938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:53.994938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:53.994938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:53.994938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:53.994938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:53.994938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:53.994938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:53.994938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:53.994938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:53.994938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:53.994938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:53.994938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:53.994938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:53.994938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:53.994938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:53.996147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:53.996147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:53.996147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:53.996147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:53.996147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:53.996147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:53.996147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:53.996147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:53.996147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:53:53.996147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:53.996147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 392/803] 10.222.0.41 () {56 vars in 1117 bytes} [Mon May 30 11:53:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:53.996737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a3b6c-f1ec-43ef-a62a-5fb073982633 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:54.024087 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:54.035589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae2ae9-a343-4acb-ac16-d4ee9a8b588a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:54.072422 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d8c63-ff15-4fd7-bb43-9cf14a3064dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:54.073365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d8c63-ff15-4fd7-bb43-9cf14a3064dc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:54.073656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d8c63-ff15-4fd7-bb43-9cf14a3064dc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:54.074244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d8c63-ff15-4fd7-bb43-9cf14a3064dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:54.087272 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d8c63-ff15-4fd7-bb43-9cf14a3064dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:54.088779 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d8c63-ff15-4fd7-bb43-9cf14a3064dc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:54.106560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-863d8c63-ff15-4fd7-bb43-9cf14a3064dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:54.106560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:54.106560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:54.106560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:54.106560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:54.106560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:54.106560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:54.106560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:54.106560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:54.106560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:54.106560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:54.106560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:54.106560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:54.106560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:54.106560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:54.113288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:54.113288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:54.113288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:54.113288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:54.113288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:54.113288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:54.113288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:54.113288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:54.113288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:54.113288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:54.113288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:54.113288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:54.113288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:54.113288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:54.113288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:54.113288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:54.113288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:54.114227 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:54.114227 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:54.114227 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:54.114227 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:54.114227 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 412/804] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:54.114227 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d8c63-ff15-4fd7-bb43-9cf14a3064dc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:54.127134 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a3b6c-f1ec-43ef-a62a-5fb073982633 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:54.160602 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e00190-8873-45c7-b2e5-b63c76dbaa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:54.161488 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e00190-8873-45c7-b2e5-b63c76dbaa7d None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:54.161765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e00190-8873-45c7-b2e5-b63c76dbaa7d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:54.162040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e00190-8873-45c7-b2e5-b63c76dbaa7d None admin] PATH_INFO: `/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/83e5f980cdb74227bb31c7e7e5eab74b/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:54.164071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e00190-8873-45c7-b2e5-b63c76dbaa7d None admin] RBAC: Authorizing `identity:create_grant(project_id=1e8426fd0e01433b8aa3a3797c687e03, user_id=83e5f980cdb74227bb31c7e7e5eab74b, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:54.165518 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e00190-8873-45c7-b2e5-b63c76dbaa7d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:54.173610 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:54.188469 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 393/805] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:53:53 2022] PUT /identity/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/83e5f980cdb74227bb31c7e7e5eab74b/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:53:54.188469 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb3eb6-e870-4f33-b9ea-850a3442d17d None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:54.188469 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb3eb6-e870-4f33-b9ea-850a3442d17d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:54.188469 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb3eb6-e870-4f33-b9ea-850a3442d17d None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:54.188469 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 394/806] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:54.188469 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb3eb6-e870-4f33-b9ea-850a3442d17d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:54.246620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d8c63-ff15-4fd7-bb43-9cf14a3064dc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:54.289899 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18154b-6074-4a65-9e25-27b58b0ba817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:54.290508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18154b-6074-4a65-9e25-27b58b0ba817 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:54.290795 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18154b-6074-4a65-9e25-27b58b0ba817 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:54.291072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18154b-6074-4a65-9e25-27b58b0ba817 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:54.292111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18154b-6074-4a65-9e25-27b58b0ba817 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:54.292562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18154b-6074-4a65-9e25-27b58b0ba817 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:54.294145 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18154b-6074-4a65-9e25-27b58b0ba817 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:54.311772 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:54.316347 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb3eb6-e870-4f33-b9ea-850a3442d17d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:54.321515 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 413/807] 10.222.0.41 () {56 vars in 1149 bytes} [Mon May 30 11:53:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:54.321515 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfe2b3-def5-44b5-9264-b3b78c67b9f9 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:54.321515 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfe2b3-def5-44b5-9264-b3b78c67b9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:54.321515 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfe2b3-def5-44b5-9264-b3b78c67b9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:54.339352 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-44cfe2b3-def5-44b5-9264-b3b78c67b9f9 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:54.340896 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-44cfe2b3-def5-44b5-9264-b3b78c67b9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:54.368821 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bacdc-3055-4877-b33d-1b15ac3d49fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:54.370030 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bacdc-3055-4877-b33d-1b15ac3d49fd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:54.370467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bacdc-3055-4877-b33d-1b15ac3d49fd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:54.371426 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bacdc-3055-4877-b33d-1b15ac3d49fd None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:54.373428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826bacdc-3055-4877-b33d-1b15ac3d49fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:54.373927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826bacdc-3055-4877-b33d-1b15ac3d49fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:54.376071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826bacdc-3055-4877-b33d-1b15ac3d49fd None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:54.398478 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 395/808] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:54.399659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bacdc-3055-4877-b33d-1b15ac3d49fd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:54.435849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 414/809] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:53:54.435849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfe2b3-def5-44b5-9264-b3b78c67b9f9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:54.484215 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:54.541964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bacdc-3055-4877-b33d-1b15ac3d49fd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:54.559895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfe2b3-def5-44b5-9264-b3b78c67b9f9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:54.586909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11dadd4-4e17-4a31-b177-f502b8573c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:54.588013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dadd4-4e17-4a31-b177-f502b8573c77 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:54.588443 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dadd4-4e17-4a31-b177-f502b8573c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:54.588881 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dadd4-4e17-4a31-b177-f502b8573c77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:54.600019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11dadd4-4e17-4a31-b177-f502b8573c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:54.600201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:54.602144 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11dadd4-4e17-4a31-b177-f502b8573c77 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:54.608629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b812-10ce-4e06-bb82-6c1ab3152c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:54.609536 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b812-10ce-4e06-bb82-6c1ab3152c04 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:54.609824 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b812-10ce-4e06-bb82-6c1ab3152c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:54.610104 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b812-10ce-4e06-bb82-6c1ab3152c04 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:54.619533 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68b812-10ce-4e06-bb82-6c1ab3152c04 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:54.621276 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68b812-10ce-4e06-bb82-6c1ab3152c04 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:54.625686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b11dadd4-4e17-4a31-b177-f502b8573c77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:54.625686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:54.625686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:54.625686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:54.625686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:54.625686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:54.625686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:54.625686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:54.625686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:54.625686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:54.625686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:54.625686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:54.625686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:54.625686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:54.625686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:54.626744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:54.626744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:54.626744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:54.626744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:54.626744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:54.626744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:54.626744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:54.626744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:54.626744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:54.626744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:54.626744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:54.626744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:54.626744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:54.626744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:54.626744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:54.626744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:54.626744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:54.632018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:54.632018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:54.632018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:54.632018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:54.633993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 396/810] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:54.635032 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11dadd4-4e17-4a31-b177-f502b8573c77 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:54.638652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-7d68b812-10ce-4e06-bb82-6c1ab3152c04 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 30 11:53:54.638652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:54.638652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:54.638652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:54.638652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:54.638652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:54.638652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:54.638652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:54.638652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:54.638652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:54.638652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:54.638652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:54.638652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:54.638652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:54.638652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:54.638652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:54.639857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:54.639857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:54.639857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:54.639857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:54.639857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:54.639857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:54.639857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:54.639857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:54.639857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:54.639857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:54.639857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:54.639857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:54.639857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:54.639857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:54.639857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:54.639857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:54.639857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:54.639857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:54.641116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:54.641116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:54.641116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:54.641116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:54.641116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:54.641116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:54.641116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:54.641116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:54.641116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 30 11:53:54.641116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:54.641116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 415/811] 10.222.0.41 () {56 vars in 1093 bytes} [Mon May 30 11:53:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:54.643221 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b812-10ce-4e06-bb82-6c1ab3152c04 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:54.765679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b812-10ce-4e06-bb82-6c1ab3152c04 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:54.792608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11dadd4-4e17-4a31-b177-f502b8573c77 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:54.805885 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63901bf6-3585-41a0-b8c5-050fdd2145cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:54.806826 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63901bf6-3585-41a0-b8c5-050fdd2145cf None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:54.807170 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:54.807449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63901bf6-3585-41a0-b8c5-050fdd2145cf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:54.808247 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63901bf6-3585-41a0-b8c5-050fdd2145cf None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:54.809242 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63901bf6-3585-41a0-b8c5-050fdd2145cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:54.809799 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63901bf6-3585-41a0-b8c5-050fdd2145cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:54.812999 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63901bf6-3585-41a0-b8c5-050fdd2145cf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:54.833016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 416/812] 10.222.0.41 () {56 vars in 1133 bytes} [Mon May 30 11:53:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:54.834126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63901bf6-3585-41a0-b8c5-050fdd2145cf None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:54.841066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e27255-5775-4170-a125-8ea1d0c9ab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:54.842040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e27255-5775-4170-a125-8ea1d0c9ab8a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:54.842510 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e27255-5775-4170-a125-8ea1d0c9ab8a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:54.842908 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e27255-5775-4170-a125-8ea1d0c9ab8a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:54.844113 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e27255-5775-4170-a125-8ea1d0c9ab8a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:54.845598 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e27255-5775-4170-a125-8ea1d0c9ab8a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:54.862753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-62e27255-5775-4170-a125-8ea1d0c9ab8a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 30 11:53:54.862753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:54.862753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:53:54.862753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:53:54.862753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:53:54.862753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:53:54.862753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:53:54.862753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:53:54.862753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 30 11:53:54.862753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:54.862753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:53:54.862753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:54.862753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:54.862753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:54.862753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:54.862753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:54.864037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:54.864037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:54.864037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:54.864037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:54.864037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:54.864037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:54.864037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:54.864037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:53:54.864037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:53:54.864037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:53:54.864037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:53:54.864037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:54.864037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:54.864037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:54.864037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:54.864037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:54.864872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:54.864872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:54.864872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:54.864872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:54.864872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:54.864872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:54.864872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:54.864872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:54.864872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:54.864872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:54.864872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:54.864872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:53:54.864872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:53:54.864872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 30 11:53:54.864872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:54.870546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 397/813] 10.222.0.41 () {56 vars in 1129 bytes} [Mon May 30 11:53:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:54.870546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e27255-5775-4170-a125-8ea1d0c9ab8a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:54.895999 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:54.965982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63901bf6-3585-41a0-b8c5-050fdd2145cf None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:54.992334 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e27255-5775-4170-a125-8ea1d0c9ab8a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:55.013959 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013a93d-cc1d-49b4-ae80-db2085ac8f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:55.014858 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013a93d-cc1d-49b4-ae80-db2085ac8f77 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:55.015390 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013a93d-cc1d-49b4-ae80-db2085ac8f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:55.015680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013a93d-cc1d-49b4-ae80-db2085ac8f77 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:55.016459 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013a93d-cc1d-49b4-ae80-db2085ac8f77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:55.016771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013a93d-cc1d-49b4-ae80-db2085ac8f77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:55.018887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013a93d-cc1d-49b4-ae80-db2085ac8f77 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:55.030348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e82257-355e-4814-b6ac-3370a2af2411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:55.031378 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e82257-355e-4814-b6ac-3370a2af2411 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:55.031901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e82257-355e-4814-b6ac-3370a2af2411 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:55.032382 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e82257-355e-4814-b6ac-3370a2af2411 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:55.034523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 417/814] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:55.035376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013a93d-cc1d-49b4-ae80-db2085ac8f77 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:55.084464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:55.113997 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e82257-355e-4814-b6ac-3370a2af2411 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:55.115492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e82257-355e-4814-b6ac-3370a2af2411 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:55.143530 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013a93d-cc1d-49b4-ae80-db2085ac8f77 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:55.152395 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:55.180201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1deb74b-0932-4370-8ead-3700d5b1d629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:55.180864 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1deb74b-0932-4370-8ead-3700d5b1d629 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:55.181351 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1deb74b-0932-4370-8ead-3700d5b1d629 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:55.181460 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1deb74b-0932-4370-8ead-3700d5b1d629 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:55.182117 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1deb74b-0932-4370-8ead-3700d5b1d629 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:55.182427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1deb74b-0932-4370-8ead-3700d5b1d629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:55.183920 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1deb74b-0932-4370-8ead-3700d5b1d629 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:55.193343 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 418/815] 10.222.0.41 () {56 vars in 1124 bytes} [Mon May 30 11:53:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:55.193343 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1deb74b-0932-4370-8ead-3700d5b1d629 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:55.240095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 398/816] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:53:55.240095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3c2ed-e402-43f2-97cd-d48be09afcaf None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:55.240095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3c2ed-e402-43f2-97cd-d48be09afcaf None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:55.240095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3c2ed-e402-43f2-97cd-d48be09afcaf None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:55.242867 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 399/817] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:55.243639 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3c2ed-e402-43f2-97cd-d48be09afcaf None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:55.298272 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1deb74b-0932-4370-8ead-3700d5b1d629 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:55.325064 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:55.334068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a242d-3823-462f-9d96-7ce668be59c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:55.334915 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a242d-3823-462f-9d96-7ce668be59c8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:55.335190 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a242d-3823-462f-9d96-7ce668be59c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:55.335431 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a242d-3823-462f-9d96-7ce668be59c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:55.343153 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a242d-3823-462f-9d96-7ce668be59c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:55.344635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a242d-3823-462f-9d96-7ce668be59c8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:55.355024 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3c2ed-e402-43f2-97cd-d48be09afcaf None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:55.359679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-841a242d-3823-462f-9d96-7ce668be59c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:55.359679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:55.359679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:55.359679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:55.359679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:55.359679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:55.359679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:55.359679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:55.359679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:55.359679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:55.359679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:55.359679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:55.359679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:55.359679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:55.359679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:55.360555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:55.360555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:55.360555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:55.360555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:55.360555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:55.360555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:55.360555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:55.360555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:55.360555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:55.360555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:55.360555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:55.360555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:55.360555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:55.360555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:55.360555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:55.360555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:55.360555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:55.361408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:55.361408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:55.361408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:55.361408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:55.361408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:55.361408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:55.361408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:55.361408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:55.365584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 419/818] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:55.366421 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a242d-3823-462f-9d96-7ce668be59c8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:55.393312 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e2a98-7529-494c-abdc-58cd18b1a597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:55.394294 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e2a98-7529-494c-abdc-58cd18b1a597 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:55.394572 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e2a98-7529-494c-abdc-58cd18b1a597 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:55.394846 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e2a98-7529-494c-abdc-58cd18b1a597 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:55.395636 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e2a98-7529-494c-abdc-58cd18b1a597 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:55.395864 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e2a98-7529-494c-abdc-58cd18b1a597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:55.397229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e2a98-7529-494c-abdc-58cd18b1a597 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:55.400267 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:55.402959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 400/819] 10.222.0.41 () {56 vars in 1124 bytes} [Mon May 30 11:53:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:55.405092 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac28e2-af13-4b7d-a80f-4b4f84e717d4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:55.405390 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac28e2-af13-4b7d-a80f-4b4f84e717d4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:55.405665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac28e2-af13-4b7d-a80f-4b4f84e717d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:55.426136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-cfac28e2-af13-4b7d-a80f-4b4f84e717d4 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:55.427616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cfac28e2-af13-4b7d-a80f-4b4f84e717d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:55.485181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a242d-3823-462f-9d96-7ce668be59c8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:55.506217 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 401/820] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:53:55.507417 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac28e2-af13-4b7d-a80f-4b4f84e717d4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:55.527803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c37af2-bca9-4502-9854-5ad2d546a59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:55.528634 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c37af2-bca9-4502-9854-5ad2d546a59c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:55.528936 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c37af2-bca9-4502-9854-5ad2d546a59c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:55.529296 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c37af2-bca9-4502-9854-5ad2d546a59c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:55.540561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c37af2-bca9-4502-9854-5ad2d546a59c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:55.542002 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c37af2-bca9-4502-9854-5ad2d546a59c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:55.563126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-e4c37af2-bca9-4502-9854-5ad2d546a59c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:55.563126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:55.563126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:55.563126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:55.563126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:55.563126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:55.563126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:55.563126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:55.563126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:55.563126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:55.563126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:55.563126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:55.563126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:55.563126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:55.563126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:55.564255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:55.564255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:55.564255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:55.564255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:55.564255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:55.564255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:55.564255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:55.564255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:55.564255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:55.564255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:55.564255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:55.564255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:55.564255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:55.564255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:55.564255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:55.564255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:55.564255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:55.565113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:55.565113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:55.565113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:55.565113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:55.565113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 420/821] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:55.565113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c37af2-bca9-4502-9854-5ad2d546a59c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:55.593663 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:55.631008 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac28e2-af13-4b7d-a80f-4b4f84e717d4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:55.651174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:55.667871 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8220af-34c2-4961-98d3-fc8277e5dbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:55.668174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c37af2-bca9-4502-9854-5ad2d546a59c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:55.668547 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8220af-34c2-4961-98d3-fc8277e5dbdb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:55.668835 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8220af-34c2-4961-98d3-fc8277e5dbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:55.669118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8220af-34c2-4961-98d3-fc8277e5dbdb None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:55.670614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8220af-34c2-4961-98d3-fc8277e5dbdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:55.671704 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8220af-34c2-4961-98d3-fc8277e5dbdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:55.673183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8220af-34c2-4961-98d3-fc8277e5dbdb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:55.685002 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 402/822] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:55.690907 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8220af-34c2-4961-98d3-fc8277e5dbdb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:55.705398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ba897-cc36-4b82-9dbd-3fa7688e8098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:55.706063 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ba897-cc36-4b82-9dbd-3fa7688e8098 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:55.706349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ba897-cc36-4b82-9dbd-3fa7688e8098 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:55.706628 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ba897-cc36-4b82-9dbd-3fa7688e8098 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:55.707373 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ba897-cc36-4b82-9dbd-3fa7688e8098 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:55.708787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ba897-cc36-4b82-9dbd-3fa7688e8098 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:55.739852 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 421/823] 10.222.0.41 () {60 vars in 1144 bytes} [Mon May 30 11:53:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:53:55.739852 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ba897-cc36-4b82-9dbd-3fa7688e8098 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:55.835768 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8220af-34c2-4961-98d3-fc8277e5dbdb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:55.869518 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ba897-cc36-4b82-9dbd-3fa7688e8098 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:55.875673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:55.887087 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a0d31-f58b-4c89-b07b-6630168c428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:55.888941 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a0d31-f58b-4c89-b07b-6630168c428c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:55.889365 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a0d31-f58b-4c89-b07b-6630168c428c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:55.890340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a0d31-f58b-4c89-b07b-6630168c428c None admin] PATH_INFO: `/v3/services/network` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:55.891121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a0d31-f58b-4c89-b07b-6630168c428c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:55.893090 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a0d31-f58b-4c89-b07b-6630168c428c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:55.911450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7e8a0d31-f58b-4c89-b07b-6630168c428c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 30 11:53:55.911450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:55.911450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:53:55.911450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:53:55.911450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:53:55.911450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:53:55.911450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:53:55.911450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:53:55.911450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 30 11:53:55.911450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:55.911450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:53:55.911450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:55.911450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:55.911450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:55.911450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:55.911450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:55.911450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:55.912558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:55.912558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:55.912558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:55.912558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:55.912558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:55.912558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:55.912558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:53:55.912558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:53:55.912558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:53:55.912558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:53:55.912558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:55.912558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:55.912558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:55.912558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:55.912558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:55.912558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:55.913618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:55.913618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:55.913618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:55.913618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:55.913618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:55.913618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:55.913618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:55.913618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:55.913618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:55.913618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:55.913618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:53:55.913618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:53:55.913618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 30 11:53:55.913618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:55.913618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 403/824] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:55 2022] GET /identity/v3/services/network => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:55.914806 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a0d31-f58b-4c89-b07b-6630168c428c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:55.917961 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ca5a3-a23f-4c57-8eac-26509169ef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:55.918804 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ca5a3-a23f-4c57-8eac-26509169ef01 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:55.919265 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ca5a3-a23f-4c57-8eac-26509169ef01 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:55.920382 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ca5a3-a23f-4c57-8eac-26509169ef01 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:55.921272 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ca5a3-a23f-4c57-8eac-26509169ef01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:55.921690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ca5a3-a23f-4c57-8eac-26509169ef01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:55.923212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ca5a3-a23f-4c57-8eac-26509169ef01 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:55.926970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:55.943185 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 422/825] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:55.943185 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ca5a3-a23f-4c57-8eac-26509169ef01 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:56.050657 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a0d31-f58b-4c89-b07b-6630168c428c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:56.073293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ca5a3-a23f-4c57-8eac-26509169ef01 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:56.091596 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30005f2c-45f5-4588-a680-d0a41c1d9802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:56.092778 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30005f2c-45f5-4588-a680-d0a41c1d9802 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:56.093131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30005f2c-45f5-4588-a680-d0a41c1d9802 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:56.093536 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30005f2c-45f5-4588-a680-d0a41c1d9802 None admin] PATH_INFO: `/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/a63dd78421064bbe838b1ed0261c13bb/roles/dc57e0b7f67947e0b6b63c4ad0148358` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:56.116516 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb175e-1019-4b30-8a1f-24cca9326625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:56.116750 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30005f2c-45f5-4588-a680-d0a41c1d9802 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e8426fd0e01433b8aa3a3797c687e03, user_id=a63dd78421064bbe838b1ed0261c13bb, role_id=dc57e0b7f67947e0b6b63c4ad0148358)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:56.117189 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb175e-1019-4b30-8a1f-24cca9326625 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:56.117478 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb175e-1019-4b30-8a1f-24cca9326625 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:56.117761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb175e-1019-4b30-8a1f-24cca9326625 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:56.118106 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30005f2c-45f5-4588-a680-d0a41c1d9802 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:56.118480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb175e-1019-4b30-8a1f-24cca9326625 None admin] RBAC: Adding query filter params (name=network) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:56.118791 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb175e-1019-4b30-8a1f-24cca9326625 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:56.120347 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb175e-1019-4b30-8a1f-24cca9326625 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:56.126910 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 423/826] 10.222.0.41 () {56 vars in 1112 bytes} [Mon May 30 11:53:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:56.127755 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb175e-1019-4b30-8a1f-24cca9326625 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:56.140248 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 404/827] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:53:55 2022] PUT /identity/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/a63dd78421064bbe838b1ed0261c13bb/roles/dc57e0b7f67947e0b6b63c4ad0148358 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:53:56.141161 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30005f2c-45f5-4588-a680-d0a41c1d9802 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:56.240023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:56.250235 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:56.304767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb175e-1019-4b30-8a1f-24cca9326625 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:56.347025 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d543f2c-b540-4804-966d-e676a629838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:56.348008 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d543f2c-b540-4804-966d-e676a629838c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:56.348293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d543f2c-b540-4804-966d-e676a629838c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:56.348572 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d543f2c-b540-4804-966d-e676a629838c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:56.358066 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d543f2c-b540-4804-966d-e676a629838c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:56.360337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d543f2c-b540-4804-966d-e676a629838c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:56.382065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-4d543f2c-b540-4804-966d-e676a629838c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:56.382065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:56.382065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:56.382065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:56.382065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:56.382065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:56.382065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:56.382065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:56.382065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:56.382065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:56.382065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:56.382065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:56.382065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:56.382065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:56.382065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:56.382977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:56.382977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:56.382977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:56.382977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:56.382977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:56.382977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:56.382977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:56.382977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:56.382977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:56.382977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:56.382977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:56.382977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:56.382977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:56.382977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:56.382977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:56.382977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:56.382977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:56.383887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:56.383887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:56.383887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:56.383887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:56.383887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:56.383887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:56.383887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:56.383887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:56.391729 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 424/828] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:56.393987 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d543f2c-b540-4804-966d-e676a629838c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:56.410365 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30005f2c-45f5-4588-a680-d0a41c1d9802 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:56.459923 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1f96b-bac5-4f31-b923-978b8b4d1d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:56.460616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1f96b-bac5-4f31-b923-978b8b4d1d93 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:56.460926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1f96b-bac5-4f31-b923-978b8b4d1d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:56.461211 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1f96b-bac5-4f31-b923-978b8b4d1d93 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:56.462131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1f96b-bac5-4f31-b923-978b8b4d1d93 None admin] RBAC: Adding query filter params (type=network) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:56.462446 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1f96b-bac5-4f31-b923-978b8b4d1d93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:56.464762 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1f96b-bac5-4f31-b923-978b8b4d1d93 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:56.472647 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 405/829] 10.222.0.41 () {56 vars in 1112 bytes} [Mon May 30 11:53:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:56.477903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1f96b-bac5-4f31-b923-978b8b4d1d93 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:56.539763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d543f2c-b540-4804-966d-e676a629838c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:56.561449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:56.582551 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0875c5-f8b4-464b-98b9-5c228f5e28de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:56.582551 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0875c5-f8b4-464b-98b9-5c228f5e28de None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:56.582551 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0875c5-f8b4-464b-98b9-5c228f5e28de None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:56.582551 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0875c5-f8b4-464b-98b9-5c228f5e28de None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:56.582982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0875c5-f8b4-464b-98b9-5c228f5e28de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:56.582982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0875c5-f8b4-464b-98b9-5c228f5e28de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:56.582982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0875c5-f8b4-464b-98b9-5c228f5e28de None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:56.599628 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 425/830] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:56.601147 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d93b1-aaed-4081-92db-872a2d74c052 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:56.601448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d93b1-aaed-4081-92db-872a2d74c052 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:56.601735 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d93b1-aaed-4081-92db-872a2d74c052 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:56.603870 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 426/831] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:56.604391 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d93b1-aaed-4081-92db-872a2d74c052 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:56.630433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1f96b-bac5-4f31-b923-978b8b4d1d93 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:56.656051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:56.669272 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc01af-192c-4030-80ee-a14cc40278f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:56.670698 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc01af-192c-4030-80ee-a14cc40278f8 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:56.671349 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc01af-192c-4030-80ee-a14cc40278f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:56.671884 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc01af-192c-4030-80ee-a14cc40278f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:56.672892 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc01af-192c-4030-80ee-a14cc40278f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:56.674394 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc01af-192c-4030-80ee-a14cc40278f8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:56.698563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 406/832] 10.222.0.41 () {60 vars in 1144 bytes} [Mon May 30 11:53:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:53:56.700161 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6c851-6f05-4365-9fe1-d8e0c0a34250 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:56.700606 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6c851-6f05-4365-9fe1-d8e0c0a34250 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:56.701646 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6c851-6f05-4365-9fe1-d8e0c0a34250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:56.722168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-41c6c851-6f05-4365-9fe1-d8e0c0a34250 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:56.723131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d93b1-aaed-4081-92db-872a2d74c052 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:56.723733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-41c6c851-6f05-4365-9fe1-d8e0c0a34250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:56.763179 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353a159-c7f9-4569-938b-81e84644e795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:56.764665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353a159-c7f9-4569-938b-81e84644e795 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:56.765150 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353a159-c7f9-4569-938b-81e84644e795 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:56.765454 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353a159-c7f9-4569-938b-81e84644e795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:56.767403 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353a159-c7f9-4569-938b-81e84644e795 None admin] RBAC: Adding query filter params (role.id=8196ef570097443bac15d3cf39878486, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=bb3820a613744c15b840681fe6b6e808) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:56.771917 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353a159-c7f9-4569-938b-81e84644e795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:56.773630 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353a159-c7f9-4569-938b-81e84644e795 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:56.789537 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 427/833] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:53:56 2022] GET /identity/v3/role_assignments?user.id=bb3820a613744c15b840681fe6b6e808&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=8196ef570097443bac15d3cf39878486 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:56.812704 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 407/834] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:53:56.837483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353a159-c7f9-4569-938b-81e84644e795 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:56.888680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:56.958440 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353a159-c7f9-4569-938b-81e84644e795 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:56.997369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb99db-9dad-4940-9f53-65c3cbc198ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:56.999212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb99db-9dad-4940-9f53-65c3cbc198ea None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:56.999735 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb99db-9dad-4940-9f53-65c3cbc198ea None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:57.000252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb99db-9dad-4940-9f53-65c3cbc198ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:57.014237 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb99db-9dad-4940-9f53-65c3cbc198ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:57.022653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-aedb99db-9dad-4940-9f53-65c3cbc198ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:53:57.022653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:57.022653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:57.022653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:57.022653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:57.022653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:57.022653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:57.022653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:57.022653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:57.022653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:57.022653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:57.022653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:57.022653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:57.022653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:57.022653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:57.022653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:57.023665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:57.023665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:57.023665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:57.023665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:57.023665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:57.023665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:57.023665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:57.023665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:57.023665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:57.023665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:57.023665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:57.023665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:57.023665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:57.023665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:57.023665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:57.023665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:57.024575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:57.024575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:57.024575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:57.024575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:57.024575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:57.024575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:57.024575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:57.024575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:57.024575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:57.024575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:57.024575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:53:57.024575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:57.027427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 428/835] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:53:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:57.033494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6c851-6f05-4365-9fe1-d8e0c0a34250 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:57.143854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:57.152954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6c851-6f05-4365-9fe1-d8e0c0a34250 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:57.195557 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13c96d-3400-4169-ac69-76ed8fc42417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:57.196393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13c96d-3400-4169-ac69-76ed8fc42417 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:57.196755 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13c96d-3400-4169-ac69-76ed8fc42417 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:57.197109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13c96d-3400-4169-ac69-76ed8fc42417 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:57.197976 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13c96d-3400-4169-ac69-76ed8fc42417 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:57.198367 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13c96d-3400-4169-ac69-76ed8fc42417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:57.199921 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13c96d-3400-4169-ac69-76ed8fc42417 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:57.209947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 408/836] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:53:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:57.218143 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb99db-9dad-4940-9f53-65c3cbc198ea None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:57.324072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:57.327302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb99db-9dad-4940-9f53-65c3cbc198ea None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:57.363876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78114366-7c4d-4c20-a7c6-3f764c7be058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:57.364773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78114366-7c4d-4c20-a7c6-3f764c7be058 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:57.365133 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78114366-7c4d-4c20-a7c6-3f764c7be058 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:57.365584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78114366-7c4d-4c20-a7c6-3f764c7be058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:57.377071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78114366-7c4d-4c20-a7c6-3f764c7be058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:57.378625 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78114366-7c4d-4c20-a7c6-3f764c7be058 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:57.396110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-78114366-7c4d-4c20-a7c6-3f764c7be058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:57.396110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:57.396110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:57.396110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:57.396110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:57.396110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:57.396110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:57.396110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:57.396110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:57.396110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:57.396110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:57.396110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:57.396110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:57.396110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:57.396110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:57.397268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:57.397268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:57.397268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:57.397268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:57.397268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:57.397268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:57.397268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:57.397268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:57.397268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:57.397268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:57.397268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:57.397268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:57.397268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:57.397268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:57.397268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:57.397268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:57.397268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:57.398431 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:57.398431 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:57.398431 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:57.398431 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:57.403718 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 429/837] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:57.405627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13c96d-3400-4169-ac69-76ed8fc42417 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:57.514145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13c96d-3400-4169-ac69-76ed8fc42417 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:57.553803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257b2a5-cecf-4399-8fa6-f32be730e96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:57.554590 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257b2a5-cecf-4399-8fa6-f32be730e96a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:57.554947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257b2a5-cecf-4399-8fa6-f32be730e96a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:57.555298 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257b2a5-cecf-4399-8fa6-f32be730e96a None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:57.556157 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257b2a5-cecf-4399-8fa6-f32be730e96a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:57.556546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257b2a5-cecf-4399-8fa6-f32be730e96a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:57.558032 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257b2a5-cecf-4399-8fa6-f32be730e96a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:57.572720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 409/838] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:57.578913 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78114366-7c4d-4c20-a7c6-3f764c7be058 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:57.696694 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78114366-7c4d-4c20-a7c6-3f764c7be058 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:57.733480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83677e54-8e5f-4dce-b3c3-0228c312136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:57.734282 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83677e54-8e5f-4dce-b3c3-0228c312136a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:57.734569 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83677e54-8e5f-4dce-b3c3-0228c312136a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:57.734852 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83677e54-8e5f-4dce-b3c3-0228c312136a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:57.742922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83677e54-8e5f-4dce-b3c3-0228c312136a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:57.744404 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83677e54-8e5f-4dce-b3c3-0228c312136a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:57.759727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-83677e54-8e5f-4dce-b3c3-0228c312136a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 30 11:53:57.759727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:57.759727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:57.759727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:57.759727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:57.759727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:57.759727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:57.759727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:57.759727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:57.759727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:57.759727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:57.759727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:57.759727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:53:57.759727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:53:57.759727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:53:57.759727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:53:57.760738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:57.760738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:57.760738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:53:57.760738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:57.760738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:53:57.760738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:53:57.760738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:57.760738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:57.760738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:57.760738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:57.760738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:57.760738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:57.760738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:57.760738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:57.760738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:57.760738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:57.760738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:57.760738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:57.761668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:57.761668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:57.761668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:53:57.761668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:53:57.761668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:53:57.761668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:53:57.761668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:53:57.761668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:53:57.761668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 30 11:53:57.761668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:57.761668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 430/839] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:53:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:57.779144 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257b2a5-cecf-4399-8fa6-f32be730e96a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:57.800142 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:57.888095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257b2a5-cecf-4399-8fa6-f32be730e96a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:57.924270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497314b-d3a6-4fde-9b73-a9a6fa908ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:57.924948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497314b-d3a6-4fde-9b73-a9a6fa908ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:57.925241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497314b-d3a6-4fde-9b73-a9a6fa908ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:57.925519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497314b-d3a6-4fde-9b73-a9a6fa908ba5 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:57.926361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497314b-d3a6-4fde-9b73-a9a6fa908ba5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:57.926671 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497314b-d3a6-4fde-9b73-a9a6fa908ba5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:57.928139 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497314b-d3a6-4fde-9b73-a9a6fa908ba5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:57.946912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 410/840] 10.222.0.41 () {56 vars in 1135 bytes} [Mon May 30 11:53:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:57.953018 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83677e54-8e5f-4dce-b3c3-0228c312136a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:57.970092 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:58.068227 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83677e54-8e5f-4dce-b3c3-0228c312136a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:58.104607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c47bd-fb6b-48de-b10f-ddb9e76b336d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:58.105625 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c47bd-fb6b-48de-b10f-ddb9e76b336d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:58.106126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c47bd-fb6b-48de-b10f-ddb9e76b336d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:58.106618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c47bd-fb6b-48de-b10f-ddb9e76b336d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:58.179843 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c47bd-fb6b-48de-b10f-ddb9e76b336d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:58.181699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c47bd-fb6b-48de-b10f-ddb9e76b336d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:58.196843 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:58.290495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 431/841] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:53:57 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:53:58.296578 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497314b-d3a6-4fde-9b73-a9a6fa908ba5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:58.379365 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:58.386839 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2c1a4-6fa8-44c5-9779-f73459dbdef6 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:58.387153 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2c1a4-6fa8-44c5-9779-f73459dbdef6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:58.387409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2c1a4-6fa8-44c5-9779-f73459dbdef6 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:58.389272 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 432/842] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:53:58.395149 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1f591-f809-4d89-b6e3-210a20bfda86 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:58.395458 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1f591-f809-4d89-b6e3-210a20bfda86 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:58.395719 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1f591-f809-4d89-b6e3-210a20bfda86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:58.415002 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-69e1f591-f809-4d89-b6e3-210a20bfda86 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:58.416804 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-69e1f591-f809-4d89-b6e3-210a20bfda86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:58.418809 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497314b-d3a6-4fde-9b73-a9a6fa908ba5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:58.462186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769a756-45ba-4108-9711-f044f41ce97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:58.463009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769a756-45ba-4108-9711-f044f41ce97f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:58.463289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769a756-45ba-4108-9711-f044f41ce97f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:58.463553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769a756-45ba-4108-9711-f044f41ce97f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:58.475662 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769a756-45ba-4108-9711-f044f41ce97f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:58.477238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769a756-45ba-4108-9711-f044f41ce97f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:58.498348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d769a756-45ba-4108-9711-f044f41ce97f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:58.498348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:58.498348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:58.498348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:58.498348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:58.498348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:58.498348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:58.498348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:58.498348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:58.498348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:58.498348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:58.498348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:58.498348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:58.498348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:58.498348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:58.499666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:58.499666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:58.499666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:58.499666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:58.499666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:58.499666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:58.499666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:58.499666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:58.499666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:58.499666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:58.499666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:58.499666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:58.499666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:58.499666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:58.499666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:58.499666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:58.499666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:58.500580 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:58.500580 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:58.500580 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:58.500580 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:58.503911 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 411/843] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:58.505191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 433/844] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:53:58.505393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769a756-45ba-4108-9711-f044f41ce97f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:58.528053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1f591-f809-4d89-b6e3-210a20bfda86 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:58.573541 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:58.625216 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769a756-45ba-4108-9711-f044f41ce97f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:58.644930 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1f591-f809-4d89-b6e3-210a20bfda86 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:58.649854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:58.663604 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e3ef4-a0bc-4dc1-8b7c-9d9449812cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:58.664485 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e3ef4-a0bc-4dc1-8b7c-9d9449812cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:58.664785 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e3ef4-a0bc-4dc1-8b7c-9d9449812cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:58.665062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e3ef4-a0bc-4dc1-8b7c-9d9449812cd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:58.666212 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e3ef4-a0bc-4dc1-8b7c-9d9449812cd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:58.666524 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e3ef4-a0bc-4dc1-8b7c-9d9449812cd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:58.667921 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e3ef4-a0bc-4dc1-8b7c-9d9449812cd9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:58.684053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873ab18-fe49-4dab-8c54-5c5c2dd8e165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:58.684598 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 412/845] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:58.686266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873ab18-fe49-4dab-8c54-5c5c2dd8e165 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:58.686266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873ab18-fe49-4dab-8c54-5c5c2dd8e165 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:58.686568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873ab18-fe49-4dab-8c54-5c5c2dd8e165 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:58.687174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873ab18-fe49-4dab-8c54-5c5c2dd8e165 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:58.689200 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873ab18-fe49-4dab-8c54-5c5c2dd8e165 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:58.690441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e3ef4-a0bc-4dc1-8b7c-9d9449812cd9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:58.704268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-e873ab18-fe49-4dab-8c54-5c5c2dd8e165 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 30 11:53:58.704268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:58.704268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:53:58.704268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:53:58.704268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:53:58.704268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:53:58.704268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:53:58.704268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:53:58.704268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 30 11:53:58.704268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:58.704268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:53:58.704268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:58.704268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:58.704268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:58.704268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:58.704268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:58.704268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:58.705337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:58.705337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:58.705337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:58.705337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:58.705337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:58.705337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:58.705337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:53:58.705337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:53:58.705337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:53:58.705337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:53:58.705337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:58.705337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:58.705337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:58.705337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:58.705337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:58.705337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:58.706195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:58.706195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:58.706195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:58.706195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:58.706195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:58.706195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:58.706195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:58.706195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:58.706195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:58.706195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:58.706195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:53:58.706195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:53:58.706195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 30 11:53:58.706195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:58.708985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 434/846] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:53:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:53:58.714783 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873ab18-fe49-4dab-8c54-5c5c2dd8e165 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:58.811726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e3ef4-a0bc-4dc1-8b7c-9d9449812cd9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:58.820461 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873ab18-fe49-4dab-8c54-5c5c2dd8e165 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:58.828273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:58.848156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ed4c5-cb7f-430f-bdd4-4a5ae7dc88b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:58.848961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed4c5-cb7f-430f-bdd4-4a5ae7dc88b3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:58.849251 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed4c5-cb7f-430f-bdd4-4a5ae7dc88b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:58.849528 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed4c5-cb7f-430f-bdd4-4a5ae7dc88b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:58.856722 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ed4c5-cb7f-430f-bdd4-4a5ae7dc88b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:58.858339 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ed4c5-cb7f-430f-bdd4-4a5ae7dc88b3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:58.859450 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c35cf-9be5-48ef-a9fa-eaa945848a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:58.860157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c35cf-9be5-48ef-a9fa-eaa945848a1b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:58.860445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c35cf-9be5-48ef-a9fa-eaa945848a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:58.860727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c35cf-9be5-48ef-a9fa-eaa945848a1b None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:58.861438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c35cf-9be5-48ef-a9fa-eaa945848a1b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:58.861746 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c35cf-9be5-48ef-a9fa-eaa945848a1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:58.863098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c35cf-9be5-48ef-a9fa-eaa945848a1b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:58.867968 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 435/847] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:53:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:53:58.873774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-403ed4c5-cb7f-430f-bdd4-4a5ae7dc88b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:58.873774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:58.873774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:58.873774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:58.873774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:58.873774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:58.873774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:58.873774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:58.873774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:58.873774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:58.873774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:58.873774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:58.873774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:53:58.873774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:53:58.873774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:53:58.874866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:53:58.874866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:58.874866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:58.874866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:58.874866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:58.874866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:58.874866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:58.874866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:58.874866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:58.874866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:58.874866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:58.874866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:58.874866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:58.874866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:58.874866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:58.874866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:58.874866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:58.876062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:53:58.876062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:53:58.876062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:53:58.876062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:53:58.876062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:53:58.876062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:53:58.876062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:53:58.876062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:58.876606 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af1f3f-7dcb-495e-9542-13f0ae7b4de8 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:58.876777 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af1f3f-7dcb-495e-9542-13f0ae7b4de8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:58.877150 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af1f3f-7dcb-495e-9542-13f0ae7b4de8 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:58.878742 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 436/848] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:58.879675 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 413/849] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:53:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:58.880653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af1f3f-7dcb-495e-9542-13f0ae7b4de8 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:58.881839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ed4c5-cb7f-430f-bdd4-4a5ae7dc88b3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:58.932806 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:58.993795 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ed4c5-cb7f-430f-bdd4-4a5ae7dc88b3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:58.994625 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af1f3f-7dcb-495e-9542-13f0ae7b4de8 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:59.031192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf95fd4-8b1d-48b6-8524-e5cca2f09b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:59.031894 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf95fd4-8b1d-48b6-8524-e5cca2f09b08 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:59.032182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf95fd4-8b1d-48b6-8524-e5cca2f09b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:59.032284 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d03aa9-c693-43ff-98ad-5f49222e900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:59.032489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf95fd4-8b1d-48b6-8524-e5cca2f09b08 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:59.032896 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d03aa9-c693-43ff-98ad-5f49222e900c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:59.033181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d03aa9-c693-43ff-98ad-5f49222e900c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:59.033285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf95fd4-8b1d-48b6-8524-e5cca2f09b08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:59.033457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d03aa9-c693-43ff-98ad-5f49222e900c None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:59.033559 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf95fd4-8b1d-48b6-8524-e5cca2f09b08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:59.034159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d03aa9-c693-43ff-98ad-5f49222e900c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:59.034472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d03aa9-c693-43ff-98ad-5f49222e900c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:59.034968 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf95fd4-8b1d-48b6-8524-e5cca2f09b08 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:59.035827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d03aa9-c693-43ff-98ad-5f49222e900c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:59.052026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 437/850] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:53:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:59.052026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddd133-680f-47a5-a934-5cf26cd1bf78 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:59.052026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddd133-680f-47a5-a934-5cf26cd1bf78 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:59.052026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddd133-680f-47a5-a934-5cf26cd1bf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:59.052525 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 414/851] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:53:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:59.053932 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf95fd4-8b1d-48b6-8524-e5cca2f09b08 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:59.072752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a8ddd133-680f-47a5-a934-5cf26cd1bf78 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:59.074360 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a8ddd133-680f-47a5-a934-5cf26cd1bf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:59.120233 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:59.177207 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 438/852] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:53:59.193598 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf95fd4-8b1d-48b6-8524-e5cca2f09b08 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:59.202918 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:59.206839 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddd133-680f-47a5-a934-5cf26cd1bf78 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:59.242313 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e7599-9278-4afe-9c2e-89c1c1097d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:59.243308 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e7599-9278-4afe-9c2e-89c1c1097d81 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:59.244029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e7599-9278-4afe-9c2e-89c1c1097d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:59.244416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e7599-9278-4afe-9c2e-89c1c1097d81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:59.245544 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e7599-9278-4afe-9c2e-89c1c1097d81 None admin] RBAC: Adding query filter params (role.id=8196ef570097443bac15d3cf39878486, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=83e5f980cdb74227bb31c7e7e5eab74b) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:59.246108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e7599-9278-4afe-9c2e-89c1c1097d81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:59.248560 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e7599-9278-4afe-9c2e-89c1c1097d81 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:59.255380 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 415/853] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:53:59 2022] GET /identity/v3/role_assignments?user.id=83e5f980cdb74227bb31c7e7e5eab74b&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=8196ef570097443bac15d3cf39878486 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:59.332849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddd133-680f-47a5-a934-5cf26cd1bf78 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:59.376287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7100f-2577-484c-a6c4-bc1af389c39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:59.377490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7100f-2577-484c-a6c4-bc1af389c39d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:59.378004 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7100f-2577-484c-a6c4-bc1af389c39d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:59.378495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7100f-2577-484c-a6c4-bc1af389c39d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:59.391243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7100f-2577-484c-a6c4-bc1af389c39d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:53:59.399788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-38a7100f-2577-484c-a6c4-bc1af389c39d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:59.399788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:59.399788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:59.399788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:59.399788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:59.399788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:59.399788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:59.399788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:59.399788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:59.399788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:59.399788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:59.399788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:59.399788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:53:59.399788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:53:59.399788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:53:59.399788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:53:59.400827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:53:59.400827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:53:59.400827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:53:59.400827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:53:59.400827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:59.400827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:59.400827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:59.400827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:59.400827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:59.400827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:59.400827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:59.400827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:59.400827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:59.400827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:59.400827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:59.400827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:59.401665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:59.401665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:59.401665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:59.401665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:59.401665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:53:59.401665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:53:59.401665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:53:59.401665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:53:59.401665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:53:59.401665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:53:59.401665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:53:59.401665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:59.404676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 439/854] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:53:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:53:59.413010 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e7599-9278-4afe-9c2e-89c1c1097d81 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:59.459319 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b05aba-931a-4d2b-adf2-d2d32e61ecb8 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:59.459727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b05aba-931a-4d2b-adf2-d2d32e61ecb8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:59.460045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b05aba-931a-4d2b-adf2-d2d32e61ecb8 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:59.461822 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 440/855] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:53:59.468462 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3b238-65dd-4217-9dd9-f88e728a6cb4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:59.468759 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3b238-65dd-4217-9dd9-f88e728a6cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:59.469046 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3b238-65dd-4217-9dd9-f88e728a6cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:59.490220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-75d3b238-65dd-4217-9dd9-f88e728a6cb4 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:53:59.491435 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-75d3b238-65dd-4217-9dd9-f88e728a6cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:53:59.514736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:59.534988 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e7599-9278-4afe-9c2e-89c1c1097d81 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:59.571461 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdabfc0-0591-4e8f-9a8d-c343b430ea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:59.572481 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdabfc0-0591-4e8f-9a8d-c343b430ea37 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:59.572772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdabfc0-0591-4e8f-9a8d-c343b430ea37 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:59.573327 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdabfc0-0591-4e8f-9a8d-c343b430ea37 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:59.574085 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdabfc0-0591-4e8f-9a8d-c343b430ea37 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:59.574399 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdabfc0-0591-4e8f-9a8d-c343b430ea37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:59.575971 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdabfc0-0591-4e8f-9a8d-c343b430ea37 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:59.577051 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 441/856] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:53:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:53:59.592477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 416/857] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:53:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:59.598020 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3b238-65dd-4217-9dd9-f88e728a6cb4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:59.600820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdabfc0-0591-4e8f-9a8d-c343b430ea37 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:59.634355 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:59.716097 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdabfc0-0591-4e8f-9a8d-c343b430ea37 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:59.726273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3b238-65dd-4217-9dd9-f88e728a6cb4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:59.756357 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a79992-ca1f-4619-9bca-fbb184af70a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:59.757335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a79992-ca1f-4619-9bca-fbb184af70a1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:59.757622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a79992-ca1f-4619-9bca-fbb184af70a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:59.757900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a79992-ca1f-4619-9bca-fbb184af70a1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:59.758887 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a79992-ca1f-4619-9bca-fbb184af70a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:59.760734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a79992-ca1f-4619-9bca-fbb184af70a1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:59.777552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7068e-d6f4-4906-99b2-fd53c7173e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:59.778551 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7068e-d6f4-4906-99b2-fd53c7173e0d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:59.779538 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7068e-d6f4-4906-99b2-fd53c7173e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:59.780006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7068e-d6f4-4906-99b2-fd53c7173e0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:59.784259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-f1a79992-ca1f-4619-9bca-fbb184af70a1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 30 11:53:59.784259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:59.784259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:53:59.784259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:53:59.784259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:53:59.784259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:53:59.784259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:53:59.784259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:53:59.784259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 30 11:53:59.784259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:59.784259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:53:59.784259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:59.784259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:59.784259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:59.784259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:59.784259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:59.785398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:59.785398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:59.785398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:59.785398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:59.785398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:59.785398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:59.785398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:59.785398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:53:59.785398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:53:59.785398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:53:59.785398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:53:59.785398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:59.785398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:59.785398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:59.785398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:59.785398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:59.791228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:59.791228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:59.791228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:53:59.791228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:59.791228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:59.791228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:59.791228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:59.791228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:59.791228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:59.791228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:59.791228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:59.791228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:53:59.791228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:53:59.791228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 30 11:53:59.791228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:53:59.791228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 417/858] 10.222.0.41 () {56 vars in 1132 bytes} [Mon May 30 11:53:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:53:59.792477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a79992-ca1f-4619-9bca-fbb184af70a1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:59.797008 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7068e-d6f4-4906-99b2-fd53c7173e0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:59.799393 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7068e-d6f4-4906-99b2-fd53c7173e0d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:59.819827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-5ab7068e-d6f4-4906-99b2-fd53c7173e0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:59.819827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:53:59.819827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:53:59.819827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:53:59.819827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:53:59.819827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:53:59.819827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:53:59.819827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:53:59.819827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:53:59.819827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:53:59.819827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:53:59.819827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:53:59.819827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:53:59.819827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:53:59.819827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:53:59.821210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:53:59.821210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:53:59.821210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:53:59.821210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:53:59.821210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:53:59.821210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:53:59.821210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:53:59.821210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:53:59.821210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:53:59.821210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:53:59.821210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:53:59.821210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:53:59.821210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:53:59.821210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:53:59.821210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:53:59.821210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:53:59.821210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:53:59.822112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:53:59.822112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:53:59.822112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:53:59.822112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:53:59.825990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 442/859] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:53:59.827171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7068e-d6f4-4906-99b2-fd53c7173e0d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:59.836106 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:59.906407 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:53:59.914919 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a79992-ca1f-4619-9bca-fbb184af70a1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:59.939694 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7068e-d6f4-4906-99b2-fd53c7173e0d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:53:59.954919 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01626efd-3919-4e88-93cd-4f4d4a637b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:59.956010 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01626efd-3919-4e88-93cd-4f4d4a637b83 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:59.956574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01626efd-3919-4e88-93cd-4f4d4a637b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:59.957165 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01626efd-3919-4e88-93cd-4f4d4a637b83 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:59.958081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01626efd-3919-4e88-93cd-4f4d4a637b83 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:59.958596 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01626efd-3919-4e88-93cd-4f4d4a637b83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:59.960362 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01626efd-3919-4e88-93cd-4f4d4a637b83 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:59.970468 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 418/860] 10.222.0.41 () {56 vars in 1126 bytes} [Mon May 30 11:53:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:59.971768 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01626efd-3919-4e88-93cd-4f4d4a637b83 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:53:59.974761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1e8a7-dba8-401c-8769-76ef5ee95b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:53:59.975425 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1e8a7-dba8-401c-8769-76ef5ee95b5f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:53:59.975712 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1e8a7-dba8-401c-8769-76ef5ee95b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:53:59.976030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1e8a7-dba8-401c-8769-76ef5ee95b5f None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:53:59.977489 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1e8a7-dba8-401c-8769-76ef5ee95b5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:53:59.977489 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1e8a7-dba8-401c-8769-76ef5ee95b5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:53:59.978423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1e8a7-dba8-401c-8769-76ef5ee95b5f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:53:59.995909 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 443/861] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:53:59.996767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1e8a7-dba8-401c-8769-76ef5ee95b5f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:00.068377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:00.082401 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01626efd-3919-4e88-93cd-4f4d4a637b83 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:00.098681 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1e8a7-dba8-401c-8769-76ef5ee95b5f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:00.119422 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a1398-17ec-4725-afe3-d51eaedf2ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:00.120226 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a1398-17ec-4725-afe3-d51eaedf2ddd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:00.120585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a1398-17ec-4725-afe3-d51eaedf2ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:00.121193 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a1398-17ec-4725-afe3-d51eaedf2ddd None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:00.122009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a1398-17ec-4725-afe3-d51eaedf2ddd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:00.122389 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a1398-17ec-4725-afe3-d51eaedf2ddd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:00.124014 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a1398-17ec-4725-afe3-d51eaedf2ddd None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:00.136027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 419/862] 10.222.0.41 () {56 vars in 1126 bytes} [Mon May 30 11:53:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:00.140632 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e795261-c570-4920-93b1-136291c1ddd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:00.141896 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795261-c570-4920-93b1-136291c1ddd6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:00.142365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795261-c570-4920-93b1-136291c1ddd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:00.142847 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795261-c570-4920-93b1-136291c1ddd6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:00.151928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e795261-c570-4920-93b1-136291c1ddd6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:00.153829 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e795261-c570-4920-93b1-136291c1ddd6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:00.174479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-0e795261-c570-4920-93b1-136291c1ddd6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:54:00.174479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:00.174479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:00.174479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:00.174479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:00.174479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:00.174479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:00.174479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:00.174479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:00.174479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:00.174479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:00.174479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:00.174479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:54:00.174479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:54:00.174479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:54:00.174479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:54:00.175484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:00.175484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:00.175484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:54:00.175484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:54:00.175484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:54:00.175484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:54:00.175484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:00.175484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:00.175484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:00.175484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:00.175484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:00.175484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:00.175484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:00.175484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:00.175484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:00.175484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:00.175484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:00.175484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:00.176455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:00.176455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:00.176455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:54:00.176455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:54:00.176455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:54:00.176455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:54:00.176455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:54:00.176455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:54:00.176455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:54:00.176455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:00.178847 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 444/863] 10.222.0.41 () {56 vars in 1117 bytes} [Mon May 30 11:53:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:00.184699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a1398-17ec-4725-afe3-d51eaedf2ddd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:00.213679 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:00.305824 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a1398-17ec-4725-afe3-d51eaedf2ddd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:00.345906 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b341a-da79-4dfb-b54d-c4709a51eace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:00.346665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b341a-da79-4dfb-b54d-c4709a51eace None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:00.346957 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b341a-da79-4dfb-b54d-c4709a51eace None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:00.347240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b341a-da79-4dfb-b54d-c4709a51eace None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:00.348181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b341a-da79-4dfb-b54d-c4709a51eace None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:00.348503 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b341a-da79-4dfb-b54d-c4709a51eace None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:00.349975 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b341a-da79-4dfb-b54d-c4709a51eace None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:00.369765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 420/864] 10.222.0.41 () {56 vars in 1149 bytes} [Mon May 30 11:54:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:00.377842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e795261-c570-4920-93b1-136291c1ddd6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:00.487808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e795261-c570-4920-93b1-136291c1ddd6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:00.516976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:00.526793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd8e39-0139-498f-a6ed-58bb3b12ef02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:00.527595 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd8e39-0139-498f-a6ed-58bb3b12ef02 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:00.527904 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd8e39-0139-498f-a6ed-58bb3b12ef02 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:00.528594 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd8e39-0139-498f-a6ed-58bb3b12ef02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:00.602193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd8e39-0139-498f-a6ed-58bb3b12ef02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:00.603565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd8e39-0139-498f-a6ed-58bb3b12ef02 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:00.708832 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 445/865] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:54:00 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:54:00.714306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b341a-da79-4dfb-b54d-c4709a51eace None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:00.802844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:00.824513 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b341a-da79-4dfb-b54d-c4709a51eace None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:00.861931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965189b1-09cf-4845-b08a-41e4747133f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:00.862653 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965189b1-09cf-4845-b08a-41e4747133f5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:00.862943 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965189b1-09cf-4845-b08a-41e4747133f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:00.863222 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965189b1-09cf-4845-b08a-41e4747133f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:00.874939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965189b1-09cf-4845-b08a-41e4747133f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:00.876446 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965189b1-09cf-4845-b08a-41e4747133f5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:00.894652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-965189b1-09cf-4845-b08a-41e4747133f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:00.894652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:00.894652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:00.894652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:00.894652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:00.894652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:00.894652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:00.894652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:00.894652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:00.894652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:00.894652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:00.894652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:00.894652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:54:00.894652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:54:00.894652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:54:00.895570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:54:00.895570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:00.895570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:00.895570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:00.895570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:00.895570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:00.895570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:00.895570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:00.895570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:00.895570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:00.895570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:00.895570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:00.895570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:00.895570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:00.895570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:00.895570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:00.895570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:00.896478 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:54:00.896478 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:54:00.896478 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:00.896478 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:00.896478 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 421/866] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:00.902550 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd8e39-0139-498f-a6ed-58bb3b12ef02 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:00.932211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:01.017598 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd8e39-0139-498f-a6ed-58bb3b12ef02 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:01.054170 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856d061-cbc7-494b-8e08-e4bafa2a986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:01.054846 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856d061-cbc7-494b-8e08-e4bafa2a986b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:01.055135 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856d061-cbc7-494b-8e08-e4bafa2a986b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:01.055416 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856d061-cbc7-494b-8e08-e4bafa2a986b None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:01.056176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856d061-cbc7-494b-8e08-e4bafa2a986b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:01.056489 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856d061-cbc7-494b-8e08-e4bafa2a986b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:01.057873 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856d061-cbc7-494b-8e08-e4bafa2a986b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:01.072855 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 446/867] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:01.079332 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965189b1-09cf-4845-b08a-41e4747133f5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:01.192281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965189b1-09cf-4845-b08a-41e4747133f5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:01.223431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:01.228992 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17bd08-b6f2-4abb-87bc-e96865751b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:01.229860 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17bd08-b6f2-4abb-87bc-e96865751b01 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:01.230151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17bd08-b6f2-4abb-87bc-e96865751b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:01.230437 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17bd08-b6f2-4abb-87bc-e96865751b01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:01.237915 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17bd08-b6f2-4abb-87bc-e96865751b01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:01.239585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17bd08-b6f2-4abb-87bc-e96865751b01 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:01.254851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-4c17bd08-b6f2-4abb-87bc-e96865751b01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:54:01.254851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:01.254851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:01.254851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:01.254851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:01.254851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:01.254851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:01.254851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:01.254851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:01.254851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:01.254851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:01.254851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:01.254851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:54:01.254851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:54:01.254851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:54:01.255954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:54:01.255954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:01.255954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:01.255954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:01.255954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:01.255954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:01.255954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:01.255954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:01.255954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:01.255954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:01.255954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:01.255954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:01.255954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:01.255954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:01.255954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:01.255954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:01.255954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:01.256819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:54:01.256819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:54:01.256819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:54:01.256819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:54:01.256819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:54:01.256819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:54:01.256819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:54:01.256819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:01.259839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 422/868] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:54:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:01.268969 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856d061-cbc7-494b-8e08-e4bafa2a986b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:01.365987 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:01.381446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856d061-cbc7-494b-8e08-e4bafa2a986b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:01.413206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a1388-fa90-4792-a004-fad4b93e3a79 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:01.413541 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a1388-fa90-4792-a004-fad4b93e3a79 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:01.413770 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a1388-fa90-4792-a004-fad4b93e3a79 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:01.416228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 423/869] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:54:01.422161 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cd68a-aca8-424c-ad03-e79a5cf74ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:01.422832 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cd68a-aca8-424c-ad03-e79a5cf74ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:01.423116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cd68a-aca8-424c-ad03-e79a5cf74ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:01.423392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cd68a-aca8-424c-ad03-e79a5cf74ee0 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:01.423761 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c95753-708b-477f-a344-501713ddb28b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:01.424214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cd68a-aca8-424c-ad03-e79a5cf74ee0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:01.424505 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c95753-708b-477f-a344-501713ddb28b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:01.424607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cd68a-aca8-424c-ad03-e79a5cf74ee0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:01.425068 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c95753-708b-477f-a344-501713ddb28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:01.425925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cd68a-aca8-424c-ad03-e79a5cf74ee0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:01.442077 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 447/870] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:54:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:01.444095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-40c95753-708b-477f-a344-501713ddb28b None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:01.445561 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-40c95753-708b-477f-a344-501713ddb28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:01.448976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cd68a-aca8-424c-ad03-e79a5cf74ee0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:01.535866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 424/871] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:54:01.557733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c95753-708b-477f-a344-501713ddb28b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:01.572471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cd68a-aca8-424c-ad03-e79a5cf74ee0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:01.612239 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64061f62-8f05-4b59-a7cb-7b143208c0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:01.612653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64061f62-8f05-4b59-a7cb-7b143208c0ad None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:01.612942 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64061f62-8f05-4b59-a7cb-7b143208c0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:01.613226 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64061f62-8f05-4b59-a7cb-7b143208c0ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:01.614082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64061f62-8f05-4b59-a7cb-7b143208c0ad None admin] RBAC: Adding query filter params (role.id=dc57e0b7f67947e0b6b63c4ad0148358, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=a63dd78421064bbe838b1ed0261c13bb) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:01.614403 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64061f62-8f05-4b59-a7cb-7b143208c0ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:01.615865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64061f62-8f05-4b59-a7cb-7b143208c0ad None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:01.623109 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 448/872] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:54:01 2022] GET /identity/v3/role_assignments?user.id=a63dd78421064bbe838b1ed0261c13bb&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=dc57e0b7f67947e0b6b63c4ad0148358 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:01.646517 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914176e1-435c-40f1-a44b-6127da711f8b None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:01.646875 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914176e1-435c-40f1-a44b-6127da711f8b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:01.647090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914176e1-435c-40f1-a44b-6127da711f8b None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:01.652924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 449/873] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:54:01.654812 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093f1d9-da47-417e-8ca2-2727c13c2e17 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:01.655107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093f1d9-da47-417e-8ca2-2727c13c2e17 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:01.655388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093f1d9-da47-417e-8ca2-2727c13c2e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:01.674595 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2093f1d9-da47-417e-8ca2-2727c13c2e17 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:01.675810 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2093f1d9-da47-417e-8ca2-2727c13c2e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:01.684282 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:01.696078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c95753-708b-477f-a344-501713ddb28b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:01.730246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:01.749577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8887b28-3dfd-4e51-a33e-23913bc18db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:01.750667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8887b28-3dfd-4e51-a33e-23913bc18db4 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:01.751248 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8887b28-3dfd-4e51-a33e-23913bc18db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:01.751699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8887b28-3dfd-4e51-a33e-23913bc18db4 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:01.753249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8887b28-3dfd-4e51-a33e-23913bc18db4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:01.755036 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8887b28-3dfd-4e51-a33e-23913bc18db4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:01.764005 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 450/874] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:54:01.780801 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093f1d9-da47-417e-8ca2-2727c13c2e17 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:01.789311 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 425/875] 10.222.0.41 () {60 vars in 1141 bytes} [Mon May 30 11:54:01 2022] POST /identity/v3/services => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:54:01.906094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093f1d9-da47-417e-8ca2-2727c13c2e17 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:01.955498 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42feea-ec10-4c16-a902-6ea7bb2e8f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:01.956285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42feea-ec10-4c16-a902-6ea7bb2e8f5c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:01.956571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42feea-ec10-4c16-a902-6ea7bb2e8f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:01.956848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42feea-ec10-4c16-a902-6ea7bb2e8f5c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:01.957519 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42feea-ec10-4c16-a902-6ea7bb2e8f5c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:01.958924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42feea-ec10-4c16-a902-6ea7bb2e8f5c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:01.962335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:01.973432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-7a42feea-ec10-4c16-a902-6ea7bb2e8f5c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:54:01.973432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:01.973432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:54:01.973432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:54:01.973432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:54:01.973432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:54:01.973432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:54:01.973432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:01.973432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:54:01.973432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:01.973432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:54:01.973432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:01.973432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:01.973432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:01.973432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:01.973432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:01.973432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:01.974523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:01.974523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:01.974523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:01.974523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:01.974523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:01.974523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:01.974523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:54:01.974523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:54:01.974523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:54:01.974523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:54:01.974523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:01.974523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:01.974523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:01.974523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:01.974523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:01.974523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:01.975365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:01.975365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:01.975365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:01.975365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:01.975365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:01.975365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:01.975365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:01.975365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:01.975365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:01.975365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:01.975365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:54:01.975365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:01.975365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:54:01.975365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:01.978681 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 451/876] 10.222.0.41 () {56 vars in 1126 bytes} [Mon May 30 11:54:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:01.984277 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8887b28-3dfd-4e51-a33e-23913bc18db4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:02.095406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8887b28-3dfd-4e51-a33e-23913bc18db4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:02.130711 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c46a9-23b0-442a-8569-09444368d71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:02.131435 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c46a9-23b0-442a-8569-09444368d71b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:02.131727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c46a9-23b0-442a-8569-09444368d71b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:02.132031 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c46a9-23b0-442a-8569-09444368d71b None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:02.132749 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c46a9-23b0-442a-8569-09444368d71b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:02.133059 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c46a9-23b0-442a-8569-09444368d71b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:02.134432 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c46a9-23b0-442a-8569-09444368d71b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:02.143754 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 426/877] 10.222.0.41 () {56 vars in 1122 bytes} [Mon May 30 11:54:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:02.145833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42feea-ec10-4c16-a902-6ea7bb2e8f5c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:02.258160 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42feea-ec10-4c16-a902-6ea7bb2e8f5c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:02.299535 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e5b93-cd58-44d5-8852-efa6a830c5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:02.300668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e5b93-cd58-44d5-8852-efa6a830c5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:02.301170 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e5b93-cd58-44d5-8852-efa6a830c5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:02.301658 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e5b93-cd58-44d5-8852-efa6a830c5e0 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:02.302655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e5b93-cd58-44d5-8852-efa6a830c5e0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:02.303191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e5b93-cd58-44d5-8852-efa6a830c5e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:02.304859 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e5b93-cd58-44d5-8852-efa6a830c5e0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:02.311100 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 452/878] 10.222.0.41 () {56 vars in 1122 bytes} [Mon May 30 11:54:02 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:02.623232 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbca23d-d775-45d1-8892-08e7f604d171 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:02.623422 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbca23d-d775-45d1-8892-08e7f604d171 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:02.623789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbca23d-d775-45d1-8892-08e7f604d171 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:02.625457 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 427/879] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:02.630714 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b4c46-0f49-4116-b215-2791f7a155af None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:02.631009 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b4c46-0f49-4116-b215-2791f7a155af None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:02.631292 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b4c46-0f49-4116-b215-2791f7a155af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:02.649207 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-de5b4c46-0f49-4116-b215-2791f7a155af None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:02.650735 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-de5b4c46-0f49-4116-b215-2791f7a155af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:02.715467 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:02.725445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 453/880] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:02 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:02.748677 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbca23d-d775-45d1-8892-08e7f604d171 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:02.809568 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:02.875655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbca23d-d775-45d1-8892-08e7f604d171 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:02.911251 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9726bd-20ea-4cff-8d59-941d60f0d771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:02.911959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9726bd-20ea-4cff-8d59-941d60f0d771 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:02.912248 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9726bd-20ea-4cff-8d59-941d60f0d771 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:02.912529 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9726bd-20ea-4cff-8d59-941d60f0d771 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:02.913264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9726bd-20ea-4cff-8d59-941d60f0d771 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:02.914637 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9726bd-20ea-4cff-8d59-941d60f0d771 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:02.932767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 428/881] 10.222.0.41 () {60 vars in 1141 bytes} [Mon May 30 11:54:02 2022] POST /identity/v3/services => generated 269 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:54:04.112159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0397f78-5784-4d85-84ec-f785727d081d None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:04.112656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0397f78-5784-4d85-84ec-f785727d081d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:04.112916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0397f78-5784-4d85-84ec-f785727d081d None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:04.114671 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 454/882] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:04.120061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3392b-6d9f-47e3-a89e-179878f4eaba None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:04.120487 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3392b-6d9f-47e3-a89e-179878f4eaba None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:04.121075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3392b-6d9f-47e3-a89e-179878f4eaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:04.138871 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f1b3392b-6d9f-47e3-a89e-179878f4eaba None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:04.140122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f1b3392b-6d9f-47e3-a89e-179878f4eaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:04.217111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b92a6-8631-4357-971d-cf8567c81a8c None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:04.217591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b92a6-8631-4357-971d-cf8567c81a8c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:04.217746 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b92a6-8631-4357-971d-cf8567c81a8c None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:04.218535 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 429/883] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:04.223230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 455/884] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:04.224891 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344ac34-73ad-4f2e-9fc0-a4845b48cf5d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:04.225189 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344ac34-73ad-4f2e-9fc0-a4845b48cf5d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:04.225475 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344ac34-73ad-4f2e-9fc0-a4845b48cf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:04.243002 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4344ac34-73ad-4f2e-9fc0-a4845b48cf5d None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:04.244234 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4344ac34-73ad-4f2e-9fc0-a4845b48cf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:04.247952 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b92a6-8631-4357-971d-cf8567c81a8c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:04.280602 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:04.343518 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 430/885] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:04.362851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344ac34-73ad-4f2e-9fc0-a4845b48cf5d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:04.374370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b92a6-8631-4357-971d-cf8567c81a8c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:04.412384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad027f45-1f29-4a76-aa7d-bbb4c65f480c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:04.413257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad027f45-1f29-4a76-aa7d-bbb4c65f480c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:04.413485 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad027f45-1f29-4a76-aa7d-bbb4c65f480c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:04.413750 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad027f45-1f29-4a76-aa7d-bbb4c65f480c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:04.425407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad027f45-1f29-4a76-aa7d-bbb4c65f480c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:54:04.434174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ad027f45-1f29-4a76-aa7d-bbb4c65f480c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:54:04.434174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:04.434174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:04.434174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:04.434174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:04.434174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:04.434174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:04.434174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:04.434174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:04.434174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:04.434174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:04.434174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:04.434174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:54:04.434174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:54:04.434174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:54:04.434174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:54:04.435410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:54:04.435410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:54:04.435410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:54:04.435410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:54:04.435410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:04.435410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:04.435410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:04.435410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:04.435410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:04.435410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:04.435410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:04.435410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:04.435410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:04.435410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:04.435410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:04.435410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:04.436283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:04.436283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:04.436283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:04.436283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:04.436283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:54:04.436283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:54:04.436283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:54:04.436283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:54:04.436283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:54:04.436283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:54:04.436283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:54:04.436283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:04.439987 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 456/886] 10.222.0.41 () {56 vars in 1120 bytes} [Mon May 30 11:54:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:04.442034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad027f45-1f29-4a76-aa7d-bbb4c65f480c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:04.475467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344ac34-73ad-4f2e-9fc0-a4845b48cf5d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:04.503379 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:04.513601 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe7ed4-1586-400c-b924-f393908f0d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:04.514706 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe7ed4-1586-400c-b924-f393908f0d8a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:04.515151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe7ed4-1586-400c-b924-f393908f0d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:04.515583 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe7ed4-1586-400c-b924-f393908f0d8a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:04.516428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe7ed4-1586-400c-b924-f393908f0d8a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:04.517979 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe7ed4-1586-400c-b924-f393908f0d8a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:04.531259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-1bfe7ed4-1586-400c-b924-f393908f0d8a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 30 11:54:04.531259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:04.531259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:54:04.531259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:54:04.531259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:54:04.531259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:54:04.531259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:54:04.531259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:04.531259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 30 11:54:04.531259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:04.531259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:54:04.531259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:04.531259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:04.531259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:04.531259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:04.531259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:04.531259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:04.532340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:04.532340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:04.532340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:04.532340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:04.532340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:04.532340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:04.532340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:54:04.532340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:54:04.532340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:54:04.532340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:54:04.532340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:04.532340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:04.532340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:04.532340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:04.532340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:04.532340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:04.533306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:04.533306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:04.533306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:04.533306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:04.533306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:04.533306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:04.533306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:04.533306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:04.533306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:04.533306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:04.533306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:54:04.533306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:04.533306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 30 11:54:04.533306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:04.540977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 431/887] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:54:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:04.542084 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe7ed4-1586-400c-b924-f393908f0d8a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:04.554993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad027f45-1f29-4a76-aa7d-bbb4c65f480c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:04.572024 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:04.594638 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b760733-1af3-4d94-84f8-ae189fc7f814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:04.595343 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b760733-1af3-4d94-84f8-ae189fc7f814 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:04.595710 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b760733-1af3-4d94-84f8-ae189fc7f814 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:04.596033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b760733-1af3-4d94-84f8-ae189fc7f814 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:04.596789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b760733-1af3-4d94-84f8-ae189fc7f814 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:04.597112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b760733-1af3-4d94-84f8-ae189fc7f814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:04.598626 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b760733-1af3-4d94-84f8-ae189fc7f814 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:04.612296 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 457/888] 10.222.0.41 () {56 vars in 1115 bytes} [Mon May 30 11:54:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:04.613712 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b760733-1af3-4d94-84f8-ae189fc7f814 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:04.657234 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe7ed4-1586-400c-b924-f393908f0d8a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:04.693134 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f46dd3-9c23-42dd-8ed6-9396fa830f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:04.693791 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f46dd3-9c23-42dd-8ed6-9396fa830f9a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:04.694077 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f46dd3-9c23-42dd-8ed6-9396fa830f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:04.694353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f46dd3-9c23-42dd-8ed6-9396fa830f9a None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:04.695055 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f46dd3-9c23-42dd-8ed6-9396fa830f9a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:04.695361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f46dd3-9c23-42dd-8ed6-9396fa830f9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:04.696767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f46dd3-9c23-42dd-8ed6-9396fa830f9a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:04.703152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 432/889] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:54:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:04.705484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e20977-4990-42e5-b529-8ec854ac8987 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:04.705887 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e20977-4990-42e5-b529-8ec854ac8987 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:04.706247 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e20977-4990-42e5-b529-8ec854ac8987 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:04.708395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 433/890] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:04.709228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e20977-4990-42e5-b529-8ec854ac8987 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:04.726499 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b760733-1af3-4d94-84f8-ae189fc7f814 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:04.745171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:04.768803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd78ad-52e8-47c2-8aa7-c0e4f59a5ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:04.769606 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd78ad-52e8-47c2-8aa7-c0e4f59a5ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:04.769895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd78ad-52e8-47c2-8aa7-c0e4f59a5ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:04.770174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd78ad-52e8-47c2-8aa7-c0e4f59a5ef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:04.784822 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd78ad-52e8-47c2-8aa7-c0e4f59a5ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:04.786301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd78ad-52e8-47c2-8aa7-c0e4f59a5ef5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:04.804355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-c7fd78ad-52e8-47c2-8aa7-c0e4f59a5ef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:04.804355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:04.804355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:04.804355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:04.804355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:04.804355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:04.804355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:04.804355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:04.804355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:04.804355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:04.804355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:04.804355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:04.804355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:54:04.804355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:54:04.804355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:54:04.805291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:54:04.805291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:04.805291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:04.805291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:04.805291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:04.805291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:04.805291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:04.805291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:04.805291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:04.805291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:04.805291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:04.805291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:04.805291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:04.805291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:04.805291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:04.805291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:04.805291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:04.806153 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:54:04.806153 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:54:04.806153 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:04.806153 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:04.806153 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 458/891] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:04.806971 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebed454-af1b-4515-ba6e-0262e9708d61 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:04.807140 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebed454-af1b-4515-ba6e-0262e9708d61 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:04.807375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebed454-af1b-4515-ba6e-0262e9708d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:04.819793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:04.826116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-eebed454-af1b-4515-ba6e-0262e9708d61 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:04.827282 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-eebed454-af1b-4515-ba6e-0262e9708d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:04.833047 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e20977-4990-42e5-b529-8ec854ac8987 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:04.871752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d8af2-7178-433d-8de2-0eb0bd484be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:04.873005 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d8af2-7178-433d-8de2-0eb0bd484be8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:04.873295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d8af2-7178-433d-8de2-0eb0bd484be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:04.873579 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d8af2-7178-433d-8de2-0eb0bd484be8 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:04.874292 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d8af2-7178-433d-8de2-0eb0bd484be8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:04.874608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d8af2-7178-433d-8de2-0eb0bd484be8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:04.876150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d8af2-7178-433d-8de2-0eb0bd484be8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:04.886538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 434/892] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:54:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:04.887519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d8af2-7178-433d-8de2-0eb0bd484be8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:04.911852 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 459/893] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:04.911852 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebed454-af1b-4515-ba6e-0262e9708d61 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:04.995158 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d8af2-7178-433d-8de2-0eb0bd484be8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:05.021324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:05.026391 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebed454-af1b-4515-ba6e-0262e9708d61 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:05.031905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c91348-8765-4dca-8e74-58a76e08f227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:05.032580 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c91348-8765-4dca-8e74-58a76e08f227 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:05.032869 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c91348-8765-4dca-8e74-58a76e08f227 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:05.033152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c91348-8765-4dca-8e74-58a76e08f227 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:05.033881 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c91348-8765-4dca-8e74-58a76e08f227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:05.034195 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c91348-8765-4dca-8e74-58a76e08f227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:05.035574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c91348-8765-4dca-8e74-58a76e08f227 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:05.053063 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 435/894] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:05.053794 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c91348-8765-4dca-8e74-58a76e08f227 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:05.062534 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f2ed4-ce58-4645-a698-846d57526dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:05.063198 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f2ed4-ce58-4645-a698-846d57526dfe None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:05.063490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f2ed4-ce58-4645-a698-846d57526dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:05.063772 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f2ed4-ce58-4645-a698-846d57526dfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:05.064605 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f2ed4-ce58-4645-a698-846d57526dfe None admin] RBAC: Adding query filter params (interface=public, service_id=c9ed69f3faa44044b75f75529ba6caef, region_id=RegionOne) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:05.064934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f2ed4-ce58-4645-a698-846d57526dfe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:05.066310 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f2ed4-ce58-4645-a698-846d57526dfe None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:05.070218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:05.076207 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 460/895] 10.222.0.41 () {56 vars in 1251 bytes} [Mon May 30 11:54:04 2022] GET /identity/v3/endpoints?service_id=c9ed69f3faa44044b75f75529ba6caef&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:05.076207 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f2ed4-ce58-4645-a698-846d57526dfe None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:05.167495 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c91348-8765-4dca-8e74-58a76e08f227 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:05.179397 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f2ed4-ce58-4645-a698-846d57526dfe None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:05.203559 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62164280-8450-4629-b2fb-c8fce191af41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:05.204401 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62164280-8450-4629-b2fb-c8fce191af41 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:05.204693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62164280-8450-4629-b2fb-c8fce191af41 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:05.204978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62164280-8450-4629-b2fb-c8fce191af41 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:05.205720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62164280-8450-4629-b2fb-c8fce191af41 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:05.207087 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62164280-8450-4629-b2fb-c8fce191af41 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:05.219320 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5dd908-1269-4272-8746-14d30dd3cb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:05.220171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dd908-1269-4272-8746-14d30dd3cb4b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:05.220462 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dd908-1269-4272-8746-14d30dd3cb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:05.220743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dd908-1269-4272-8746-14d30dd3cb4b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:05.229629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 436/896] 10.222.0.41 () {60 vars in 1141 bytes} [Mon May 30 11:54:05 2022] POST /identity/v3/services => generated 241 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:54:05.229629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62164280-8450-4629-b2fb-c8fce191af41 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:05.229911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5dd908-1269-4272-8746-14d30dd3cb4b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:05.230581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5dd908-1269-4272-8746-14d30dd3cb4b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:05.249060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-1a5dd908-1269-4272-8746-14d30dd3cb4b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:54:05.249060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:05.249060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:05.249060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:05.249060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:05.249060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:05.249060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:05.249060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:05.249060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:05.249060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:05.249060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:05.249060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:05.249060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:54:05.249060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:54:05.249060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:54:05.249060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:54:05.250091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:05.250091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:05.250091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:54:05.250091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:54:05.250091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:54:05.250091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:54:05.250091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:05.250091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:05.250091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:05.250091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:05.250091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:05.250091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:05.250091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:05.250091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:05.250091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:05.250091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:05.250091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:05.250091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:05.251183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:05.251183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:05.251183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:54:05.251183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:54:05.251183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:54:05.251183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:54:05.251183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:54:05.251183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:54:05.251183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:54:05.251183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:05.251183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 461/897] 10.222.0.41 () {56 vars in 1117 bytes} [Mon May 30 11:54:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:05.252076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ee018-d240-48a1-82bc-80e7670f8b4b None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:05.252076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ee018-d240-48a1-82bc-80e7670f8b4b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:05.252227 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ee018-d240-48a1-82bc-80e7670f8b4b None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:05.254610 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 462/898] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:05.258193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ee018-d240-48a1-82bc-80e7670f8b4b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:05.287301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:05.330603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:05.371154 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62164280-8450-4629-b2fb-c8fce191af41 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:05.382423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ee018-d240-48a1-82bc-80e7670f8b4b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:05.410625 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6a19b-9321-4944-a271-16d5826939b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:05.411688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6a19b-9321-4944-a271-16d5826939b5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:05.412291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6a19b-9321-4944-a271-16d5826939b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:05.412725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6a19b-9321-4944-a271-16d5826939b5 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:05.413626 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6a19b-9321-4944-a271-16d5826939b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:05.415448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6a19b-9321-4944-a271-16d5826939b5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:05.420571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a545b-7e23-4328-8b28-aee31fe789f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:05.421266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a545b-7e23-4328-8b28-aee31fe789f7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:05.421551 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a545b-7e23-4328-8b28-aee31fe789f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:05.421824 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a545b-7e23-4328-8b28-aee31fe789f7 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:05.422680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a545b-7e23-4328-8b28-aee31fe789f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:05.422998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a545b-7e23-4328-8b28-aee31fe789f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:05.424450 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a545b-7e23-4328-8b28-aee31fe789f7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:05.432067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 437/899] 10.222.0.41 () {56 vars in 1087 bytes} [Mon May 30 11:54:05 2022] GET /identity/v3/services => generated 1497 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 11:54:05.433601 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27aae2-3b82-4531-b2e1-8b7aa041bb43 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:05.433898 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27aae2-3b82-4531-b2e1-8b7aa041bb43 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:05.434183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27aae2-3b82-4531-b2e1-8b7aa041bb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:05.448198 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 463/900] 10.222.0.41 () {56 vars in 1149 bytes} [Mon May 30 11:54:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:05.454630 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a545b-7e23-4328-8b28-aee31fe789f7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:05.459982 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8b27aae2-3b82-4531-b2e1-8b7aa041bb43 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:05.461481 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8b27aae2-3b82-4531-b2e1-8b7aa041bb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:05.555146 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 438/901] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:05.569614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:05.580392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27aae2-3b82-4531-b2e1-8b7aa041bb43 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:05.595025 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a545b-7e23-4328-8b28-aee31fe789f7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:05.634427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5ae45-7286-42a8-809a-0f6f1d734ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:05.634427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ae45-7286-42a8-809a-0f6f1d734ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:05.634427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ae45-7286-42a8-809a-0f6f1d734ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:05.634781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ae45-7286-42a8-809a-0f6f1d734ba7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:05.667766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:05.713064 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27aae2-3b82-4531-b2e1-8b7aa041bb43 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:05.732997 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5ae45-7286-42a8-809a-0f6f1d734ba7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:05.734823 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5ae45-7286-42a8-809a-0f6f1d734ba7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:05.754383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab0bc3-3ee4-4e4b-9677-e56fd2f8105f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:05.755930 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab0bc3-3ee4-4e4b-9677-e56fd2f8105f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:05.756857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab0bc3-3ee4-4e4b-9677-e56fd2f8105f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:05.757344 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab0bc3-3ee4-4e4b-9677-e56fd2f8105f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:05.758276 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab0bc3-3ee4-4e4b-9677-e56fd2f8105f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:05.760757 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab0bc3-3ee4-4e4b-9677-e56fd2f8105f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:05.780498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-e3ab0bc3-3ee4-4e4b-9677-e56fd2f8105f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 30 11:54:05.780498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:05.780498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:54:05.780498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:54:05.780498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:54:05.780498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:54:05.780498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:54:05.780498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:05.780498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 30 11:54:05.780498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:05.780498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:54:05.780498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:05.780498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:05.780498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:05.780498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:05.780498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:05.781649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:05.781649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:05.781649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:05.781649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:05.781649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:05.781649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:05.781649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:05.781649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:54:05.781649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:54:05.781649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:54:05.781649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:54:05.781649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:05.781649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:05.781649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:05.781649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:05.781649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:05.782697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:05.782697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:05.782697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:05.782697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:05.782697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:05.782697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:05.782697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:05.782697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:05.782697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:05.782697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:05.782697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:05.782697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:54:05.782697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:05.782697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 30 11:54:05.782697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:05.790737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 439/902] 10.222.0.41 () {56 vars in 1132 bytes} [Mon May 30 11:54:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:05.791255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab0bc3-3ee4-4e4b-9677-e56fd2f8105f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:05.856547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:05.885695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 464/903] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:54:05 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:54:05.892725 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5ae45-7286-42a8-809a-0f6f1d734ba7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:05.908556 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab0bc3-3ee4-4e4b-9677-e56fd2f8105f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:05.936597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:05.945794 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4beca-3f36-4033-8600-c38a928ae08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:05.946650 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4beca-3f36-4033-8600-c38a928ae08e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:05.947033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4beca-3f36-4033-8600-c38a928ae08e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:05.947441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4beca-3f36-4033-8600-c38a928ae08e None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:05.948313 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4beca-3f36-4033-8600-c38a928ae08e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:05.948722 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4beca-3f36-4033-8600-c38a928ae08e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:05.950196 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4beca-3f36-4033-8600-c38a928ae08e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:05.957278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 440/904] 10.222.0.41 () {56 vars in 1126 bytes} [Mon May 30 11:54:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:05.962573 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4beca-3f36-4033-8600-c38a928ae08e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:06.021308 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5ae45-7286-42a8-809a-0f6f1d734ba7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:06.069906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fcdaf-35d3-4859-921f-adfb05ce37e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:06.071029 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fcdaf-35d3-4859-921f-adfb05ce37e8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:06.071323 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fcdaf-35d3-4859-921f-adfb05ce37e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:06.071605 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fcdaf-35d3-4859-921f-adfb05ce37e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:06.086406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fcdaf-35d3-4859-921f-adfb05ce37e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:06.088554 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fcdaf-35d3-4859-921f-adfb05ce37e8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:06.092972 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4beca-3f36-4033-8600-c38a928ae08e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:06.113162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-5b1fcdaf-35d3-4859-921f-adfb05ce37e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:06.113162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:06.113162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:06.113162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:06.113162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:06.113162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:06.113162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:06.113162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:06.113162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:06.113162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:06.113162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:06.113162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:06.113162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:54:06.113162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:54:06.113162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:54:06.114324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:54:06.114324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:06.114324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:06.114324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:06.114324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:06.114324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:06.114324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:06.114324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:06.114324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:06.114324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:06.114324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:06.114324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:06.114324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:06.114324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:06.114324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:06.114324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:06.114324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:06.115409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:54:06.115409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:54:06.115409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:06.115409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:06.115409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 465/905] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:06.122492 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fcdaf-35d3-4859-921f-adfb05ce37e8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:06.141073 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f61f0-f620-4ce1-81dc-5f1f9b8588a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:06.142148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f61f0-f620-4ce1-81dc-5f1f9b8588a1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:06.142512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f61f0-f620-4ce1-81dc-5f1f9b8588a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:06.143272 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f61f0-f620-4ce1-81dc-5f1f9b8588a1 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:06.144109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f61f0-f620-4ce1-81dc-5f1f9b8588a1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:06.144498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f61f0-f620-4ce1-81dc-5f1f9b8588a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:06.145950 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f61f0-f620-4ce1-81dc-5f1f9b8588a1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:06.155151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 441/906] 10.222.0.41 () {56 vars in 1126 bytes} [Mon May 30 11:54:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:06.157148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:06.161380 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f61f0-f620-4ce1-81dc-5f1f9b8588a1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:06.237782 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fcdaf-35d3-4859-921f-adfb05ce37e8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:06.249575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:06.277656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991fb70-d685-46f4-a992-c1e78e35741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:06.278486 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991fb70-d685-46f4-a992-c1e78e35741f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:06.279534 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991fb70-d685-46f4-a992-c1e78e35741f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:06.280188 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991fb70-d685-46f4-a992-c1e78e35741f None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:06.281025 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991fb70-d685-46f4-a992-c1e78e35741f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:06.281437 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991fb70-d685-46f4-a992-c1e78e35741f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:06.283000 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991fb70-d685-46f4-a992-c1e78e35741f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:06.300385 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 466/907] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:06.301869 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991fb70-d685-46f4-a992-c1e78e35741f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:06.305109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f61f0-f620-4ce1-81dc-5f1f9b8588a1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:06.354923 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d95898-48f7-4ad0-a624-338f683cb378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:06.355891 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d95898-48f7-4ad0-a624-338f683cb378 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:06.356339 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d95898-48f7-4ad0-a624-338f683cb378 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:06.357137 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d95898-48f7-4ad0-a624-338f683cb378 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:06.358105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d95898-48f7-4ad0-a624-338f683cb378 None admin] RBAC: Adding query filter params (interface=public, service_id=1796b38655d54da7bd41b4a0bc684802, region_id=RegionOne) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:06.358438 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d95898-48f7-4ad0-a624-338f683cb378 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:06.360441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d95898-48f7-4ad0-a624-338f683cb378 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:06.367300 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 442/908] 10.222.0.41 () {56 vars in 1251 bytes} [Mon May 30 11:54:06 2022] GET /identity/v3/endpoints?service_id=1796b38655d54da7bd41b4a0bc684802&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:06.373921 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d95898-48f7-4ad0-a624-338f683cb378 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:06.400580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:06.411109 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991fb70-d685-46f4-a992-c1e78e35741f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:06.449807 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473d6d7-f256-4439-8968-80660b9c0c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:06.451056 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473d6d7-f256-4439-8968-80660b9c0c73 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:06.451551 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473d6d7-f256-4439-8968-80660b9c0c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:06.452090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473d6d7-f256-4439-8968-80660b9c0c73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:06.463134 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473d6d7-f256-4439-8968-80660b9c0c73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:06.465502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473d6d7-f256-4439-8968-80660b9c0c73 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:06.483960 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d95898-48f7-4ad0-a624-338f683cb378 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:06.488747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-1473d6d7-f256-4439-8968-80660b9c0c73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:54:06.488747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:06.488747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:06.488747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:06.488747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:06.488747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:06.488747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:06.488747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:06.488747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:06.488747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:06.488747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:06.488747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:06.488747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:54:06.488747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:54:06.488747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:54:06.489631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:54:06.489631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:06.489631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:06.489631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:06.489631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:06.489631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:06.489631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:06.489631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:06.489631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:06.489631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:06.489631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:06.489631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:06.489631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:06.489631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:06.489631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:06.489631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:06.489631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:06.490499 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:54:06.490499 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:54:06.490499 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:54:06.490499 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:54:06.490499 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:54:06.490499 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:54:06.490499 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:54:06.490499 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:06.493496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 467/909] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:54:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:06.500258 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473d6d7-f256-4439-8968-80660b9c0c73 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:06.509948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:06.526974 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862e840-29a3-4349-a01a-8eb26d7fa668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:06.527744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862e840-29a3-4349-a01a-8eb26d7fa668 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:06.528005 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862e840-29a3-4349-a01a-8eb26d7fa668 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:06.528289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862e840-29a3-4349-a01a-8eb26d7fa668 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:06.529509 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862e840-29a3-4349-a01a-8eb26d7fa668 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:06.531175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862e840-29a3-4349-a01a-8eb26d7fa668 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:06.543843 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 443/910] 10.222.0.41 () {56 vars in 1087 bytes} [Mon May 30 11:54:06 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 11:54:06.627421 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473d6d7-f256-4439-8968-80660b9c0c73 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:06.665988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456817f4-c7ba-4c52-a733-5a1f4b59fab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:06.666665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456817f4-c7ba-4c52-a733-5a1f4b59fab1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:06.666949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456817f4-c7ba-4c52-a733-5a1f4b59fab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:06.667227 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456817f4-c7ba-4c52-a733-5a1f4b59fab1 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:06.668060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456817f4-c7ba-4c52-a733-5a1f4b59fab1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:06.668376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456817f4-c7ba-4c52-a733-5a1f4b59fab1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:06.670087 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456817f4-c7ba-4c52-a733-5a1f4b59fab1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:06.687960 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 468/911] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:54:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:06.689840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862e840-29a3-4349-a01a-8eb26d7fa668 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:06.808779 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862e840-29a3-4349-a01a-8eb26d7fa668 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:06.848175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d243453-8d94-4bac-9dbf-20f6922a2e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:06.848841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d243453-8d94-4bac-9dbf-20f6922a2e8c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:06.849126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d243453-8d94-4bac-9dbf-20f6922a2e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:06.849407 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d243453-8d94-4bac-9dbf-20f6922a2e8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:06.850251 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d243453-8d94-4bac-9dbf-20f6922a2e8c None admin] RBAC: Adding query filter params (role.id=f22986e64f7e44279ed898fdf581a644, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=a63dd78421064bbe838b1ed0261c13bb) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:06.850567 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d243453-8d94-4bac-9dbf-20f6922a2e8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:06.852047 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d243453-8d94-4bac-9dbf-20f6922a2e8c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:06.863989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 444/912] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:54:06 2022] GET /identity/v3/role_assignments?user.id=a63dd78421064bbe838b1ed0261c13bb&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=f22986e64f7e44279ed898fdf581a644 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:07.646964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613e452-2869-4fe9-b159-2b693b71a0b7 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:07.647480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613e452-2869-4fe9-b159-2b693b71a0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:07.647559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613e452-2869-4fe9-b159-2b693b71a0b7 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:07.649187 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 469/913] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:07.654698 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c78c4-ef9b-4ce5-bd58-6cbf24a40a25 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:07.655147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c78c4-ef9b-4ce5-bd58-6cbf24a40a25 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:07.655339 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c78c4-ef9b-4ce5-bd58-6cbf24a40a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:07.673228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d22c78c4-ef9b-4ce5-bd58-6cbf24a40a25 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:07.674429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d22c78c4-ef9b-4ce5-bd58-6cbf24a40a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:07.720809 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:07.746030 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 445/914] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:07.780070 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613e452-2869-4fe9-b159-2b693b71a0b7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:07.797448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:07.819626 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc0796-159c-4c1b-89f9-962d540379cd None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:07.820018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc0796-159c-4c1b-89f9-962d540379cd None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:07.820316 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc0796-159c-4c1b-89f9-962d540379cd None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:07.821994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 446/915] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:07.827325 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1bc57-d71f-4816-919e-3bd8c9020fdf None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:07.827615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1bc57-d71f-4816-919e-3bd8c9020fdf None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:07.827933 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1bc57-d71f-4816-919e-3bd8c9020fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:07.845352 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-72f1bc57-d71f-4816-919e-3bd8c9020fdf None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:07.846546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-72f1bc57-d71f-4816-919e-3bd8c9020fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:07.896366 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613e452-2869-4fe9-b159-2b693b71a0b7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:07.932007 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 447/916] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:54:07.941676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5b385-ca6c-498b-84e6-197707fc3672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:07.942485 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5b385-ca6c-498b-84e6-197707fc3672 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:07.942776 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5b385-ca6c-498b-84e6-197707fc3672 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:07.943059 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5b385-ca6c-498b-84e6-197707fc3672 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:07.943727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5b385-ca6c-498b-84e6-197707fc3672 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:07.945137 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5b385-ca6c-498b-84e6-197707fc3672 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:07.955625 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1bc57-d71f-4816-919e-3bd8c9020fdf None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:07.960383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-63c5b385-ca6c-498b-84e6-197707fc3672 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:54:07.960383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:07.960383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:54:07.960383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:54:07.960383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:54:07.960383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:54:07.960383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:54:07.960383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:07.960383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:54:07.960383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:07.960383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:54:07.960383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:07.960383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:07.960383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:07.960383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:07.960383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:07.960383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:07.961361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:07.961361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:07.961361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:07.961361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:07.961361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:07.961361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:07.961361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:54:07.961361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:54:07.961361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:54:07.961361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:54:07.961361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:07.961361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:07.961361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:07.961361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:07.961361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:07.961361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:07.962733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:07.962733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:07.962733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:07.962733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:07.962733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:07.962733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:07.962733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:07.962733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:07.962733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:07.962733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:07.962733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:54:07.962733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:07.962733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:54:07.962733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:07.962733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 470/917] 10.222.0.41 () {56 vars in 1126 bytes} [Mon May 30 11:54:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:07.971269 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5b385-ca6c-498b-84e6-197707fc3672 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:08.058985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:08.082329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5b385-ca6c-498b-84e6-197707fc3672 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:08.087665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1bc57-d71f-4816-919e-3bd8c9020fdf None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:08.099767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:08.117588 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0d1ee-ff8f-4ecc-9591-6a8acc2246f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:08.118244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0d1ee-ff8f-4ecc-9591-6a8acc2246f6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:08.118537 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0d1ee-ff8f-4ecc-9591-6a8acc2246f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:08.118814 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0d1ee-ff8f-4ecc-9591-6a8acc2246f6 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:08.119526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0d1ee-ff8f-4ecc-9591-6a8acc2246f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:08.119853 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0d1ee-ff8f-4ecc-9591-6a8acc2246f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:08.121571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0d1ee-ff8f-4ecc-9591-6a8acc2246f6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:08.127913 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 471/918] 10.222.0.41 () {56 vars in 1122 bytes} [Mon May 30 11:54:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:08.130406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8b184-2039-4846-919a-a744a95851b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:08.131209 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8b184-2039-4846-919a-a744a95851b9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:08.131492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8b184-2039-4846-919a-a744a95851b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:08.131768 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8b184-2039-4846-919a-a744a95851b9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:08.132486 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8b184-2039-4846-919a-a744a95851b9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:08.133503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0d1ee-ff8f-4ecc-9591-6a8acc2246f6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:08.133875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8b184-2039-4846-919a-a744a95851b9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:08.148748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-5af8b184-2039-4846-919a-a744a95851b9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 30 11:54:08.148748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:08.148748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:54:08.148748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:54:08.148748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:54:08.148748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:54:08.148748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:54:08.148748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:08.148748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 30 11:54:08.148748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:08.148748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:54:08.148748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:08.148748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:08.148748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:08.148748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:08.148748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:08.148748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:08.149751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:08.149751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:08.149751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:08.149751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:08.149751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:08.149751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:08.149751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:54:08.149751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:54:08.149751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:54:08.149751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:54:08.149751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:08.149751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:08.149751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:08.149751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:08.149751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:08.149751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:08.150993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:08.150993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:08.150993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:08.150993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:08.150993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:08.150993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:08.150993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:08.150993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:08.150993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:08.150993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:08.150993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:54:08.150993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:08.150993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 30 11:54:08.150993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:08.155191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 448/919] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:54:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:08.156126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8b184-2039-4846-919a-a744a95851b9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:08.261066 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0d1ee-ff8f-4ecc-9591-6a8acc2246f6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:08.293341 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8b184-2039-4846-919a-a744a95851b9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:08.298292 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16796533-eeec-4160-ac01-d03f00362eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:08.299096 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16796533-eeec-4160-ac01-d03f00362eca None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:08.299519 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16796533-eeec-4160-ac01-d03f00362eca None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:08.299927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16796533-eeec-4160-ac01-d03f00362eca None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:08.300746 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16796533-eeec-4160-ac01-d03f00362eca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:08.301157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16796533-eeec-4160-ac01-d03f00362eca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:08.302621 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16796533-eeec-4160-ac01-d03f00362eca None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:08.308479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 472/920] 10.222.0.41 () {56 vars in 1122 bytes} [Mon May 30 11:54:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:08.314754 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16796533-eeec-4160-ac01-d03f00362eca None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:08.319544 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:08.336424 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e0b2a-51ca-4c66-8445-6082bc3a80a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:08.337688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e0b2a-51ca-4c66-8445-6082bc3a80a0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:08.338401 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e0b2a-51ca-4c66-8445-6082bc3a80a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:08.338828 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e0b2a-51ca-4c66-8445-6082bc3a80a0 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:08.339857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e0b2a-51ca-4c66-8445-6082bc3a80a0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:08.340314 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e0b2a-51ca-4c66-8445-6082bc3a80a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:08.342164 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e0b2a-51ca-4c66-8445-6082bc3a80a0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:08.348906 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 449/921] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:54:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:08.354733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e0b2a-51ca-4c66-8445-6082bc3a80a0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:08.394680 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:08.430934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16796533-eeec-4160-ac01-d03f00362eca None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:08.467595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e0b2a-51ca-4c66-8445-6082bc3a80a0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:08.468501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e826ee7-2996-40e6-9730-00ae3b8c79e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:08.469372 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e826ee7-2996-40e6-9730-00ae3b8c79e9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:08.469834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e826ee7-2996-40e6-9730-00ae3b8c79e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:08.470305 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e826ee7-2996-40e6-9730-00ae3b8c79e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:08.471406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e826ee7-2996-40e6-9730-00ae3b8c79e9 None admin] RBAC: Adding query filter params (interface=public, service_id=73f9c696731245d2824dec7123a11e89, region_id=RegionOne) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:08.472086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e826ee7-2996-40e6-9730-00ae3b8c79e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:08.473725 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e826ee7-2996-40e6-9730-00ae3b8c79e9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:08.479880 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 473/922] 10.222.0.41 () {56 vars in 1251 bytes} [Mon May 30 11:54:08 2022] GET /identity/v3/endpoints?service_id=73f9c696731245d2824dec7123a11e89&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:08.484998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e826ee7-2996-40e6-9730-00ae3b8c79e9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:08.506585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb61dd-9ef5-44f2-8fec-2a42d1e0cde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:08.507261 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb61dd-9ef5-44f2-8fec-2a42d1e0cde7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:08.507545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb61dd-9ef5-44f2-8fec-2a42d1e0cde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:08.507857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb61dd-9ef5-44f2-8fec-2a42d1e0cde7 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:08.508711 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb61dd-9ef5-44f2-8fec-2a42d1e0cde7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:08.509019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb61dd-9ef5-44f2-8fec-2a42d1e0cde7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:08.510506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb61dd-9ef5-44f2-8fec-2a42d1e0cde7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:08.521048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 450/923] 10.222.0.41 () {56 vars in 1114 bytes} [Mon May 30 11:54:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:08.521835 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb61dd-9ef5-44f2-8fec-2a42d1e0cde7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:08.562781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:08.600429 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e826ee7-2996-40e6-9730-00ae3b8c79e9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:08.637787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c7c03-df1c-483a-9721-4e8f808f69ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:08.639126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:08.640778 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c7c03-df1c-483a-9721-4e8f808f69ad None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:08.641308 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c7c03-df1c-483a-9721-4e8f808f69ad None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:08.641803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c7c03-df1c-483a-9721-4e8f808f69ad None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:08.642160 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb61dd-9ef5-44f2-8fec-2a42d1e0cde7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:08.643065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c7c03-df1c-483a-9721-4e8f808f69ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:08.644837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c7c03-df1c-483a-9721-4e8f808f69ad None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:08.652428 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 474/924] 10.222.0.41 () {56 vars in 1087 bytes} [Mon May 30 11:54:08 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 11:54:08.691769 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9564996-2247-4615-9f92-9ef239667424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:08.692492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9564996-2247-4615-9f92-9ef239667424 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:08.692770 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9564996-2247-4615-9f92-9ef239667424 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:08.693049 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9564996-2247-4615-9f92-9ef239667424 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:08.693837 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9564996-2247-4615-9f92-9ef239667424 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:08.695336 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9564996-2247-4615-9f92-9ef239667424 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:08.723544 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 451/925] 10.222.0.41 () {60 vars in 1144 bytes} [Mon May 30 11:54:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:54:09.006822 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afc08b-9086-497a-b927-8573dd2eba04 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:09.007193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afc08b-9086-497a-b927-8573dd2eba04 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:09.007402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afc08b-9086-497a-b927-8573dd2eba04 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:09.009013 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 475/926] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:09.015225 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626de60-4a12-47cb-802b-f48ccde5e5c6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:09.015528 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626de60-4a12-47cb-802b-f48ccde5e5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:09.015833 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626de60-4a12-47cb-802b-f48ccde5e5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:09.033801 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f626de60-4a12-47cb-802b-f48ccde5e5c6 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:09.034929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f626de60-4a12-47cb-802b-f48ccde5e5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:09.113966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 452/927] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:09.136457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afc08b-9086-497a-b927-8573dd2eba04 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:09.223977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56731791-be6c-4bbe-b844-723de3ae04b0 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:09.224819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56731791-be6c-4bbe-b844-723de3ae04b0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:09.225221 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56731791-be6c-4bbe-b844-723de3ae04b0 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:09.227489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 453/928] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:09.233363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af31f0-d985-42d0-acc5-f4a489c4246b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:09.233786 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af31f0-d985-42d0-acc5-f4a489c4246b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:09.234387 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af31f0-d985-42d0-acc5-f4a489c4246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:09.252879 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afc08b-9086-497a-b927-8573dd2eba04 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:09.257066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c9af31f0-d985-42d0-acc5-f4a489c4246b None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:09.258392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c9af31f0-d985-42d0-acc5-f4a489c4246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:09.288283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:09.293590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321557e-c728-45b4-b95f-de30ca3bd0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:09.295161 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321557e-c728-45b4-b95f-de30ca3bd0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:09.295700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321557e-c728-45b4-b95f-de30ca3bd0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:09.296207 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321557e-c728-45b4-b95f-de30ca3bd0d1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:09.297116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321557e-c728-45b4-b95f-de30ca3bd0d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:09.298841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321557e-c728-45b4-b95f-de30ca3bd0d1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:09.317359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-5321557e-c728-45b4-b95f-de30ca3bd0d1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 30 11:54:09.317359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:09.317359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:54:09.317359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:54:09.317359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:54:09.317359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:54:09.317359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:54:09.317359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:09.317359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 30 11:54:09.317359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:09.317359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:54:09.317359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:09.317359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:09.317359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:09.317359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:09.317359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:09.318349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:09.318349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:09.318349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:09.318349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:09.318349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:09.318349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:09.318349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:09.318349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:54:09.318349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:54:09.318349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:54:09.318349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:54:09.318349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:09.318349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:09.318349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:09.318349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:09.318349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:09.319490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:09.319490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:09.319490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:09.319490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:09.319490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:09.319490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:09.319490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:09.319490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:09.319490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:09.319490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:09.319490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:09.319490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:54:09.319490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:09.319490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 30 11:54:09.319490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:09.319490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 476/929] 10.222.0.41 () {56 vars in 1132 bytes} [Mon May 30 11:54:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:09.324479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321557e-c728-45b4-b95f-de30ca3bd0d1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:09.343538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 454/930] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:09.370817 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af31f0-d985-42d0-acc5-f4a489c4246b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:09.386762 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:09.453471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321557e-c728-45b4-b95f-de30ca3bd0d1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:09.491798 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec541f8f-8d5f-4528-ad99-d9c979d1e7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:09.492500 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec541f8f-8d5f-4528-ad99-d9c979d1e7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:09.492789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec541f8f-8d5f-4528-ad99-d9c979d1e7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:09.493111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec541f8f-8d5f-4528-ad99-d9c979d1e7d3 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:09.493777 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec541f8f-8d5f-4528-ad99-d9c979d1e7d3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:09.494087 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec541f8f-8d5f-4528-ad99-d9c979d1e7d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:09.496076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec541f8f-8d5f-4528-ad99-d9c979d1e7d3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:09.500284 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af31f0-d985-42d0-acc5-f4a489c4246b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:09.501898 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 477/931] 10.222.0.41 () {56 vars in 1126 bytes} [Mon May 30 11:54:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:09.506971 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec541f8f-8d5f-4528-ad99-d9c979d1e7d3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:09.538538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5efb7c-ff8a-4a9c-a677-1714ac3b6703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:09.539275 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5efb7c-ff8a-4a9c-a677-1714ac3b6703 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:09.539558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5efb7c-ff8a-4a9c-a677-1714ac3b6703 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:09.539854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5efb7c-ff8a-4a9c-a677-1714ac3b6703 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:09.552170 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5efb7c-ff8a-4a9c-a677-1714ac3b6703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:54:09.561767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7f5efb7c-ff8a-4a9c-a677-1714ac3b6703 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:54:09.561767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:09.561767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:09.561767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:09.561767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:09.561767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:09.561767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:09.561767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:09.561767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:09.561767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:09.561767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:09.561767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:09.561767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:54:09.561767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:54:09.561767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:54:09.561767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:54:09.562731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:54:09.562731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:54:09.562731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:54:09.562731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:54:09.562731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:09.562731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:09.562731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:09.562731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:09.562731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:09.562731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:09.562731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:09.562731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:09.562731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:09.562731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:09.562731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:09.562731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:09.563576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:09.563576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:09.563576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:09.563576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:09.563576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:54:09.563576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:54:09.563576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:54:09.563576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:54:09.563576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:54:09.563576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:54:09.563576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:54:09.563576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:09.568031 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 455/932] 10.222.0.41 () {56 vars in 1120 bytes} [Mon May 30 11:54:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:09.569401 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5efb7c-ff8a-4a9c-a677-1714ac3b6703 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:09.585796 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:09.641503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec541f8f-8d5f-4528-ad99-d9c979d1e7d3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:09.647994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:09.682608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5efb7c-ff8a-4a9c-a677-1714ac3b6703 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:09.687149 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb2a9c-4592-444d-9438-050bbe967eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:09.688456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb2a9c-4592-444d-9438-050bbe967eca None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:09.688965 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb2a9c-4592-444d-9438-050bbe967eca None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:09.689472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb2a9c-4592-444d-9438-050bbe967eca None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:09.690387 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb2a9c-4592-444d-9438-050bbe967eca None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:09.691308 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb2a9c-4592-444d-9438-050bbe967eca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:09.694724 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb2a9c-4592-444d-9438-050bbe967eca None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:09.702167 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 478/933] 10.222.0.41 () {56 vars in 1126 bytes} [Mon May 30 11:54:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:09.707944 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb2a9c-4592-444d-9438-050bbe967eca None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:09.723432 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954aee6-0fcd-4a79-9442-67ff45222dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:09.724722 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954aee6-0fcd-4a79-9442-67ff45222dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:09.725008 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954aee6-0fcd-4a79-9442-67ff45222dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:09.725296 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954aee6-0fcd-4a79-9442-67ff45222dd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:09.726100 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954aee6-0fcd-4a79-9442-67ff45222dd9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:09.726415 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954aee6-0fcd-4a79-9442-67ff45222dd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:09.727981 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954aee6-0fcd-4a79-9442-67ff45222dd9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:09.742365 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 456/934] 10.222.0.41 () {56 vars in 1115 bytes} [Mon May 30 11:54:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:09.743737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954aee6-0fcd-4a79-9442-67ff45222dd9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:09.847595 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb2a9c-4592-444d-9438-050bbe967eca None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:09.870128 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954aee6-0fcd-4a79-9442-67ff45222dd9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:09.881286 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:09.898643 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d110ad-58ef-450d-9f12-310d32cadc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:09.899552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d110ad-58ef-450d-9f12-310d32cadc22 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:09.900010 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d110ad-58ef-450d-9f12-310d32cadc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:09.900444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d110ad-58ef-450d-9f12-310d32cadc22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:09.901327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d110ad-58ef-450d-9f12-310d32cadc22 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:09.904400 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d110ad-58ef-450d-9f12-310d32cadc22 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:09.923251 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e4360-8c7a-4625-90a5-eabc43465f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:09.924172 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e4360-8c7a-4625-90a5-eabc43465f9a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:09.924476 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e4360-8c7a-4625-90a5-eabc43465f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:09.924847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e4360-8c7a-4625-90a5-eabc43465f9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:09.927299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:09.938178 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 479/935] 10.222.0.41 () {60 vars in 1144 bytes} [Mon May 30 11:54:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:54:09.951438 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e4360-8c7a-4625-90a5-eabc43465f9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:09.953800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e4360-8c7a-4625-90a5-eabc43465f9a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:09.975095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-a41e4360-8c7a-4625-90a5-eabc43465f9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:09.975095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:09.975095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:09.975095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:09.975095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:09.975095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:09.975095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:09.975095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:09.975095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:09.975095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:09.975095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:09.975095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:09.975095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:54:09.975095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:54:09.975095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:54:09.976153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:54:09.976153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:09.976153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:09.976153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:09.976153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:09.976153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:09.976153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:09.976153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:09.976153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:09.976153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:09.976153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:09.976153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:09.976153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:09.976153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:09.976153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:09.976153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:09.976153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:09.977039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:54:09.977039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:54:09.977039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:09.977039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:09.977685 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 457/936] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:09.984992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d110ad-58ef-450d-9f12-310d32cadc22 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:10.110816 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d110ad-58ef-450d-9f12-310d32cadc22 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:10.148400 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e1dc7-92ba-4993-906c-532f3eda389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:10.149069 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e1dc7-92ba-4993-906c-532f3eda389b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:10.149357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e1dc7-92ba-4993-906c-532f3eda389b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:10.149627 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e1dc7-92ba-4993-906c-532f3eda389b None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:10.150356 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e1dc7-92ba-4993-906c-532f3eda389b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:10.150700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e1dc7-92ba-4993-906c-532f3eda389b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:10.152203 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e1dc7-92ba-4993-906c-532f3eda389b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:10.165683 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 480/937] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:10.172534 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e4360-8c7a-4625-90a5-eabc43465f9a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:10.280636 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e4360-8c7a-4625-90a5-eabc43465f9a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:10.317088 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872454ea-0438-4a76-8b12-6c2252c8313c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:10.318220 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872454ea-0438-4a76-8b12-6c2252c8313c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:10.318709 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872454ea-0438-4a76-8b12-6c2252c8313c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:10.319206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872454ea-0438-4a76-8b12-6c2252c8313c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:10.328676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872454ea-0438-4a76-8b12-6c2252c8313c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:10.330420 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872454ea-0438-4a76-8b12-6c2252c8313c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:10.346033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-872454ea-0438-4a76-8b12-6c2252c8313c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:54:10.346033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:10.346033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:10.346033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:10.346033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:10.346033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:10.346033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:10.346033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:10.346033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:10.346033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:10.346033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:10.346033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:10.346033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:54:10.346033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:54:10.346033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:54:10.346033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:54:10.346965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:10.346965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:10.346965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:54:10.346965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:54:10.346965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:54:10.346965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:54:10.346965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:10.346965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:10.346965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:10.346965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:10.346965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:10.346965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:10.346965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:10.346965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:10.346965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:10.346965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:10.346965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:10.346965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:10.347929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:10.347929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:10.347929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:54:10.347929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:54:10.347929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:54:10.347929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:54:10.347929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:54:10.347929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:54:10.347929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:54:10.347929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:10.350120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 458/938] 10.222.0.41 () {56 vars in 1117 bytes} [Mon May 30 11:54:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:10.355861 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e1dc7-92ba-4993-906c-532f3eda389b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:10.393957 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:10.462560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e1dc7-92ba-4993-906c-532f3eda389b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:10.499043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55ac8c-f26f-4ad9-925c-e6d0b1511cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:10.499723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55ac8c-f26f-4ad9-925c-e6d0b1511cca None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:10.500035 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55ac8c-f26f-4ad9-925c-e6d0b1511cca None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:10.500312 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55ac8c-f26f-4ad9-925c-e6d0b1511cca None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:10.501154 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55ac8c-f26f-4ad9-925c-e6d0b1511cca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:10.501461 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55ac8c-f26f-4ad9-925c-e6d0b1511cca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:10.502870 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55ac8c-f26f-4ad9-925c-e6d0b1511cca None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:10.523515 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 481/939] 10.222.0.41 () {56 vars in 1149 bytes} [Mon May 30 11:54:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:10.529922 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872454ea-0438-4a76-8b12-6c2252c8313c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:10.582173 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:10.639811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872454ea-0438-4a76-8b12-6c2252c8313c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:10.675694 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895154d-e94f-402d-9fda-d48e69c28234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:10.676483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895154d-e94f-402d-9fda-d48e69c28234 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:10.676765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895154d-e94f-402d-9fda-d48e69c28234 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:10.677087 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895154d-e94f-402d-9fda-d48e69c28234 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:10.688475 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895154d-e94f-402d-9fda-d48e69c28234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:10.689950 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895154d-e94f-402d-9fda-d48e69c28234 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:10.708429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-4895154d-e94f-402d-9fda-d48e69c28234 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:10.708429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:10.708429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:10.708429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:10.708429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:10.708429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:10.708429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:10.708429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:10.708429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:10.708429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:10.708429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:10.708429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:10.708429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:54:10.708429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:54:10.708429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:54:10.709368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:54:10.709368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:10.709368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:10.709368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:10.709368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:10.709368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:10.709368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:10.709368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:10.709368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:10.709368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:10.709368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:10.709368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:10.709368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:10.709368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:10.709368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:10.709368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:10.709368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:10.710725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:54:10.710725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:54:10.710725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:10.710725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:10.710725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 459/940] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:10.716532 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55ac8c-f26f-4ad9-925c-e6d0b1511cca None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:10.824184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:10.832509 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55ac8c-f26f-4ad9-925c-e6d0b1511cca None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:10.867158 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d389074-4e39-4f2c-9836-09412e9f364d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:10.867841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d389074-4e39-4f2c-9836-09412e9f364d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:10.868134 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d389074-4e39-4f2c-9836-09412e9f364d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:10.868414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d389074-4e39-4f2c-9836-09412e9f364d None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:10.869135 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d389074-4e39-4f2c-9836-09412e9f364d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:10.869441 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d389074-4e39-4f2c-9836-09412e9f364d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:10.871068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d389074-4e39-4f2c-9836-09412e9f364d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:10.884188 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 482/941] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:10.890410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895154d-e94f-402d-9fda-d48e69c28234 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:10.993592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:10.998515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895154d-e94f-402d-9fda-d48e69c28234 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:11.033634 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e8a86-d7d2-4b70-93b0-4092d0a5b9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:11.034435 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e8a86-d7d2-4b70-93b0-4092d0a5b9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:11.034715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e8a86-d7d2-4b70-93b0-4092d0a5b9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:11.034989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e8a86-d7d2-4b70-93b0-4092d0a5b9b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:11.041787 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e8a86-d7d2-4b70-93b0-4092d0a5b9b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:11.043417 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e8a86-d7d2-4b70-93b0-4092d0a5b9b1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:11.058289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b14e8a86-d7d2-4b70-93b0-4092d0a5b9b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:54:11.058289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:11.058289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:11.058289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:11.058289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:11.058289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:11.058289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:11.058289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:11.058289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:11.058289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:11.058289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:11.058289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:11.058289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:54:11.058289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:54:11.058289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:54:11.059213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:54:11.059213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:11.059213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:11.059213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:11.059213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:11.059213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:11.059213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:11.059213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:11.059213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:11.059213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:11.059213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:11.059213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:11.059213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:11.059213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:11.059213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:11.059213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:11.059213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:11.060571 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:54:11.060571 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:54:11.060571 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:54:11.060571 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:54:11.060571 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:54:11.060571 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:54:11.060571 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:54:11.060571 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:11.063900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 460/942] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:54:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:11.065508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebabd0a-7afa-4132-afc2-cddbfd9e82f5 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:11.065800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebabd0a-7afa-4132-afc2-cddbfd9e82f5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:11.066077 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebabd0a-7afa-4132-afc2-cddbfd9e82f5 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:11.067538 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 483/943] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:11.068905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e8a86-d7d2-4b70-93b0-4092d0a5b9b1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:11.074541 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fc3f4-92b7-48f8-92b2-04ae2934cc14 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:11.074836 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fc3f4-92b7-48f8-92b2-04ae2934cc14 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:11.075123 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fc3f4-92b7-48f8-92b2-04ae2934cc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:11.093296 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-949fc3f4-92b7-48f8-92b2-04ae2934cc14 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:11.094496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-949fc3f4-92b7-48f8-92b2-04ae2934cc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:11.163090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 484/944] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:54:11.173253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfb154-7882-4baf-8e59-89bd127bc97c None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:11.173652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfb154-7882-4baf-8e59-89bd127bc97c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:11.173913 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfb154-7882-4baf-8e59-89bd127bc97c None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:11.175256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 485/945] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:11 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:11.181101 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccefd0-a7e5-4936-970a-2d999a425bdf None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:11.181395 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccefd0-a7e5-4936-970a-2d999a425bdf None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:11.181676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccefd0-a7e5-4936-970a-2d999a425bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:11.183274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e8a86-d7d2-4b70-93b0-4092d0a5b9b1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:11.199962 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a3ccefd0-a7e5-4936-970a-2d999a425bdf None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:11.201909 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a3ccefd0-a7e5-4936-970a-2d999a425bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:11.224492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3341619-7aa1-4413-8c91-024ef9bcc977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:11.225164 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3341619-7aa1-4413-8c91-024ef9bcc977 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:11.225452 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3341619-7aa1-4413-8c91-024ef9bcc977 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:11.225735 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3341619-7aa1-4413-8c91-024ef9bcc977 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:11.226524 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3341619-7aa1-4413-8c91-024ef9bcc977 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:11.226842 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3341619-7aa1-4413-8c91-024ef9bcc977 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:11.228316 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3341619-7aa1-4413-8c91-024ef9bcc977 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:11.240520 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 461/946] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:54:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:11.241329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3341619-7aa1-4413-8c91-024ef9bcc977 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:11.264474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:11.283417 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 486/947] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:11.284373 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccefd0-a7e5-4936-970a-2d999a425bdf None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:11.302052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:11.352696 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3341619-7aa1-4413-8c91-024ef9bcc977 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:11.393509 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218590b2-140f-4c3e-ad02-8e30ac74f361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:11.394426 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218590b2-140f-4c3e-ad02-8e30ac74f361 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:11.394776 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218590b2-140f-4c3e-ad02-8e30ac74f361 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:11.395058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218590b2-140f-4c3e-ad02-8e30ac74f361 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:11.395709 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218590b2-140f-4c3e-ad02-8e30ac74f361 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:11.397109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218590b2-140f-4c3e-ad02-8e30ac74f361 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:11.397213 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccefd0-a7e5-4936-970a-2d999a425bdf None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:11.409396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-218590b2-140f-4c3e-ad02-8e30ac74f361 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:54:11.409396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:11.409396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:54:11.409396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:54:11.409396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:54:11.409396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:54:11.409396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:54:11.409396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:11.409396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:54:11.409396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:11.409396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:54:11.409396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:11.409396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:11.409396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:11.409396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:11.409396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:11.409396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:11.410397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:11.410397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:11.410397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:11.410397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:11.410397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:11.410397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:11.410397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:54:11.410397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:54:11.410397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:54:11.410397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:54:11.410397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:11.410397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:11.410397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:11.410397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:11.410397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:11.410397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:11.411233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:11.411233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:11.411233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:11.411233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:11.411233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:11.411233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:11.411233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:11.411233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:11.411233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:11.411233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:11.411233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:54:11.411233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:11.411233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:54:11.411233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:11.411233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 462/948] 10.222.0.41 () {56 vars in 1126 bytes} [Mon May 30 11:54:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:11.412702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218590b2-140f-4c3e-ad02-8e30ac74f361 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:11.433860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2218a-63ba-4f78-9472-9bf32525987c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:11.434864 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2218a-63ba-4f78-9472-9bf32525987c None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:11.435157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2218a-63ba-4f78-9472-9bf32525987c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:11.435442 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2218a-63ba-4f78-9472-9bf32525987c None admin] PATH_INFO: `/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/a63dd78421064bbe838b1ed0261c13bb/roles/f22986e64f7e44279ed898fdf581a644` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:11.437825 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2218a-63ba-4f78-9472-9bf32525987c None admin] RBAC: Authorizing `identity:create_grant(project_id=1e8426fd0e01433b8aa3a3797c687e03, user_id=a63dd78421064bbe838b1ed0261c13bb, role_id=f22986e64f7e44279ed898fdf581a644)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:11.439740 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2218a-63ba-4f78-9472-9bf32525987c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:11.453603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 487/949] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:54:11 2022] PUT /identity/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/a63dd78421064bbe838b1ed0261c13bb/roles/f22986e64f7e44279ed898fdf581a644 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:54:11.454714 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2218a-63ba-4f78-9472-9bf32525987c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:11.518616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:11.542071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218590b2-140f-4c3e-ad02-8e30ac74f361 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:11.582157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:11.593540 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cabb6-e59b-4c39-81f1-243b5e6a8b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:11.595397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cabb6-e59b-4c39-81f1-243b5e6a8b7d None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:11.596042 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cabb6-e59b-4c39-81f1-243b5e6a8b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:11.596538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cabb6-e59b-4c39-81f1-243b5e6a8b7d None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:11.597501 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cabb6-e59b-4c39-81f1-243b5e6a8b7d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:11.599950 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cabb6-e59b-4c39-81f1-243b5e6a8b7d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:11.602021 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: WARNING keystone.server.flask.common [None req-1c2cabb6-e59b-4c39-81f1-243b5e6a8b7d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 30 11:54:11.614266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2218a-63ba-4f78-9472-9bf32525987c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:11.628573 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.sql.core [None req-1c2cabb6-e59b-4c39-81f1-243b5e6a8b7d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 30 11:54:11.628573 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 30 11:54:11.628573 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [parameters: {'id': '8ffd17421b0c4c65a8bac80cba53c14f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 30 11:54:11.628573 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80189) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 30 11:54:11.647558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-1c2cabb6-e59b-4c39-81f1-243b5e6a8b7d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8ffd17421b0c4c65a8bac80cba53c14f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8ffd17421b0c4c65a8bac80cba53c14f. May 30 11:54:11.647558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:11.647558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 30 11:54:11.647558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.dialect.do_execute( May 30 11:54:11.647558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 30 11:54:11.647558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 30 11:54:11.647558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 30 11:54:11.647558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application result = self._query(query) May 30 11:54:11.647558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 30 11:54:11.647558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application conn.query(q) May 30 11:54:11.647558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 30 11:54:11.647558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 30 11:54:11.647558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 30 11:54:11.648482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application result.read() May 30 11:54:11.648482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 30 11:54:11.648482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 30 11:54:11.648482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 30 11:54:11.648482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application packet.raise_for_error() May 30 11:54:11.648482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 30 11:54:11.648482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 30 11:54:11.648482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 30 11:54:11.648482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 30 11:54:11.648482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 30 11:54:11.648482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:11.648482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 30 11:54:11.648482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:11.648482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:11.648482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 30 11:54:11.648482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 30 11:54:11.648482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 30 11:54:11.648482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return project_ref.to_dict() May 30 11:54:11.649436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 30 11:54:11.649436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application next(self.gen) May 30 11:54:11.649436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 30 11:54:11.649436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application yield resource May 30 11:54:11.649436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 30 11:54:11.649436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application next(self.gen) May 30 11:54:11.649436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 30 11:54:11.649436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.session.rollback() May 30 11:54:11.649436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 30 11:54:11.649436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.force_reraise() May 30 11:54:11.649436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 30 11:54:11.649436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise self.value May 30 11:54:11.649436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 30 11:54:11.649436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 30 11:54:11.649436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 30 11:54:11.649436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application session.commit() May 30 11:54:11.649436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 30 11:54:11.650342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 30 11:54:11.650342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 30 11:54:11.650342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._prepare_impl() May 30 11:54:11.650342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 30 11:54:11.650342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.session.flush() May 30 11:54:11.650342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 30 11:54:11.650342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._flush(objects) May 30 11:54:11.650342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 30 11:54:11.650342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 30 11:54:11.650342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 30 11:54:11.650342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application compat.raise_( May 30 11:54:11.650342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 30 11:54:11.650342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception May 30 11:54:11.650342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 30 11:54:11.650342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application flush_context.execute() May 30 11:54:11.650342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 30 11:54:11.650342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rec.execute(self) May 30 11:54:11.651231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 30 11:54:11.651231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 30 11:54:11.651231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 30 11:54:11.651231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application _emit_insert_statements( May 30 11:54:11.651231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 30 11:54:11.651231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application c = connection._execute_20( May 30 11:54:11.651231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 30 11:54:11.651231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 30 11:54:11.651231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 30 11:54:11.651231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 30 11:54:11.651231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 30 11:54:11.651231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ret = self._execute_context( May 30 11:54:11.651231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 30 11:54:11.651231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 30 11:54:11.651231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 30 11:54:11.652061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 30 11:54:11.652061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 30 11:54:11.652061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception May 30 11:54:11.652061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 30 11:54:11.652061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.dialect.do_execute( May 30 11:54:11.652061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 30 11:54:11.652061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 30 11:54:11.652061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 30 11:54:11.652061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application result = self._query(query) May 30 11:54:11.652061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 30 11:54:11.652061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application conn.query(q) May 30 11:54:11.652061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 30 11:54:11.652061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 30 11:54:11.652061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 30 11:54:11.652061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application result.read() May 30 11:54:11.652061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 30 11:54:11.652061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 30 11:54:11.652927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 30 11:54:11.652927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application packet.raise_for_error() May 30 11:54:11.652927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 30 11:54:11.652927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 30 11:54:11.652927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 30 11:54:11.652927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 30 11:54:11.652927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 30 11:54:11.652927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 30 11:54:11.652927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [parameters: {'id': '8ffd17421b0c4c65a8bac80cba53c14f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 30 11:54:11.652927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 30 11:54:11.652927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:11.652927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:54:11.652927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:11.652927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:11.652927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 30 11:54:11.654267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 30 11:54:11.654267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 30 11:54:11.654267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 30 11:54:11.654267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 30 11:54:11.654267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:11.654267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:54:11.654267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:11.654267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:11.654267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:11.654267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:11.654267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:11.654267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:11.654267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:11.654267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:11.654267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:11.654267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:11.654267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:11.655329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:11.655329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 30 11:54:11.655329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 30 11:54:11.655329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:11.655329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:11.655329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 30 11:54:11.655329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.Conflict( May 30 11:54:11.655329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8ffd17421b0c4c65a8bac80cba53c14f. May 30 11:54:11.655329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:11.655329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 463/950] 10.222.0.41 () {60 vars in 1140 bytes} [Mon May 30 11:54:11 2022] POST /identity/v3/projects => generated 262 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:11.657677 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cabb6-e59b-4c39-81f1-243b5e6a8b7d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:11.664882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d19f59-deec-4138-ac12-4893dbef1568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:11.665928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d19f59-deec-4138-ac12-4893dbef1568 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:11.666458 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d19f59-deec-4138-ac12-4893dbef1568 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:11.666945 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d19f59-deec-4138-ac12-4893dbef1568 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:11.667913 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d19f59-deec-4138-ac12-4893dbef1568 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:11.668433 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d19f59-deec-4138-ac12-4893dbef1568 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:11.670689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d19f59-deec-4138-ac12-4893dbef1568 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:11.676885 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 488/951] 10.222.0.41 () {56 vars in 1122 bytes} [Mon May 30 11:54:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:11.685977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d19f59-deec-4138-ac12-4893dbef1568 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:11.781549 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cabb6-e59b-4c39-81f1-243b5e6a8b7d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:11.819486 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d19f59-deec-4138-ac12-4893dbef1568 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:11.827347 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062db255-500c-48e2-9288-c5c7bd415c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:11.828527 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062db255-500c-48e2-9288-c5c7bd415c37 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:11.829406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062db255-500c-48e2-9288-c5c7bd415c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:11.829849 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062db255-500c-48e2-9288-c5c7bd415c37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:11.839184 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062db255-500c-48e2-9288-c5c7bd415c37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:11.841714 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062db255-500c-48e2-9288-c5c7bd415c37 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:11.846046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:11.865503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e4f3e-f567-4c36-9f16-371dfbca66f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:11.866168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e4f3e-f567-4c36-9f16-371dfbca66f4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:11.866450 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e4f3e-f567-4c36-9f16-371dfbca66f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:11.866739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e4f3e-f567-4c36-9f16-371dfbca66f4 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:11.867148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-062db255-500c-48e2-9288-c5c7bd415c37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:54:11.867148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:11.867148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:11.867148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:11.867148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:11.867148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:11.867148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:11.867148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:11.867148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:11.867148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:11.867148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:11.867148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:11.867148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:54:11.867148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:54:11.867148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:54:11.868103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:54:11.868103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:11.868103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:11.868103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:11.868103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:11.868103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:11.868103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:11.868103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:11.868103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:11.868103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:11.868103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:11.868103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:11.868103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:11.868103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:11.868103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:11.868103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:11.868103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:11.869035 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:54:11.869035 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:54:11.869035 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:54:11.869035 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:54:11.869035 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:54:11.869035 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:54:11.869035 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:54:11.869035 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:11.869464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e4f3e-f567-4c36-9f16-371dfbca66f4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:11.869464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e4f3e-f567-4c36-9f16-371dfbca66f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:11.869464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e4f3e-f567-4c36-9f16-371dfbca66f4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:11.872951 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 464/952] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:54:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:11.878410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062db255-500c-48e2-9288-c5c7bd415c37 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:11.879651 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 489/953] 10.222.0.41 () {56 vars in 1122 bytes} [Mon May 30 11:54:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:11.889206 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e4f3e-f567-4c36-9f16-371dfbca66f4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:11.892224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:11.997082 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062db255-500c-48e2-9288-c5c7bd415c37 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:12.002779 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e4f3e-f567-4c36-9f16-371dfbca66f4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:12.038586 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bda86-4fdb-4bd9-aaf9-a49fe77848c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:12.039224 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bda86-4fdb-4bd9-aaf9-a49fe77848c7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:12.039517 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bda86-4fdb-4bd9-aaf9-a49fe77848c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:12.039877 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bda86-4fdb-4bd9-aaf9-a49fe77848c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:12.040934 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bda86-4fdb-4bd9-aaf9-a49fe77848c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:12.041260 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bda86-4fdb-4bd9-aaf9-a49fe77848c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:12.041667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4bf34-9ab5-4464-a220-e1ff951cd7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:12.042354 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4bf34-9ab5-4464-a220-e1ff951cd7a2 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:12.042639 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4bf34-9ab5-4464-a220-e1ff951cd7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:12.042859 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bda86-4fdb-4bd9-aaf9-a49fe77848c7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:12.042975 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4bf34-9ab5-4464-a220-e1ff951cd7a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:12.043675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4bf34-9ab5-4464-a220-e1ff951cd7a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:12.045740 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4bf34-9ab5-4464-a220-e1ff951cd7a2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:12.068364 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 490/954] 10.222.0.41 () {60 vars in 1144 bytes} [Mon May 30 11:54:11 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:54:12.072014 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 465/955] 10.222.0.41 () {56 vars in 1112 bytes} [Mon May 30 11:54:11 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:12.371411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26d8dc-c011-482e-a838-83e1e1b51fd1 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:12.371753 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26d8dc-c011-482e-a838-83e1e1b51fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:12.371911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26d8dc-c011-482e-a838-83e1e1b51fd1 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:12.374157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 491/956] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:12.379947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0ac51-7f96-4bb0-9cff-21abdfac0155 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:12.380519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0ac51-7f96-4bb0-9cff-21abdfac0155 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:12.381032 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0ac51-7f96-4bb0-9cff-21abdfac0155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:12.398506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-dea0ac51-7f96-4bb0-9cff-21abdfac0155 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:12.400365 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-dea0ac51-7f96-4bb0-9cff-21abdfac0155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:12.456233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:12.483934 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 466/957] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:12.500881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26d8dc-c011-482e-a838-83e1e1b51fd1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:12.564610 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:12.614830 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26d8dc-c011-482e-a838-83e1e1b51fd1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:12.651593 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2cd64-085a-4a7a-8614-caa19192b9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:12.652427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2cd64-085a-4a7a-8614-caa19192b9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:12.652711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2cd64-085a-4a7a-8614-caa19192b9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:12.652989 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2cd64-085a-4a7a-8614-caa19192b9d0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:12.653869 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2cd64-085a-4a7a-8614-caa19192b9d0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:12.655238 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2cd64-085a-4a7a-8614-caa19192b9d0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:12.667451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-def2cd64-085a-4a7a-8614-caa19192b9d0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 30 11:54:12.667451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:12.667451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:54:12.667451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:54:12.667451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:54:12.667451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:54:12.667451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:54:12.667451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:12.667451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 30 11:54:12.667451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:12.667451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:54:12.667451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:12.667451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:12.667451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:12.667451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:12.667451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:12.667451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:12.668654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:12.668654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:12.668654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:12.668654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:12.668654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:12.668654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:12.668654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:54:12.668654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:54:12.668654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:54:12.668654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:54:12.668654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:12.668654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:12.668654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:12.668654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:12.668654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:12.668654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:12.670052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:12.670052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:12.670052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:12.670052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:12.670052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:12.670052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:12.670052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:12.670052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:12.670052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:12.670052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:12.670052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:54:12.670052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:12.670052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 30 11:54:12.670052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:12.670052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 492/958] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:54:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:12.675705 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0ac51-7f96-4bb0-9cff-21abdfac0155 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:12.783092 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0ac51-7f96-4bb0-9cff-21abdfac0155 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:12.817728 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6af42-85e7-45a6-8b3a-beff5d80eed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:12.818627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6af42-85e7-45a6-8b3a-beff5d80eed2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:12.819081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6af42-85e7-45a6-8b3a-beff5d80eed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:12.819501 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6af42-85e7-45a6-8b3a-beff5d80eed2 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:12.820405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6af42-85e7-45a6-8b3a-beff5d80eed2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:12.820859 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6af42-85e7-45a6-8b3a-beff5d80eed2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:12.822390 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6af42-85e7-45a6-8b3a-beff5d80eed2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:12.833139 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 467/959] 10.222.0.41 () {56 vars in 1112 bytes} [Mon May 30 11:54:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:12.834711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2cd64-085a-4a7a-8614-caa19192b9d0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:12.945157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2cd64-085a-4a7a-8614-caa19192b9d0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:12.969553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:12.981430 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83777b4-d811-4adb-9d04-7b8bcf37f22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:12.982801 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83777b4-d811-4adb-9d04-7b8bcf37f22a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:12.983469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83777b4-d811-4adb-9d04-7b8bcf37f22a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:12.983757 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83777b4-d811-4adb-9d04-7b8bcf37f22a None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:12.984515 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83777b4-d811-4adb-9d04-7b8bcf37f22a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:12.985185 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83777b4-d811-4adb-9d04-7b8bcf37f22a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:12.986954 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83777b4-d811-4adb-9d04-7b8bcf37f22a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:12.992067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 493/960] 10.222.0.41 () {56 vars in 1112 bytes} [Mon May 30 11:54:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:13.870832 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751def17-8193-4151-b3d6-aeeaa0553fdb None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:13.871344 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751def17-8193-4151-b3d6-aeeaa0553fdb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:13.871594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751def17-8193-4151-b3d6-aeeaa0553fdb None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:13.873866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 468/961] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:13.879091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446ba06-a6c8-469e-9430-67a9b10e79e3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:13.879517 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446ba06-a6c8-469e-9430-67a9b10e79e3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:13.879706 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446ba06-a6c8-469e-9430-67a9b10e79e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:13.897163 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8446ba06-a6c8-469e-9430-67a9b10e79e3 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:13.898359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8446ba06-a6c8-469e-9430-67a9b10e79e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:13.969328 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 494/962] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:13.992633 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751def17-8193-4151-b3d6-aeeaa0553fdb None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:14.048460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:14.103472 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751def17-8193-4151-b3d6-aeeaa0553fdb None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:14.143766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b341f6-6c3b-491d-aea8-2d24871be65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:14.144642 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b341f6-6c3b-491d-aea8-2d24871be65f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:14.144926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b341f6-6c3b-491d-aea8-2d24871be65f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:14.145201 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b341f6-6c3b-491d-aea8-2d24871be65f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:14.158898 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b341f6-6c3b-491d-aea8-2d24871be65f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:54:14.167441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-56b341f6-6c3b-491d-aea8-2d24871be65f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:54:14.167441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:14.167441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:14.167441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:14.167441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:14.167441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:14.167441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:14.167441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:14.167441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:14.167441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:14.167441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:14.167441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:14.167441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:54:14.167441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:54:14.167441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:54:14.167441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:54:14.168506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:54:14.168506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:54:14.168506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:54:14.168506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:54:14.168506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:14.168506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:14.168506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:14.168506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:14.168506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:14.168506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:14.168506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:14.168506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:14.168506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:14.168506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:14.168506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:14.168506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:14.170483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:14.170483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:14.170483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:14.170483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:14.170483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:54:14.170483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:54:14.170483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:54:14.170483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:54:14.170483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:54:14.170483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:54:14.170483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:54:14.170483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:14.170483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 469/963] 10.222.0.41 () {56 vars in 1120 bytes} [Mon May 30 11:54:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:14.175849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446ba06-a6c8-469e-9430-67a9b10e79e3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:14.280243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446ba06-a6c8-469e-9430-67a9b10e79e3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:14.301580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:14.316892 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f821a-40e4-47d7-814b-9bbe21597a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:14.317565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f821a-40e4-47d7-814b-9bbe21597a1e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:14.317875 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f821a-40e4-47d7-814b-9bbe21597a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:14.318163 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f821a-40e4-47d7-814b-9bbe21597a1e None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:14.318916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f821a-40e4-47d7-814b-9bbe21597a1e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:14.319223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f821a-40e4-47d7-814b-9bbe21597a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:14.320625 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f821a-40e4-47d7-814b-9bbe21597a1e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:14.329642 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 495/964] 10.222.0.41 () {56 vars in 1115 bytes} [Mon May 30 11:54:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:14.335144 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b341f6-6c3b-491d-aea8-2d24871be65f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:14.437905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b341f6-6c3b-491d-aea8-2d24871be65f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:14.447002 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:14.475455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7d07a-76a3-4ddb-81a5-f874f70aedca None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:14.475770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7d07a-76a3-4ddb-81a5-f874f70aedca None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:14.476054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7d07a-76a3-4ddb-81a5-f874f70aedca None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:14.477541 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 496/965] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:14.478029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a562e-c469-40a9-a499-6e5685470a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:14.478824 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a562e-c469-40a9-a499-6e5685470a82 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:14.479196 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a562e-c469-40a9-a499-6e5685470a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:14.479560 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a562e-c469-40a9-a499-6e5685470a82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:14.483887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ab608-42e3-4f97-b7b8-09ec0025754c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:14.484423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ab608-42e3-4f97-b7b8-09ec0025754c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:14.484907 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ab608-42e3-4f97-b7b8-09ec0025754c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:14.492426 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a562e-c469-40a9-a499-6e5685470a82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:14.493910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a562e-c469-40a9-a499-6e5685470a82 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:14.503547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b86ab608-42e3-4f97-b7b8-09ec0025754c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:14.505324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b86ab608-42e3-4f97-b7b8-09ec0025754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:14.513967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-062a562e-c469-40a9-a499-6e5685470a82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:14.513967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:14.513967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:14.513967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:14.513967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:14.513967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:14.513967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:14.513967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:14.513967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:14.513967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:14.513967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:14.513967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:14.513967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:54:14.513967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:54:14.513967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:54:14.514862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:54:14.514862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:14.514862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:14.514862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:14.514862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:14.514862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:14.514862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:14.514862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:14.514862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:14.514862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:14.514862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:14.514862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:14.514862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:14.514862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:14.514862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:14.514862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:14.514862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:14.515738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:54:14.515738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:54:14.515738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:14.515738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:14.515738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 470/966] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:14.517402 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8840ca2-0ea1-4bc1-8bd6-88a10387b7e1 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:14.517970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8840ca2-0ea1-4bc1-8bd6-88a10387b7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:14.518450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8840ca2-0ea1-4bc1-8bd6-88a10387b7e1 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:14.520236 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 471/967] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:14.523864 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8840ca2-0ea1-4bc1-8bd6-88a10387b7e1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:14.580380 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 497/968] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:54:14.582004 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9682602-edd5-446c-b772-d8e19441337c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:14.582297 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9682602-edd5-446c-b772-d8e19441337c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:14.582579 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9682602-edd5-446c-b772-d8e19441337c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:14.607641 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e9682602-edd5-446c-b772-d8e19441337c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:14.609386 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e9682602-edd5-446c-b772-d8e19441337c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:14.635978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8840ca2-0ea1-4bc1-8bd6-88a10387b7e1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:14.671127 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2d043-a042-4ced-b046-612f3ff2eee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:14.671804 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2d043-a042-4ced-b046-612f3ff2eee3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:14.672117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2d043-a042-4ced-b046-612f3ff2eee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:14.672401 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2d043-a042-4ced-b046-612f3ff2eee3 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:14.673133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2d043-a042-4ced-b046-612f3ff2eee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:14.673476 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2d043-a042-4ced-b046-612f3ff2eee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:14.674857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2d043-a042-4ced-b046-612f3ff2eee3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:14.686908 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 472/969] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:14.687699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2d043-a042-4ced-b046-612f3ff2eee3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:14.703853 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 498/970] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:14.703853 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9682602-edd5-446c-b772-d8e19441337c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:14.720570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:14.743025 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:14.809309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2d043-a042-4ced-b046-612f3ff2eee3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:14.815705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9682602-edd5-446c-b772-d8e19441337c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:14.845364 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da849753-669f-40a4-84f7-8ab65d20532c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:14.846020 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da849753-669f-40a4-84f7-8ab65d20532c None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:14.846310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da849753-669f-40a4-84f7-8ab65d20532c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:14.846599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da849753-669f-40a4-84f7-8ab65d20532c None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:14.847307 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da849753-669f-40a4-84f7-8ab65d20532c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:14.848832 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da849753-669f-40a4-84f7-8ab65d20532c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:14.852576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae44dd-da2b-407f-a590-0a3ed56b9493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:14.853434 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae44dd-da2b-407f-a590-0a3ed56b9493 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:14.853718 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae44dd-da2b-407f-a590-0a3ed56b9493 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:14.854038 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae44dd-da2b-407f-a590-0a3ed56b9493 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:14.862822 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae44dd-da2b-407f-a590-0a3ed56b9493 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:14.863218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.sql.core [None req-da849753-669f-40a4-84f7-8ab65d20532c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 30 11:54:14.863218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 30 11:54:14.863218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [parameters: {'user_id': '8651eac830374c9d96c7dd834e175ab1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 30 11:54:14.863218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80189) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 30 11:54:14.864399 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae44dd-da2b-407f-a590-0a3ed56b9493 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:14.871078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-da849753-669f-40a4-84f7-8ab65d20532c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 30 11:54:14.871078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:14.871078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 30 11:54:14.871078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.dialect.do_execute( May 30 11:54:14.871078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 30 11:54:14.871078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 30 11:54:14.871078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 30 11:54:14.871078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application result = self._query(query) May 30 11:54:14.871078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 30 11:54:14.871078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application conn.query(q) May 30 11:54:14.871078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 30 11:54:14.871078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 30 11:54:14.871078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 30 11:54:14.871078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application result.read() May 30 11:54:14.871078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 30 11:54:14.872766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 30 11:54:14.872766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 30 11:54:14.872766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application packet.raise_for_error() May 30 11:54:14.872766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 30 11:54:14.872766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 30 11:54:14.872766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 30 11:54:14.872766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 30 11:54:14.872766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 30 11:54:14.872766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:14.872766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 30 11:54:14.872766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:14.872766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:14.872766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 30 11:54:14.872766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 30 11:54:14.872766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 30 11:54:14.872766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 30 11:54:14.872766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 30 11:54:14.872766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application next(self.gen) May 30 11:54:14.873715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 30 11:54:14.873715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application yield resource May 30 11:54:14.873715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 30 11:54:14.873715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application next(self.gen) May 30 11:54:14.873715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 30 11:54:14.873715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.session.rollback() May 30 11:54:14.873715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 30 11:54:14.873715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.force_reraise() May 30 11:54:14.873715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 30 11:54:14.873715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise self.value May 30 11:54:14.873715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 30 11:54:14.873715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 30 11:54:14.873715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 30 11:54:14.873715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application session.commit() May 30 11:54:14.873715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 30 11:54:14.873715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 30 11:54:14.873715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 30 11:54:14.874603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._prepare_impl() May 30 11:54:14.874603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 30 11:54:14.874603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.session.flush() May 30 11:54:14.874603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 30 11:54:14.874603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._flush(objects) May 30 11:54:14.874603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 30 11:54:14.874603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 30 11:54:14.874603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 30 11:54:14.874603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application compat.raise_( May 30 11:54:14.874603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 30 11:54:14.874603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception May 30 11:54:14.874603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 30 11:54:14.874603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application flush_context.execute() May 30 11:54:14.874603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 30 11:54:14.874603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rec.execute(self) May 30 11:54:14.874603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 30 11:54:14.874603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 30 11:54:14.875477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 30 11:54:14.875477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application _emit_insert_statements( May 30 11:54:14.875477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 30 11:54:14.875477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application result = connection._execute_20( May 30 11:54:14.875477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 30 11:54:14.875477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 30 11:54:14.875477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 30 11:54:14.875477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 30 11:54:14.875477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 30 11:54:14.875477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ret = self._execute_context( May 30 11:54:14.875477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 30 11:54:14.875477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 30 11:54:14.875477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 30 11:54:14.875477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 30 11:54:14.875477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 30 11:54:14.875477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception May 30 11:54:14.877895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 30 11:54:14.877895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.dialect.do_execute( May 30 11:54:14.877895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 30 11:54:14.877895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 30 11:54:14.877895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 30 11:54:14.877895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application result = self._query(query) May 30 11:54:14.877895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 30 11:54:14.877895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application conn.query(q) May 30 11:54:14.877895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 30 11:54:14.877895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 30 11:54:14.877895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 30 11:54:14.877895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application result.read() May 30 11:54:14.877895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 30 11:54:14.877895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 30 11:54:14.877895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 30 11:54:14.877895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application packet.raise_for_error() May 30 11:54:14.879136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 30 11:54:14.879136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 30 11:54:14.879136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 30 11:54:14.879136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 30 11:54:14.879136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 30 11:54:14.879136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 30 11:54:14.879136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [parameters: {'user_id': '8651eac830374c9d96c7dd834e175ab1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 30 11:54:14.879136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 30 11:54:14.879136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:14.879136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:54:14.879136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:14.879136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:14.879136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:14.879136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:14.879136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:14.880175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:14.880175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:14.880175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:14.880175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:14.880175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:14.880175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:14.880175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:14.880175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 30 11:54:14.880175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 30 11:54:14.880175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:14.880175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:14.880175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:54:14.880175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:54:14.880175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:54:14.880175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:54:14.880175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 30 11:54:14.880175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 30 11:54:14.881287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 30 11:54:14.881287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 30 11:54:14.881287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 30 11:54:14.881287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 30 11:54:14.881287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 30 11:54:14.881287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:14.881287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 473/971] 10.222.0.41 () {60 vars in 1131 bytes} [Mon May 30 11:54:14 2022] POST /identity/v3/users => generated 160 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:14.881287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da849753-669f-40a4-84f7-8ab65d20532c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:14.892086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-67ae44dd-da2b-407f-a590-0a3ed56b9493 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:54:14.892086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:14.892086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:14.892086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:14.892086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:14.892086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:14.892086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:14.892086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:14.892086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:14.892086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:14.892086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:14.892086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:14.892086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:54:14.892086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:54:14.892086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:54:14.892086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:54:14.893689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:14.893689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:14.893689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:54:14.893689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:54:14.893689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:54:14.893689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:54:14.893689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:14.893689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:14.893689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:14.893689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:14.893689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:14.893689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:14.893689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:14.893689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:14.893689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:14.893689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:14.893689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:14.893689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:14.894878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:14.894878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:14.894878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:54:14.894878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:54:14.894878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:54:14.894878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:54:14.894878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:54:14.894878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:54:14.894878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:54:14.894878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:14.898604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 499/972] 10.222.0.41 () {56 vars in 1117 bytes} [Mon May 30 11:54:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:14.899562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae44dd-da2b-407f-a590-0a3ed56b9493 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:14.974622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:14.998124 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da849753-669f-40a4-84f7-8ab65d20532c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:15.011131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:15.016668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae44dd-da2b-407f-a590-0a3ed56b9493 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:15.036716 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad61326-449f-46ae-9e00-3529770d69c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:15.037519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad61326-449f-46ae-9e00-3529770d69c2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:15.037802 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad61326-449f-46ae-9e00-3529770d69c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:15.038078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad61326-449f-46ae-9e00-3529770d69c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:15.038732 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad61326-449f-46ae-9e00-3529770d69c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:15.040341 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad61326-449f-46ae-9e00-3529770d69c2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:15.052551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-dad61326-449f-46ae-9e00-3529770d69c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:54:15.052551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:15.052551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:54:15.052551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:54:15.052551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:54:15.052551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:54:15.052551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:54:15.052551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:15.052551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:54:15.052551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:15.052551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:54:15.052551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:15.052551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:15.052551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:15.052551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:15.052551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:15.052551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:15.053558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:15.053558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:15.053558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:15.053558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:15.053558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:15.053558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:15.053558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:54:15.053558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:54:15.053558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:54:15.053558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:54:15.053558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:15.053558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:15.053558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:15.053558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:15.053558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:15.053558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:15.054409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:15.054409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:15.054409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:15.054409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:15.054409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:15.054409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:15.054409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:15.054409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:15.054409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:15.054409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:15.054409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:54:15.054409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:15.054409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:54:15.054409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:15.054409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 474/973] 10.222.0.41 () {56 vars in 1126 bytes} [Mon May 30 11:54:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:15.055209 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad61326-449f-46ae-9e00-3529770d69c2 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:15.061961 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb074a-4128-48e5-84fb-a58f39755c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:15.063863 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb074a-4128-48e5-84fb-a58f39755c2d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:15.064340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb074a-4128-48e5-84fb-a58f39755c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:15.064804 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb074a-4128-48e5-84fb-a58f39755c2d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:15.074082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb074a-4128-48e5-84fb-a58f39755c2d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:15.076838 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb074a-4128-48e5-84fb-a58f39755c2d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:15.097684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f6bb074a-4128-48e5-84fb-a58f39755c2d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 30 11:54:15.097684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:15.097684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:15.097684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:15.097684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:15.097684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:15.097684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:15.097684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:15.097684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:15.097684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:15.097684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:15.097684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:15.097684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:54:15.097684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:54:15.097684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:54:15.097684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:54:15.098702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:15.098702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:15.098702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:54:15.098702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:54:15.098702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:54:15.098702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:54:15.098702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:15.098702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:15.098702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:15.098702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:15.098702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:15.098702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:15.098702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:15.098702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:15.098702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:15.098702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:15.098702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:15.098702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:15.099644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:15.099644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:15.099644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:54:15.099644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:54:15.099644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:54:15.099644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:54:15.099644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:54:15.099644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:54:15.099644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 30 11:54:15.099644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:15.106259 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 500/974] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:54:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:15.106259 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb074a-4128-48e5-84fb-a58f39755c2d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:15.170118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad61326-449f-46ae-9e00-3529770d69c2 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:15.206293 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2baf316-86d1-4e13-b7e9-d7b5bca8ef69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:15.206967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baf316-86d1-4e13-b7e9-d7b5bca8ef69 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:15.207249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baf316-86d1-4e13-b7e9-d7b5bca8ef69 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:15.207523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baf316-86d1-4e13-b7e9-d7b5bca8ef69 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:15.207711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb074a-4128-48e5-84fb-a58f39755c2d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:15.208387 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2baf316-86d1-4e13-b7e9-d7b5bca8ef69 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:15.208698 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2baf316-86d1-4e13-b7e9-d7b5bca8ef69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:15.210692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2baf316-86d1-4e13-b7e9-d7b5bca8ef69 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:15.233543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 475/975] 10.222.0.41 () {56 vars in 1149 bytes} [Mon May 30 11:54:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:15.234382 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2baf316-86d1-4e13-b7e9-d7b5bca8ef69 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:15.238660 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:15.249699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d766ff-cee9-4191-be2d-e222eef661c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:15.250374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d766ff-cee9-4191-be2d-e222eef661c7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:15.250660 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d766ff-cee9-4191-be2d-e222eef661c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:15.250942 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d766ff-cee9-4191-be2d-e222eef661c7 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:15.251657 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d766ff-cee9-4191-be2d-e222eef661c7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:15.251998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d766ff-cee9-4191-be2d-e222eef661c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:15.253365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d766ff-cee9-4191-be2d-e222eef661c7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:15.258123 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 501/976] 10.222.0.41 () {56 vars in 1122 bytes} [Mon May 30 11:54:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:15.263580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d766ff-cee9-4191-be2d-e222eef661c7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:15.289788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:15.345063 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2baf316-86d1-4e13-b7e9-d7b5bca8ef69 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:15.371285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d766ff-cee9-4191-be2d-e222eef661c7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:15.379129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca18b5-cea5-436c-a72a-e77df06a5219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:15.379802 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca18b5-cea5-436c-a72a-e77df06a5219 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:15.380122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca18b5-cea5-436c-a72a-e77df06a5219 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:15.380408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca18b5-cea5-436c-a72a-e77df06a5219 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:15.381213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca18b5-cea5-436c-a72a-e77df06a5219 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:15.381528 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca18b5-cea5-436c-a72a-e77df06a5219 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:15.382960 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca18b5-cea5-436c-a72a-e77df06a5219 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:15.404627 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a668391-2984-4d17-9a7f-abbac8320d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:15.405269 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a668391-2984-4d17-9a7f-abbac8320d16 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:15.405556 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a668391-2984-4d17-9a7f-abbac8320d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:15.405835 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a668391-2984-4d17-9a7f-abbac8320d16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:15.417397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 476/977] 10.222.0.41 () {56 vars in 1101 bytes} [Mon May 30 11:54:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:15.418219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca18b5-cea5-436c-a72a-e77df06a5219 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:15.483041 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a668391-2984-4d17-9a7f-abbac8320d16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:15.484571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a668391-2984-4d17-9a7f-abbac8320d16 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:15.499251 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:15.511221 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:15.545607 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca18b5-cea5-436c-a72a-e77df06a5219 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:15.584003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618e8a9-6afa-46a8-a2b6-026ce2c5a66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:15.584694 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618e8a9-6afa-46a8-a2b6-026ce2c5a66b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:15.584970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618e8a9-6afa-46a8-a2b6-026ce2c5a66b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:15.585249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618e8a9-6afa-46a8-a2b6-026ce2c5a66b None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:15.586081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618e8a9-6afa-46a8-a2b6-026ce2c5a66b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:15.586392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618e8a9-6afa-46a8-a2b6-026ce2c5a66b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:15.587974 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618e8a9-6afa-46a8-a2b6-026ce2c5a66b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:15.598788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 477/978] 10.222.0.41 () {56 vars in 1122 bytes} [Mon May 30 11:54:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:15.598788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ade958-d91d-4207-b46f-cb80670d8a7d None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:15.598788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ade958-d91d-4207-b46f-cb80670d8a7d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:15.598788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ade958-d91d-4207-b46f-cb80670d8a7d None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:15.600806 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 502/979] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:54:15 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:54:15.601688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a668391-2984-4d17-9a7f-abbac8320d16 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:15.602270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 478/980] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:15.602964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ade958-d91d-4207-b46f-cb80670d8a7d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:15.719070 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a668391-2984-4d17-9a7f-abbac8320d16 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:15.724845 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ade958-d91d-4207-b46f-cb80670d8a7d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:15.741788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:15.752363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:15.755618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd20a2-4adc-4bbf-a05a-7733a036ecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:15.756590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd20a2-4adc-4bbf-a05a-7733a036ecd3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:15.756974 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd20a2-4adc-4bbf-a05a-7733a036ecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:15.757408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd20a2-4adc-4bbf-a05a-7733a036ecd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:15.758821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd20a2-4adc-4bbf-a05a-7733a036ecd3 None admin] RBAC: Adding query filter params (interface=admin, service_id=73f9c696731245d2824dec7123a11e89, region_id=RegionOne) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:15.759354 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd20a2-4adc-4bbf-a05a-7733a036ecd3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:15.761817 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd20a2-4adc-4bbf-a05a-7733a036ecd3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:15.767173 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe65102-bcd9-4e00-941e-2881722e8dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:15.767173 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe65102-bcd9-4e00-941e-2881722e8dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:15.767173 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe65102-bcd9-4e00-941e-2881722e8dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:15.767173 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe65102-bcd9-4e00-941e-2881722e8dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:15.770725 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 503/981] 10.222.0.41 () {56 vars in 1249 bytes} [Mon May 30 11:54:15 2022] GET /identity/v3/endpoints?service_id=73f9c696731245d2824dec7123a11e89&interface=admin®ion_id=RegionOne => generated 193 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:15.772787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681a510-3738-43e2-be1f-8915bac1a9b3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:15.773299 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681a510-3738-43e2-be1f-8915bac1a9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:15.773787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681a510-3738-43e2-be1f-8915bac1a9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:15.781344 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe65102-bcd9-4e00-941e-2881722e8dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:15.782830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe65102-bcd9-4e00-941e-2881722e8dc3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:15.791422 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2681a510-3738-43e2-be1f-8915bac1a9b3 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:15.792640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2681a510-3738-43e2-be1f-8915bac1a9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:15.800800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-ffe65102-bcd9-4e00-941e-2881722e8dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:15.800800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:15.800800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:15.800800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:15.800800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:15.800800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:15.800800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:15.800800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:15.800800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:15.800800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:15.800800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:15.800800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:15.800800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:54:15.800800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:54:15.800800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:54:15.801702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:54:15.801702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:15.801702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:15.801702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:15.801702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:15.801702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:15.801702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:15.801702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:15.801702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:15.801702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:15.801702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:15.801702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:15.801702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:15.801702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:15.801702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:15.801702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:15.801702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:15.802627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:54:15.802627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:54:15.802627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:15.802627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:15.802627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 479/982] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:15.802930 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe65102-bcd9-4e00-941e-2881722e8dc3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:15.864396 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 504/983] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:15.865237 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681a510-3738-43e2-be1f-8915bac1a9b3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:15.923084 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe65102-bcd9-4e00-941e-2881722e8dc3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:15.956676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd114103-5169-402f-b3dd-649c2939223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:15.957330 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd114103-5169-402f-b3dd-649c2939223c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:15.957612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd114103-5169-402f-b3dd-649c2939223c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:15.957885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd114103-5169-402f-b3dd-649c2939223c None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:15.958559 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd114103-5169-402f-b3dd-649c2939223c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:15.959959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd114103-5169-402f-b3dd-649c2939223c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:15.964473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681a510-3738-43e2-be1f-8915bac1a9b3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:15.980163 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 480/984] 10.222.0.41 () {56 vars in 1087 bytes} [Mon May 30 11:54:15 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 11:54:15.980163 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd114103-5169-402f-b3dd-649c2939223c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:15.985580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:16.009328 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd567b-1dba-4591-a078-e6ec0385fa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:16.010024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd567b-1dba-4591-a078-e6ec0385fa44 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:16.010313 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd567b-1dba-4591-a078-e6ec0385fa44 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:16.010596 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd567b-1dba-4591-a078-e6ec0385fa44 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:16.011385 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd567b-1dba-4591-a078-e6ec0385fa44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:16.011705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd567b-1dba-4591-a078-e6ec0385fa44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:16.013827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd567b-1dba-4591-a078-e6ec0385fa44 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:16.018410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:16.027931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 505/985] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:16.033808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd567b-1dba-4591-a078-e6ec0385fa44 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:16.089779 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd114103-5169-402f-b3dd-649c2939223c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:16.130701 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbc2b6-39ca-46f6-8144-2c03851dc591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:16.131377 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbc2b6-39ca-46f6-8144-2c03851dc591 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:16.131690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbc2b6-39ca-46f6-8144-2c03851dc591 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:16.131963 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbc2b6-39ca-46f6-8144-2c03851dc591 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:16.132747 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbc2b6-39ca-46f6-8144-2c03851dc591 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:16.134142 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbc2b6-39ca-46f6-8144-2c03851dc591 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:16.149448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd567b-1dba-4591-a078-e6ec0385fa44 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:16.149807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 481/986] 10.222.0.41 () {60 vars in 1141 bytes} [Mon May 30 11:54:15 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:54:16.208827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a9f15-dbb1-4718-9071-6ce486031edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:16.209638 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a9f15-dbb1-4718-9071-6ce486031edc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:16.209928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a9f15-dbb1-4718-9071-6ce486031edc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:16.210210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a9f15-dbb1-4718-9071-6ce486031edc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:16.219111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a9f15-dbb1-4718-9071-6ce486031edc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:16.220641 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a9f15-dbb1-4718-9071-6ce486031edc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:16.237937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-527a9f15-dbb1-4718-9071-6ce486031edc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:54:16.237937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:16.237937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:16.237937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:16.237937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:16.237937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:16.237937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:16.237937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:16.237937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:16.237937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:16.237937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:16.237937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:16.237937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:54:16.237937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:54:16.237937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:54:16.238946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:54:16.238946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:16.238946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:16.238946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:16.238946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:16.238946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:16.238946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:16.238946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:16.238946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:16.238946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:16.238946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:16.238946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:16.238946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:16.238946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:16.238946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:16.238946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:16.238946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:16.239860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:54:16.239860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:54:16.239860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:54:16.239860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:54:16.239860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:54:16.239860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:54:16.239860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:54:16.239860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:16.239860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 506/987] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:54:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:16.245538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbc2b6-39ca-46f6-8144-2c03851dc591 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:16.359023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbc2b6-39ca-46f6-8144-2c03851dc591 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:16.360796 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:16.400286 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53951237-c6fb-4248-bec3-86c0ac780f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:16.400958 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53951237-c6fb-4248-bec3-86c0ac780f84 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:16.401247 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53951237-c6fb-4248-bec3-86c0ac780f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:16.401541 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53951237-c6fb-4248-bec3-86c0ac780f84 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:16.402338 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53951237-c6fb-4248-bec3-86c0ac780f84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:16.402657 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53951237-c6fb-4248-bec3-86c0ac780f84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:16.404291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53951237-c6fb-4248-bec3-86c0ac780f84 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:16.416892 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 482/988] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:54:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:16.423440 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a9f15-dbb1-4718-9071-6ce486031edc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:16.456186 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:16.529970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a9f15-dbb1-4718-9071-6ce486031edc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:16.564848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ddda0d-2ecc-4991-bc80-af85c63c33d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:16.565648 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddda0d-2ecc-4991-bc80-af85c63c33d0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:16.566030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddda0d-2ecc-4991-bc80-af85c63c33d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:16.566403 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddda0d-2ecc-4991-bc80-af85c63c33d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:16.567334 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ddda0d-2ecc-4991-bc80-af85c63c33d0 None admin] RBAC: Adding query filter params (role.id=f22986e64f7e44279ed898fdf581a644, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=a63dd78421064bbe838b1ed0261c13bb) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:16.567745 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ddda0d-2ecc-4991-bc80-af85c63c33d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:16.569975 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ddda0d-2ecc-4991-bc80-af85c63c33d0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:16.583879 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 507/989] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:54:16 2022] GET /identity/v3/role_assignments?user.id=a63dd78421064bbe838b1ed0261c13bb&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=f22986e64f7e44279ed898fdf581a644 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:18.267299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8d92a-a5aa-4eb1-ac79-569cfa8ba20f None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:18.267844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8d92a-a5aa-4eb1-ac79-569cfa8ba20f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:18.268039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8d92a-a5aa-4eb1-ac79-569cfa8ba20f None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:18.269285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 483/990] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:18.274605 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f11ec-46c9-4adb-8b66-c40b422edc7f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:18.275005 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f11ec-46c9-4adb-8b66-c40b422edc7f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:18.275171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f11ec-46c9-4adb-8b66-c40b422edc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:18.292025 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-dc1f11ec-46c9-4adb-8b66-c40b422edc7f None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:18.293230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dc1f11ec-46c9-4adb-8b66-c40b422edc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:18.361564 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 508/991] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:18.384697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8d92a-a5aa-4eb1-ac79-569cfa8ba20f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:18.440453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a47ea-7545-4a05-a85e-a00f016f2f5f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:18.440847 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a47ea-7545-4a05-a85e-a00f016f2f5f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:18.441038 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a47ea-7545-4a05-a85e-a00f016f2f5f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:18.442402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 509/992] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:54:18.447227 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d542b35-36a4-488e-9c4e-90d10687cbc1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:18.447520 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d542b35-36a4-488e-9c4e-90d10687cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:18.447839 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d542b35-36a4-488e-9c4e-90d10687cbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:18.465840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2d542b35-36a4-488e-9c4e-90d10687cbc1 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:18.467408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2d542b35-36a4-488e-9c4e-90d10687cbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:18.488991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:18.494488 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8d92a-a5aa-4eb1-ac79-569cfa8ba20f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:18.533343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb01ad2-c3e9-4807-a999-2b98d1576b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:18.534082 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb01ad2-c3e9-4807-a999-2b98d1576b01 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:18.534368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb01ad2-c3e9-4807-a999-2b98d1576b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:18.534655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb01ad2-c3e9-4807-a999-2b98d1576b01 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:18.535331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb01ad2-c3e9-4807-a999-2b98d1576b01 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:18.536826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb01ad2-c3e9-4807-a999-2b98d1576b01 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:18.548213 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 510/993] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:54:18.550613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-5fb01ad2-c3e9-4807-a999-2b98d1576b01 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:54:18.550613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:18.550613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:54:18.550613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:54:18.550613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:54:18.550613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:54:18.550613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:54:18.550613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:18.550613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:54:18.550613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:18.550613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:54:18.550613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:18.550613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:18.550613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:18.550613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:18.550613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:18.550613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:18.551545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:18.551545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:18.551545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:18.551545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:18.551545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:18.551545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:18.551545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:54:18.551545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:54:18.551545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:54:18.551545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:54:18.551545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:18.551545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:18.551545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:18.551545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:18.551545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:18.551545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:18.552428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:18.552428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:18.552428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:18.552428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:18.552428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:18.552428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:18.552428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:18.552428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:18.552428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:18.552428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:18.552428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:54:18.552428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:18.552428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:54:18.552428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:18.556133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 484/994] 10.222.0.41 () {56 vars in 1126 bytes} [Mon May 30 11:54:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:18.557868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d542b35-36a4-488e-9c4e-90d10687cbc1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:18.566011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb01ad2-c3e9-4807-a999-2b98d1576b01 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:18.596657 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:18.666409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d542b35-36a4-488e-9c4e-90d10687cbc1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:18.677870 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb01ad2-c3e9-4807-a999-2b98d1576b01 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:18.699570 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e440b13-5c18-4921-9422-58422a93adf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:18.700963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e440b13-5c18-4921-9422-58422a93adf3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:18.701258 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e440b13-5c18-4921-9422-58422a93adf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:18.701532 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e440b13-5c18-4921-9422-58422a93adf3 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:18.702243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e440b13-5c18-4921-9422-58422a93adf3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:18.702552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e440b13-5c18-4921-9422-58422a93adf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:18.703944 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e440b13-5c18-4921-9422-58422a93adf3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:18.708729 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 511/995] 10.222.0.41 () {56 vars in 1122 bytes} [Mon May 30 11:54:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:18.714267 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e440b13-5c18-4921-9422-58422a93adf3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:18.721060 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3850c-9cb0-4e0c-91fa-9517c3021ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:18.721859 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3850c-9cb0-4e0c-91fa-9517c3021ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:18.722138 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3850c-9cb0-4e0c-91fa-9517c3021ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:18.722408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3850c-9cb0-4e0c-91fa-9517c3021ef1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:18.723054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3850c-9cb0-4e0c-91fa-9517c3021ef1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:18.724716 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3850c-9cb0-4e0c-91fa-9517c3021ef1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:18.736562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-bdc3850c-9cb0-4e0c-91fa-9517c3021ef1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 30 11:54:18.736562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:18.736562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:54:18.736562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:54:18.736562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:54:18.736562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:54:18.736562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:54:18.736562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:18.736562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 30 11:54:18.736562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:18.736562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:54:18.736562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:18.736562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:18.736562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:18.736562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:18.736562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:18.736562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:18.737553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:18.737553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:18.737553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:18.737553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:18.737553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:18.737553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:18.737553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:54:18.737553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:54:18.737553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:54:18.737553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:54:18.737553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:18.737553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:18.737553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:18.737553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:18.737553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:18.737553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:18.738410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:18.738410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:18.738410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:18.738410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:18.738410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:18.738410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:18.738410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:18.738410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:18.738410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:18.738410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:18.738410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:54:18.738410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:18.738410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 30 11:54:18.738410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:18.738410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 485/996] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:54:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:18.740143 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:18.743686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3850c-9cb0-4e0c-91fa-9517c3021ef1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:18.837520 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e440b13-5c18-4921-9422-58422a93adf3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:18.843552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:18.853770 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3850c-9cb0-4e0c-91fa-9517c3021ef1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:18.877363 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57acdcf-d209-4956-8514-f5720d58258b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:18.878037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57acdcf-d209-4956-8514-f5720d58258b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:18.878319 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57acdcf-d209-4956-8514-f5720d58258b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:18.878607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57acdcf-d209-4956-8514-f5720d58258b None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:18.879313 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57acdcf-d209-4956-8514-f5720d58258b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:18.879624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57acdcf-d209-4956-8514-f5720d58258b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:18.881025 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57acdcf-d209-4956-8514-f5720d58258b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:18.890504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 512/997] 10.222.0.41 () {56 vars in 1122 bytes} [Mon May 30 11:54:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:18.890504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719bcd5-c30f-40d5-8941-c30e76cb18d9 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:18.890504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719bcd5-c30f-40d5-8941-c30e76cb18d9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:18.890504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719bcd5-c30f-40d5-8941-c30e76cb18d9 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:18.890854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e854b2-3931-45bb-ad63-e448f71e41ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:18.890948 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 513/998] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:18.891027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e854b2-3931-45bb-ad63-e448f71e41ec None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:18.891027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e854b2-3931-45bb-ad63-e448f71e41ec None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:18.891027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e854b2-3931-45bb-ad63-e448f71e41ec None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:18.891027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e854b2-3931-45bb-ad63-e448f71e41ec None admin] RBAC: Adding query filter params (name=compute) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:18.891282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e854b2-3931-45bb-ad63-e448f71e41ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:18.891595 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719bcd5-c30f-40d5-8941-c30e76cb18d9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:18.892657 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e854b2-3931-45bb-ad63-e448f71e41ec None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:18.897774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 486/999] 10.222.0.41 () {56 vars in 1112 bytes} [Mon May 30 11:54:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:18.898854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc553e-b3e0-414f-81ea-ed44a869ec92 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:18.899148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc553e-b3e0-414f-81ea-ed44a869ec92 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:18.899432 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc553e-b3e0-414f-81ea-ed44a869ec92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:18.915669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5adc553e-b3e0-414f-81ea-ed44a869ec92 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:18.917230 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5adc553e-b3e0-414f-81ea-ed44a869ec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:18.977531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:18.985026 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 487/1000] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:18.985848 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc553e-b3e0-414f-81ea-ed44a869ec92 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:18.998297 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719bcd5-c30f-40d5-8941-c30e76cb18d9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:19.032500 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662592b0-5164-4f58-bebc-6f2f79a7f219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:19.033158 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662592b0-5164-4f58-bebc-6f2f79a7f219 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:19.033446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662592b0-5164-4f58-bebc-6f2f79a7f219 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:19.033724 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662592b0-5164-4f58-bebc-6f2f79a7f219 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:19.034465 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662592b0-5164-4f58-bebc-6f2f79a7f219 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:19.035842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662592b0-5164-4f58-bebc-6f2f79a7f219 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:19.051669 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 514/1001] 10.222.0.41 () {60 vars in 1144 bytes} [Mon May 30 11:54:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:54:19.052495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662592b0-5164-4f58-bebc-6f2f79a7f219 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:19.076419 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:19.095685 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc553e-b3e0-414f-81ea-ed44a869ec92 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:19.144441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51573f5c-0166-472e-ad7a-dfcae09352c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:19.145128 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51573f5c-0166-472e-ad7a-dfcae09352c8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:19.145465 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51573f5c-0166-472e-ad7a-dfcae09352c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:19.145750 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51573f5c-0166-472e-ad7a-dfcae09352c8 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:19.146492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51573f5c-0166-472e-ad7a-dfcae09352c8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:19.146802 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51573f5c-0166-472e-ad7a-dfcae09352c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:19.148242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51573f5c-0166-472e-ad7a-dfcae09352c8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:19.158969 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 488/1002] 10.222.0.41 () {56 vars in 1112 bytes} [Mon May 30 11:54:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:19.160244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51573f5c-0166-472e-ad7a-dfcae09352c8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:19.187580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662592b0-5164-4f58-bebc-6f2f79a7f219 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:19.225010 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b4ff5-b748-491f-a348-41a1ab8c1be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:19.225827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b4ff5-b748-491f-a348-41a1ab8c1be0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:19.226110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b4ff5-b748-491f-a348-41a1ab8c1be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:19.226386 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b4ff5-b748-491f-a348-41a1ab8c1be0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:19.227057 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b4ff5-b748-491f-a348-41a1ab8c1be0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:19.228487 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b4ff5-b748-491f-a348-41a1ab8c1be0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:19.240797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-313b4ff5-b748-491f-a348-41a1ab8c1be0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 30 11:54:19.240797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:19.240797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:54:19.240797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:54:19.240797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:54:19.240797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:54:19.240797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:54:19.240797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:19.240797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 30 11:54:19.240797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:19.240797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:54:19.240797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:19.240797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:19.240797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:19.240797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:19.240797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:19.240797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:19.241934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:19.241934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:19.241934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:19.241934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:19.241934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:19.241934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:19.241934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:54:19.241934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:54:19.241934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:54:19.241934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:54:19.241934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:19.241934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:19.241934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:19.241934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:19.241934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:19.241934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:19.242781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:19.242781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:19.242781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:19.242781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:19.242781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:19.242781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:19.242781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:19.242781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:19.242781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:19.242781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:19.242781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:54:19.242781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:19.242781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 30 11:54:19.242781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:19.242781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 515/1003] 10.222.0.41 () {56 vars in 1105 bytes} [Mon May 30 11:54:19 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:19.251122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b4ff5-b748-491f-a348-41a1ab8c1be0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:19.264490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:19.279320 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51573f5c-0166-472e-ad7a-dfcae09352c8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:19.317029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbff2c7-9434-4a06-a75d-edace647ee40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:19.317696 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbff2c7-9434-4a06-a75d-edace647ee40 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:19.317987 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbff2c7-9434-4a06-a75d-edace647ee40 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:19.318344 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbff2c7-9434-4a06-a75d-edace647ee40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:19.319144 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbff2c7-9434-4a06-a75d-edace647ee40 None admin] RBAC: Adding query filter params (interface=public, service_id=2d14a11e4e5a4c64a134fde9986600ed, region_id=RegionOne) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:19.319461 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbff2c7-9434-4a06-a75d-edace647ee40 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:19.320906 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbff2c7-9434-4a06-a75d-edace647ee40 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:19.326993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 489/1004] 10.222.0.41 () {56 vars in 1251 bytes} [Mon May 30 11:54:19 2022] GET /identity/v3/endpoints?service_id=2d14a11e4e5a4c64a134fde9986600ed&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:19.332720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbff2c7-9434-4a06-a75d-edace647ee40 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:19.343803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:19.366796 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b4ff5-b748-491f-a348-41a1ab8c1be0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:19.402573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf35d82-a50b-4995-abb6-3751db0b4388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:19.403341 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf35d82-a50b-4995-abb6-3751db0b4388 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:19.403629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf35d82-a50b-4995-abb6-3751db0b4388 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:19.403934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf35d82-a50b-4995-abb6-3751db0b4388 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:19.404655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf35d82-a50b-4995-abb6-3751db0b4388 None admin] RBAC: Adding query filter params (name=image) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:19.404947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf35d82-a50b-4995-abb6-3751db0b4388 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:19.406311 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf35d82-a50b-4995-abb6-3751db0b4388 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:19.415662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 516/1005] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:19.416685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf35d82-a50b-4995-abb6-3751db0b4388 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:19.444991 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbff2c7-9434-4a06-a75d-edace647ee40 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:19.485997 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02eff3-6908-4653-ade4-7412598ced17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:19.486726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02eff3-6908-4653-ade4-7412598ced17 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:19.487050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02eff3-6908-4653-ade4-7412598ced17 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:19.487428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02eff3-6908-4653-ade4-7412598ced17 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:19.488040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02eff3-6908-4653-ade4-7412598ced17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:19.489411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02eff3-6908-4653-ade4-7412598ced17 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:19.493464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:19.504998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 490/1006] 10.222.0.41 () {56 vars in 1087 bytes} [Mon May 30 11:54:19 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 11:54:19.529382 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf35d82-a50b-4995-abb6-3751db0b4388 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:19.569063 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5736b33-69f7-413d-ac48-a7cf12cc1ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:19.569756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5736b33-69f7-413d-ac48-a7cf12cc1ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:19.570042 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5736b33-69f7-413d-ac48-a7cf12cc1ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:19.570323 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5736b33-69f7-413d-ac48-a7cf12cc1ea8 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:19.571054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5736b33-69f7-413d-ac48-a7cf12cc1ea8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:19.571364 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5736b33-69f7-413d-ac48-a7cf12cc1ea8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:19.572790 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5736b33-69f7-413d-ac48-a7cf12cc1ea8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:19.584111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 517/1007] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:21.349029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198d916-1e9d-4383-8b47-40d2c75a5c6e None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:21.349564 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198d916-1e9d-4383-8b47-40d2c75a5c6e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:21.349564 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198d916-1e9d-4383-8b47-40d2c75a5c6e None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:21.351000 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 491/1008] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:21.356893 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb42bb5-dcb1-4ff3-889d-a7573521729a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:21.357283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb42bb5-dcb1-4ff3-889d-a7573521729a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:21.357560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb42bb5-dcb1-4ff3-889d-a7573521729a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:21.374852 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ceb42bb5-dcb1-4ff3-889d-a7573521729a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:21.376077 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ceb42bb5-dcb1-4ff3-889d-a7573521729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:21.450888 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 518/1009] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:21 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:21.475267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198d916-1e9d-4383-8b47-40d2c75a5c6e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:21.553584 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:21.585681 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198d916-1e9d-4383-8b47-40d2c75a5c6e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:21.620048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab55f2b-533d-4499-a898-851dc6a20c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:21.621016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab55f2b-533d-4499-a898-851dc6a20c30 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:21.621301 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab55f2b-533d-4499-a898-851dc6a20c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:21.621577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab55f2b-533d-4499-a898-851dc6a20c30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:21.623485 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab55f2b-533d-4499-a898-851dc6a20c30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:21.624957 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab55f2b-533d-4499-a898-851dc6a20c30 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:21.631297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 492/1010] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:21.632458 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb42bb5-dcb1-4ff3-889d-a7573521729a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:21.698425 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:21.734469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb42bb5-dcb1-4ff3-889d-a7573521729a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:21.768996 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab80065-b6d0-46b2-aa0b-f08b9ee60d7f None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:21.769279 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab80065-b6d0-46b2-aa0b-f08b9ee60d7f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:21.769553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab80065-b6d0-46b2-aa0b-f08b9ee60d7f None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:21.771059 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 493/1011] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:21.775987 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529e813-0b59-4e4d-ad70-2bb53c0b622b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:21.776282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529e813-0b59-4e4d-ad70-2bb53c0b622b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:21.776561 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529e813-0b59-4e4d-ad70-2bb53c0b622b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:21.778068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a418ab4-c369-43dd-95a9-7845a83e4a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:21.778867 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a418ab4-c369-43dd-95a9-7845a83e4a79 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:21.779155 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a418ab4-c369-43dd-95a9-7845a83e4a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:21.779433 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a418ab4-c369-43dd-95a9-7845a83e4a79 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:21.780207 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a418ab4-c369-43dd-95a9-7845a83e4a79 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:21.781645 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a418ab4-c369-43dd-95a9-7845a83e4a79 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:21.794160 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5529e813-0b59-4e4d-ad70-2bb53c0b622b None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:21.795714 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5529e813-0b59-4e4d-ad70-2bb53c0b622b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:21.808704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 519/1012] 10.222.0.41 () {60 vars in 1141 bytes} [Mon May 30 11:54:21 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:54:21.849805 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c10bd-af09-4a2e-a597-2354532a260f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:21.850125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c10bd-af09-4a2e-a597-2354532a260f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:21.850374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c10bd-af09-4a2e-a597-2354532a260f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:21.851846 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 520/1013] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:54:21.857731 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96440bab-390b-408f-874e-2bc58b9bb86c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:21.858045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96440bab-390b-408f-874e-2bc58b9bb86c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:21.858307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96440bab-390b-408f-874e-2bc58b9bb86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:21.876844 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-96440bab-390b-408f-874e-2bc58b9bb86c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:21.877995 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-96440bab-390b-408f-874e-2bc58b9bb86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:21.883888 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 494/1014] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:21 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:54:21.904243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529e813-0b59-4e4d-ad70-2bb53c0b622b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:21.956095 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 521/1015] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:21 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:54:21.980607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96440bab-390b-408f-874e-2bc58b9bb86c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:21.984786 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:22.020391 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529e813-0b59-4e4d-ad70-2bb53c0b622b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:22.033127 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:22.063686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b14d2-78d9-4115-875d-2edb985fc549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:22.064531 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b14d2-78d9-4115-875d-2edb985fc549 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:22.064813 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b14d2-78d9-4115-875d-2edb985fc549 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:22.065090 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b14d2-78d9-4115-875d-2edb985fc549 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:22.065964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b14d2-78d9-4115-875d-2edb985fc549 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:22.067126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b14d2-78d9-4115-875d-2edb985fc549 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:22.079521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-0e0b14d2-78d9-4115-875d-2edb985fc549 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 30 11:54:22.079521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:22.079521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:54:22.079521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:54:22.079521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:54:22.079521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:54:22.079521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:54:22.079521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:22.079521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 30 11:54:22.079521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:22.079521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:54:22.079521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:22.079521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:22.079521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:22.079521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:22.079521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:22.079521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:22.080595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:22.080595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:22.080595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:22.080595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:22.080595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:22.080595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:22.080595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:54:22.080595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:54:22.080595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:54:22.080595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:54:22.080595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:22.080595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:22.080595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:22.080595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:22.080595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:22.080595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:22.081451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:22.081451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:22.081451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:22.081451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:22.081451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:22.081451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:22.081451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:22.081451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:22.081451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:22.081451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:22.081451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:54:22.081451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:22.081451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 30 11:54:22.081451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:22.081451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 495/1016] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:54:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:22.086728 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b14d2-78d9-4115-875d-2edb985fc549 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:22.093026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96440bab-390b-408f-874e-2bc58b9bb86c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:22.128876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187effaf-e85f-4f85-976e-24e3eff8f25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:22.129476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187effaf-e85f-4f85-976e-24e3eff8f25c None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:22.129766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187effaf-e85f-4f85-976e-24e3eff8f25c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:22.130052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187effaf-e85f-4f85-976e-24e3eff8f25c None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:22.130787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187effaf-e85f-4f85-976e-24e3eff8f25c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:22.132194 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187effaf-e85f-4f85-976e-24e3eff8f25c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:22.147037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 522/1017] 10.222.0.41 () {60 vars in 1141 bytes} [Mon May 30 11:54:21 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:54:22.201681 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b14d2-78d9-4115-875d-2edb985fc549 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:22.240345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:22.248603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153d593-0adb-4cb0-a3c0-09a8a1cc9911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:22.249313 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153d593-0adb-4cb0-a3c0-09a8a1cc9911 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:22.249604 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153d593-0adb-4cb0-a3c0-09a8a1cc9911 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:22.249884 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153d593-0adb-4cb0-a3c0-09a8a1cc9911 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:22.250613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153d593-0adb-4cb0-a3c0-09a8a1cc9911 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:22.250927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153d593-0adb-4cb0-a3c0-09a8a1cc9911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:22.252382 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153d593-0adb-4cb0-a3c0-09a8a1cc9911 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:22.263514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 496/1018] 10.222.0.41 () {56 vars in 1112 bytes} [Mon May 30 11:54:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:22.265369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187effaf-e85f-4f85-976e-24e3eff8f25c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:22.378065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187effaf-e85f-4f85-976e-24e3eff8f25c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:22.387401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:22.415078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa368c49-50ce-434f-b1bb-260d8bf179d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:22.415748 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa368c49-50ce-434f-b1bb-260d8bf179d2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:22.416076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa368c49-50ce-434f-b1bb-260d8bf179d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:22.416361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa368c49-50ce-434f-b1bb-260d8bf179d2 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:22.417078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa368c49-50ce-434f-b1bb-260d8bf179d2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:22.417392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa368c49-50ce-434f-b1bb-260d8bf179d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:22.419338 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa368c49-50ce-434f-b1bb-260d8bf179d2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:22.424705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 523/1019] 10.222.0.41 () {56 vars in 1112 bytes} [Mon May 30 11:54:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:22.430194 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153d593-0adb-4cb0-a3c0-09a8a1cc9911 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:22.532064 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153d593-0adb-4cb0-a3c0-09a8a1cc9911 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:22.566401 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23851b-c704-44cf-8024-9fac463692fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:22.567067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23851b-c704-44cf-8024-9fac463692fe None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:22.567350 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23851b-c704-44cf-8024-9fac463692fe None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:22.567625 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23851b-c704-44cf-8024-9fac463692fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:22.568413 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23851b-c704-44cf-8024-9fac463692fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:22.569775 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23851b-c704-44cf-8024-9fac463692fe None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:22.597161 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 497/1020] 10.222.0.41 () {60 vars in 1144 bytes} [Mon May 30 11:54:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:54:24.128459 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24d165-7415-42cc-8bcb-3531ebb01a70 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:24.128965 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24d165-7415-42cc-8bcb-3531ebb01a70 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:24.128965 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24d165-7415-42cc-8bcb-3531ebb01a70 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:24.130509 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 524/1021] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:24.136347 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74e437-2b4a-4f61-a06a-b93bde9d5b1a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:24.136947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74e437-2b4a-4f61-a06a-b93bde9d5b1a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:24.136947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74e437-2b4a-4f61-a06a-b93bde9d5b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:24.154501 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5d74e437-2b4a-4f61-a06a-b93bde9d5b1a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:24.155692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5d74e437-2b4a-4f61-a06a-b93bde9d5b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:24.202470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:24.232007 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 498/1022] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:24.256292 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24d165-7415-42cc-8bcb-3531ebb01a70 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:24.357674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24d165-7415-42cc-8bcb-3531ebb01a70 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:24.392047 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f01a86-bb92-4136-af19-9a685cad9886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:24.392759 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f01a86-bb92-4136-af19-9a685cad9886 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:24.393043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f01a86-bb92-4136-af19-9a685cad9886 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:24.393317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f01a86-bb92-4136-af19-9a685cad9886 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:24.394495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f01a86-bb92-4136-af19-9a685cad9886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:24.395951 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f01a86-bb92-4136-af19-9a685cad9886 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:24.402168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 525/1023] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:24.405944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74e437-2b4a-4f61-a06a-b93bde9d5b1a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:24.459680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f5762-885d-408c-afef-f9a804a9fb95 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:24.460042 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f5762-885d-408c-afef-f9a804a9fb95 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:24.460287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f5762-885d-408c-afef-f9a804a9fb95 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:24.461771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 526/1024] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:24.468773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878e457-0fc0-46ca-9642-cee2789d37b7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:24.469284 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878e457-0fc0-46ca-9642-cee2789d37b7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:24.469573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878e457-0fc0-46ca-9642-cee2789d37b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:24.486843 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f878e457-0fc0-46ca-9642-cee2789d37b7 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:24.488056 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f878e457-0fc0-46ca-9642-cee2789d37b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:24.508792 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74e437-2b4a-4f61-a06a-b93bde9d5b1a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:24.522834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:24.547414 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f5c5e-6aa7-4573-9216-3e7470dac6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:24.548110 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f5c5e-6aa7-4573-9216-3e7470dac6d3 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:24.548395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f5c5e-6aa7-4573-9216-3e7470dac6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:24.548676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f5c5e-6aa7-4573-9216-3e7470dac6d3 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:24.549406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f5c5e-6aa7-4573-9216-3e7470dac6d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:24.550856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f5c5e-6aa7-4573-9216-3e7470dac6d3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:24.560936 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 527/1025] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:54:24.574033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 499/1026] 10.222.0.41 () {60 vars in 1132 bytes} [Mon May 30 11:54:24 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:54:24.584659 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878e457-0fc0-46ca-9642-cee2789d37b7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:24.699324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878e457-0fc0-46ca-9642-cee2789d37b7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:24.738478 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9431e-b534-4afc-a0e7-fae33c0275b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:24.739328 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9431e-b534-4afc-a0e7-fae33c0275b1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:24.739616 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9431e-b534-4afc-a0e7-fae33c0275b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:24.740076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9431e-b534-4afc-a0e7-fae33c0275b1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:24.740662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9431e-b534-4afc-a0e7-fae33c0275b1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:24.742128 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9431e-b534-4afc-a0e7-fae33c0275b1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:24.756603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ffb9431e-b534-4afc-a0e7-fae33c0275b1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 30 11:54:24.756603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:24.756603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:54:24.756603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:54:24.756603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:54:24.756603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:54:24.756603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:54:24.756603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:24.756603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 30 11:54:24.756603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:24.756603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:54:24.756603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:24.756603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:24.756603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:24.756603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:24.756603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:24.756603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:24.757688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:24.757688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:24.757688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:24.757688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:24.757688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:24.757688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:24.757688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:54:24.757688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:54:24.757688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:54:24.757688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:54:24.757688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:24.757688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:24.757688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:24.757688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:24.757688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:24.757688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:24.758514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:24.758514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:24.758514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:24.758514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:24.758514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:24.758514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:24.758514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:24.758514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:24.758514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:24.758514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:24.758514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:54:24.758514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:24.758514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 30 11:54:24.758514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:24.767669 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 528/1027] 10.222.0.41 () {56 vars in 1105 bytes} [Mon May 30 11:54:24 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:24.767920 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f5c5e-6aa7-4573-9216-3e7470dac6d3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:24.805907 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:24.882210 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f5c5e-6aa7-4573-9216-3e7470dac6d3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:24.918219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed1b72-017c-4622-9ef3-6cd69f681c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:24.919557 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed1b72-017c-4622-9ef3-6cd69f681c9e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:24.919738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed1b72-017c-4622-9ef3-6cd69f681c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:24.920042 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed1b72-017c-4622-9ef3-6cd69f681c9e None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:24.920752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed1b72-017c-4622-9ef3-6cd69f681c9e None admin] RBAC: Adding query filter params (name=image) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:24.921066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed1b72-017c-4622-9ef3-6cd69f681c9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:24.922455 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed1b72-017c-4622-9ef3-6cd69f681c9e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:24.927668 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 500/1028] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:24.933393 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9431e-b534-4afc-a0e7-fae33c0275b1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:24.970962 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:25.039170 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9431e-b534-4afc-a0e7-fae33c0275b1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:25.073294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56ac18-dade-44b2-8f03-d1b4c983633c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:25.073966 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56ac18-dade-44b2-8f03-d1b4c983633c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:25.074253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56ac18-dade-44b2-8f03-d1b4c983633c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:25.074536 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56ac18-dade-44b2-8f03-d1b4c983633c None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:25.075375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56ac18-dade-44b2-8f03-d1b4c983633c None admin] RBAC: Adding query filter params (type=image) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:25.075690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56ac18-dade-44b2-8f03-d1b4c983633c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:25.077098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56ac18-dade-44b2-8f03-d1b4c983633c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:25.080258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecba82e-8dee-4ba2-936f-466e838c34c2 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:25.080561 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecba82e-8dee-4ba2-936f-466e838c34c2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:25.080850 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecba82e-8dee-4ba2-936f-466e838c34c2 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:25.086899 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 501/1029] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:25.087020 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 529/1030] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:25.087280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a681a56-3d3a-4847-a281-737b8923e62c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:25.087574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a681a56-3d3a-4847-a281-737b8923e62c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:25.087671 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56ac18-dade-44b2-8f03-d1b4c983633c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:25.087893 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a681a56-3d3a-4847-a281-737b8923e62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:25.105018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7a681a56-3d3a-4847-a281-737b8923e62c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:25.106847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7a681a56-3d3a-4847-a281-737b8923e62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:25.180380 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 502/1031] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:25.197644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:25.202839 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56ac18-dade-44b2-8f03-d1b4c983633c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:25.206435 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a681a56-3d3a-4847-a281-737b8923e62c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:25.236403 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:25.240221 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea551f-69a1-456d-a239-7c66dac92b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:25.240975 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea551f-69a1-456d-a239-7c66dac92b27 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:25.241263 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea551f-69a1-456d-a239-7c66dac92b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:25.241559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea551f-69a1-456d-a239-7c66dac92b27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:25.242342 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea551f-69a1-456d-a239-7c66dac92b27 None admin] RBAC: Adding query filter params (interface=public, service_id=d3741a242cfc4c59a39a6f583b55496b, region_id=RegionOne) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:25.242669 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea551f-69a1-456d-a239-7c66dac92b27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:25.244063 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea551f-69a1-456d-a239-7c66dac92b27 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:25.250094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 530/1032] 10.222.0.41 () {56 vars in 1251 bytes} [Mon May 30 11:54:25 2022] GET /identity/v3/endpoints?service_id=d3741a242cfc4c59a39a6f583b55496b&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:25.255434 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea551f-69a1-456d-a239-7c66dac92b27 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:25.321072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a681a56-3d3a-4847-a281-737b8923e62c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:25.362502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea551f-69a1-456d-a239-7c66dac92b27 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:25.364539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29336bda-a286-4a08-a36b-52ab7cd5a9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:25.365468 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29336bda-a286-4a08-a36b-52ab7cd5a9cd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:25.365705 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29336bda-a286-4a08-a36b-52ab7cd5a9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:25.365983 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29336bda-a286-4a08-a36b-52ab7cd5a9cd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:25.378187 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29336bda-a286-4a08-a36b-52ab7cd5a9cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:54:25.386449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-29336bda-a286-4a08-a36b-52ab7cd5a9cd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:54:25.386449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:25.386449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:25.386449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:25.386449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:25.386449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:25.386449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:25.386449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:25.386449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:25.386449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:25.386449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:25.386449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:25.386449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:54:25.386449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:54:25.386449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:54:25.386449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:54:25.388466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:54:25.388466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:54:25.388466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:54:25.388466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:54:25.388466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:25.388466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:25.388466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:25.388466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:25.388466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:25.388466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:25.388466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:25.388466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:25.388466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:25.388466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:25.388466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:25.388466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:25.389324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:25.389324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:25.389324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:25.389324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:25.389324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:54:25.389324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:54:25.389324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:54:25.389324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:54:25.389324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:54:25.389324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:54:25.389324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:54:25.389324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:25.389324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 503/1033] 10.222.0.41 () {56 vars in 1120 bytes} [Mon May 30 11:54:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:25.394103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29336bda-a286-4a08-a36b-52ab7cd5a9cd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:25.402254 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1971e2-319b-4d6a-89f8-6b5529e88b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:25.403315 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1971e2-319b-4d6a-89f8-6b5529e88b6a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:25.403612 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1971e2-319b-4d6a-89f8-6b5529e88b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:25.403920 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1971e2-319b-4d6a-89f8-6b5529e88b6a None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:25.404621 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1971e2-319b-4d6a-89f8-6b5529e88b6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:25.405992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1971e2-319b-4d6a-89f8-6b5529e88b6a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:25.412823 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 531/1034] 10.222.0.41 () {56 vars in 1087 bytes} [Mon May 30 11:54:25 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 11:54:25.493455 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:25.511222 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29336bda-a286-4a08-a36b-52ab7cd5a9cd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:25.549422 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a2758-aaae-47f4-9663-08c2b76ab762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:25.550113 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a2758-aaae-47f4-9663-08c2b76ab762 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:25.550400 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a2758-aaae-47f4-9663-08c2b76ab762 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:25.550680 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a2758-aaae-47f4-9663-08c2b76ab762 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:25.551454 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a2758-aaae-47f4-9663-08c2b76ab762 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:25.551769 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a2758-aaae-47f4-9663-08c2b76ab762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:25.553207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a2758-aaae-47f4-9663-08c2b76ab762 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:25.567597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 504/1035] 10.222.0.41 () {56 vars in 1115 bytes} [Mon May 30 11:54:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:25.568792 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1971e2-319b-4d6a-89f8-6b5529e88b6a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:25.599997 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:25.677112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1971e2-319b-4d6a-89f8-6b5529e88b6a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:25.710985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b6bbc-bbfb-4890-be6b-3f9f587da640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:25.711916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b6bbc-bbfb-4890-be6b-3f9f587da640 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:25.712204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b6bbc-bbfb-4890-be6b-3f9f587da640 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:25.712483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b6bbc-bbfb-4890-be6b-3f9f587da640 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:25.724045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b6bbc-bbfb-4890-be6b-3f9f587da640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:25.725508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b6bbc-bbfb-4890-be6b-3f9f587da640 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:25.743218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-a85b6bbc-bbfb-4890-be6b-3f9f587da640 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:25.743218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:25.743218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:25.743218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:25.743218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:25.743218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:25.743218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:25.743218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:25.743218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:25.743218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:25.743218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:25.743218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:25.743218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:54:25.743218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:54:25.743218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:54:25.744481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:54:25.744481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:25.744481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:25.744481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:25.744481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:25.744481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:25.744481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:25.744481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:25.744481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:25.744481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:25.744481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:25.744481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:25.744481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:25.744481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:25.744481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:25.744481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:25.744481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:25.745633 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:54:25.745633 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:54:25.745633 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:25.745633 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:25.745633 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 532/1036] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:25.751965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a2758-aaae-47f4-9663-08c2b76ab762 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:25.867616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a2758-aaae-47f4-9663-08c2b76ab762 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:25.901351 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53073945-32d8-46df-bc64-3fb9583daf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:25.902020 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53073945-32d8-46df-bc64-3fb9583daf00 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:25.902314 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53073945-32d8-46df-bc64-3fb9583daf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:25.902597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53073945-32d8-46df-bc64-3fb9583daf00 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:25.903878 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53073945-32d8-46df-bc64-3fb9583daf00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:25.904199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53073945-32d8-46df-bc64-3fb9583daf00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:25.905575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53073945-32d8-46df-bc64-3fb9583daf00 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:25.917950 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 505/1037] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:25.923980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b6bbc-bbfb-4890-be6b-3f9f587da640 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:26.005841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:26.029523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b6bbc-bbfb-4890-be6b-3f9f587da640 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:26.066591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3020c7d-e555-4652-8ec3-f728babaf1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:26.067616 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3020c7d-e555-4652-8ec3-f728babaf1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:26.068093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3020c7d-e555-4652-8ec3-f728babaf1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:26.068518 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3020c7d-e555-4652-8ec3-f728babaf1f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:26.076822 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3020c7d-e555-4652-8ec3-f728babaf1f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:26.078422 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3020c7d-e555-4652-8ec3-f728babaf1f4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:26.093001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f3020c7d-e555-4652-8ec3-f728babaf1f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 30 11:54:26.093001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:26.093001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:26.093001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:26.093001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:26.093001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:26.093001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:26.093001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:26.093001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:26.093001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:26.093001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:26.093001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:26.093001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:54:26.093001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:54:26.093001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:54:26.093001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:54:26.094023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:26.094023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:26.094023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:54:26.094023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:54:26.094023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:54:26.094023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:54:26.094023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:26.094023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:26.094023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:26.094023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:26.094023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:26.094023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:26.094023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:26.094023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:26.094023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:26.094023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:26.094023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:26.094023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:26.094963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:26.094963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:26.094963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:54:26.094963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:54:26.094963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:54:26.094963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:54:26.094963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:54:26.094963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:54:26.094963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 30 11:54:26.094963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:26.099481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 533/1038] 10.222.0.41 () {56 vars in 1093 bytes} [Mon May 30 11:54:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:26.100661 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53073945-32d8-46df-bc64-3fb9583daf00 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:26.112228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:26.205255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53073945-32d8-46df-bc64-3fb9583daf00 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:26.241056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b2083-bb02-45b6-aa12-97d8d4725cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:26.241734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b2083-bb02-45b6-aa12-97d8d4725cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:26.242017 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b2083-bb02-45b6-aa12-97d8d4725cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:26.242292 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b2083-bb02-45b6-aa12-97d8d4725cd0 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:26.243212 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b2083-bb02-45b6-aa12-97d8d4725cd0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:26.243531 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b2083-bb02-45b6-aa12-97d8d4725cd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:26.245009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b2083-bb02-45b6-aa12-97d8d4725cd0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:26.268004 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 506/1039] 10.222.0.41 () {56 vars in 1133 bytes} [Mon May 30 11:54:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:26.269589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3020c7d-e555-4652-8ec3-f728babaf1f4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:26.373077 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3020c7d-e555-4652-8ec3-f728babaf1f4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:26.406923 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03c209-4b0d-47cf-b6f6-24e275a78b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:26.407580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03c209-4b0d-47cf-b6f6-24e275a78b1d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:26.407905 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03c209-4b0d-47cf-b6f6-24e275a78b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:26.408191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03c209-4b0d-47cf-b6f6-24e275a78b1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:26.416792 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:26.479730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03c209-4b0d-47cf-b6f6-24e275a78b1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:26.481831 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03c209-4b0d-47cf-b6f6-24e275a78b1d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:26.588033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 534/1040] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:54:26 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:54:26.590187 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b2083-bb02-45b6-aa12-97d8d4725cd0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:26.661115 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:26.697889 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b2083-bb02-45b6-aa12-97d8d4725cd0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:26.732688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00546ae4-b4a4-431e-90fa-5624b6c863c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:26.733505 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00546ae4-b4a4-431e-90fa-5624b6c863c7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:26.733792 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00546ae4-b4a4-431e-90fa-5624b6c863c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:26.734163 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00546ae4-b4a4-431e-90fa-5624b6c863c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:26.744489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00546ae4-b4a4-431e-90fa-5624b6c863c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:26.746201 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00546ae4-b4a4-431e-90fa-5624b6c863c7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:26.764594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-00546ae4-b4a4-431e-90fa-5624b6c863c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:26.764594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:26.764594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:26.764594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:26.764594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:26.764594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:26.764594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:26.764594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:26.764594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:26.764594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:26.764594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:26.764594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:26.764594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:54:26.764594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:54:26.764594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:54:26.770456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:54:26.770456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:26.770456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:26.770456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:26.770456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:26.770456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:26.770456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:26.770456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:26.770456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:26.770456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:26.770456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:26.770456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:26.770456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:26.770456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:26.770456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:26.770456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:26.770456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:26.771345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:54:26.771345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:54:26.771345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:26.771345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:26.771345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 507/1041] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:26.773103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03c209-4b0d-47cf-b6f6-24e275a78b1d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:26.820777 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:26.886144 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03c209-4b0d-47cf-b6f6-24e275a78b1d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:26.921914 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d0b82-1337-49c1-ade6-e5dbdc7de76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:26.923233 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d0b82-1337-49c1-ade6-e5dbdc7de76a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:26.923516 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d0b82-1337-49c1-ade6-e5dbdc7de76a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:26.923788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d0b82-1337-49c1-ade6-e5dbdc7de76a None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:26.924431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2c412-a08b-48e6-a1f2-f1356162a3d4 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:26.924550 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d0b82-1337-49c1-ade6-e5dbdc7de76a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:26.924720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2c412-a08b-48e6-a1f2-f1356162a3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:26.924815 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d0b82-1337-49c1-ade6-e5dbdc7de76a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:26.925001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2c412-a08b-48e6-a1f2-f1356162a3d4 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:26.926156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d0b82-1337-49c1-ade6-e5dbdc7de76a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:26.926637 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 508/1042] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:54:26.931518 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859daab-655d-45b4-898c-4c2379cb56a5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:26.931812 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859daab-655d-45b4-898c-4c2379cb56a5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:26.932125 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859daab-655d-45b4-898c-4c2379cb56a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:26.944931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 535/1043] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:26.946080 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d0b82-1337-49c1-ade6-e5dbdc7de76a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:26.950003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0859daab-655d-45b4-898c-4c2379cb56a5 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:26.951185 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0859daab-655d-45b4-898c-4c2379cb56a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:27.025525 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 509/1044] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:54:27.049367 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859daab-655d-45b4-898c-4c2379cb56a5 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:27.054011 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:27.058344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d0b82-1337-49c1-ade6-e5dbdc7de76a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:27.095687 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52c0d7-c5fd-4109-b093-f23e0ed9ee31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:27.096606 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52c0d7-c5fd-4109-b093-f23e0ed9ee31 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:27.096899 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52c0d7-c5fd-4109-b093-f23e0ed9ee31 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:27.097180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52c0d7-c5fd-4109-b093-f23e0ed9ee31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:27.101565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:27.104773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52c0d7-c5fd-4109-b093-f23e0ed9ee31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:27.106649 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52c0d7-c5fd-4109-b093-f23e0ed9ee31 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:27.122285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-fd52c0d7-c5fd-4109-b093-f23e0ed9ee31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:54:27.122285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:27.122285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:27.122285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:27.122285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:27.122285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:27.122285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:27.122285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:27.122285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:27.122285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:27.122285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:27.122285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:27.122285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:54:27.122285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:54:27.122285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:54:27.123224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:54:27.123224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:27.123224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:27.123224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:27.123224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:27.123224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:27.123224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:27.123224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:27.123224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:27.123224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:27.123224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:27.123224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:27.123224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:27.123224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:27.123224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:27.123224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:27.123224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:27.124881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:54:27.124881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:54:27.124881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:54:27.124881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:54:27.124881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:54:27.124881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:54:27.124881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:54:27.124881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:27.124881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 536/1045] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:54:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:27.129231 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52c0d7-c5fd-4109-b093-f23e0ed9ee31 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:27.157877 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859daab-655d-45b4-898c-4c2379cb56a5 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:27.194045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad6980-252c-4211-83a5-7f28d3a2965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:27.194857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad6980-252c-4211-83a5-7f28d3a2965b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:27.195136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad6980-252c-4211-83a5-7f28d3a2965b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:27.195417 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad6980-252c-4211-83a5-7f28d3a2965b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:27.207060 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad6980-252c-4211-83a5-7f28d3a2965b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:54:27.214789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-2aad6980-252c-4211-83a5-7f28d3a2965b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:54:27.214789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:27.214789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:27.214789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:27.214789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:27.214789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:27.214789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:27.214789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:27.214789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:27.214789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:27.214789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:27.214789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:27.214789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:54:27.214789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:54:27.214789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:54:27.214789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:54:27.216148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:54:27.216148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:54:27.216148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:54:27.216148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:54:27.216148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:27.216148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:27.216148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:27.216148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:27.216148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:27.216148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:27.216148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:27.216148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:27.216148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:27.216148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:27.216148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:27.216148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:27.217799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:27.217799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:27.217799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:27.217799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:27.217799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:54:27.217799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:54:27.217799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:54:27.217799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:54:27.217799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:54:27.217799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:54:27.217799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:54:27.217799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:27.217799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 510/1046] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:54:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:27.221910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad6980-252c-4211-83a5-7f28d3a2965b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:27.241531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52c0d7-c5fd-4109-b093-f23e0ed9ee31 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:27.279042 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b54e1-eb01-4208-9232-6677a6ba095c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:27.279737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b54e1-eb01-4208-9232-6677a6ba095c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:27.280017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b54e1-eb01-4208-9232-6677a6ba095c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:27.280300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b54e1-eb01-4208-9232-6677a6ba095c None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:27.281097 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b54e1-eb01-4208-9232-6677a6ba095c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:27.281414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b54e1-eb01-4208-9232-6677a6ba095c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:27.282844 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b54e1-eb01-4208-9232-6677a6ba095c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:27.295961 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 537/1047] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:54:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:27.301457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b54e1-eb01-4208-9232-6677a6ba095c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:27.321819 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:27.338973 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad6980-252c-4211-83a5-7f28d3a2965b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:27.350048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:27.379668 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d95fe1-d123-4680-8e96-fc4f56cb6d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:27.380405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d95fe1-d123-4680-8e96-fc4f56cb6d22 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:27.380692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d95fe1-d123-4680-8e96-fc4f56cb6d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:27.380970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d95fe1-d123-4680-8e96-fc4f56cb6d22 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:27.381745 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d95fe1-d123-4680-8e96-fc4f56cb6d22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:27.382059 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d95fe1-d123-4680-8e96-fc4f56cb6d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:27.383497 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d95fe1-d123-4680-8e96-fc4f56cb6d22 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:27.394684 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 511/1048] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:54:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:27.400365 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d95fe1-d123-4680-8e96-fc4f56cb6d22 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:27.423431 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b54e1-eb01-4208-9232-6677a6ba095c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:27.460950 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734ad8f-c44c-4a2c-9c19-c20408952184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:27.461521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734ad8f-c44c-4a2c-9c19-c20408952184 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:27.461928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734ad8f-c44c-4a2c-9c19-c20408952184 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:27.462125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734ad8f-c44c-4a2c-9c19-c20408952184 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:27.462927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734ad8f-c44c-4a2c-9c19-c20408952184 None admin] RBAC: Adding query filter params (role.id=f22986e64f7e44279ed898fdf581a644, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=bb3820a613744c15b840681fe6b6e808) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:27.463255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734ad8f-c44c-4a2c-9c19-c20408952184 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:27.464730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734ad8f-c44c-4a2c-9c19-c20408952184 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:27.479864 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 538/1049] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:54:27 2022] GET /identity/v3/role_assignments?user.id=bb3820a613744c15b840681fe6b6e808&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=f22986e64f7e44279ed898fdf581a644 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:27.521018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d95fe1-d123-4680-8e96-fc4f56cb6d22 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:27.560047 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692d91b-1560-44a1-ba62-6e76c6be9f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:27.560848 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692d91b-1560-44a1-ba62-6e76c6be9f4c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:27.561138 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692d91b-1560-44a1-ba62-6e76c6be9f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:27.561417 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692d91b-1560-44a1-ba62-6e76c6be9f4c None admin] PATH_INFO: `/v3/users/92c9e7eaeddb4eb095abc0a699ad346f` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:27.577548 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692d91b-1560-44a1-ba62-6e76c6be9f4c None admin] RBAC: Authorizing `identity:get_user(user_id=92c9e7eaeddb4eb095abc0a699ad346f)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:27.579084 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692d91b-1560-44a1-ba62-6e76c6be9f4c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:27.581183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 512/1050] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:54:27 2022] GET /identity/v3/users/92c9e7eaeddb4eb095abc0a699ad346f => generated 285 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:27.586738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734ad8f-c44c-4a2c-9c19-c20408952184 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:27.677264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:27.697270 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734ad8f-c44c-4a2c-9c19-c20408952184 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:27.706517 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dad82d-1c85-49fa-a7af-c393cf770492 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:27.706816 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dad82d-1c85-49fa-a7af-c393cf770492 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:27.707098 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dad82d-1c85-49fa-a7af-c393cf770492 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:27.708720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 513/1051] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:54:27.713545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6647d-c044-45b5-a0ad-d6755d02418d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:27.713837 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6647d-c044-45b5-a0ad-d6755d02418d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:27.714114 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6647d-c044-45b5-a0ad-d6755d02418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:27.731342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a4b6647d-c044-45b5-a0ad-d6755d02418d None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:27.732563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a4b6647d-c044-45b5-a0ad-d6755d02418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:27.734120 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a090ab4-4ce9-4c3a-a283-a7cca04658af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:27.734778 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a090ab4-4ce9-4c3a-a283-a7cca04658af None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:27.735068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a090ab4-4ce9-4c3a-a283-a7cca04658af None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:27.735355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a090ab4-4ce9-4c3a-a283-a7cca04658af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:27.757753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:27.810611 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 514/1052] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:54:27.816001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a090ab4-4ce9-4c3a-a283-a7cca04658af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:27.817450 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a090ab4-4ce9-4c3a-a283-a7cca04658af None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:27.833702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6647d-c044-45b5-a0ad-d6755d02418d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:27.907553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:27.928881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 539/1053] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:54:27 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:54:27.935305 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a090ab4-4ce9-4c3a-a283-a7cca04658af None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:27.943518 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6647d-c044-45b5-a0ad-d6755d02418d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:27.981036 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832df80-d475-4a91-8665-b1a6b5cd29b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:27.982129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832df80-d475-4a91-8665-b1a6b5cd29b0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:27.982417 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832df80-d475-4a91-8665-b1a6b5cd29b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:27.982697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832df80-d475-4a91-8665-b1a6b5cd29b0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:27.983523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832df80-d475-4a91-8665-b1a6b5cd29b0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:27.985336 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832df80-d475-4a91-8665-b1a6b5cd29b0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:27.998023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-8832df80-d475-4a91-8665-b1a6b5cd29b0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 30 11:54:27.998023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:27.998023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:54:27.998023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:54:27.998023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:54:27.998023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:54:27.998023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:54:27.998023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:27.998023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 30 11:54:27.998023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:27.998023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:54:27.998023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:27.998023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:27.998023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:27.998023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:27.998023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:27.998023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:27.999103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:27.999103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:27.999103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:27.999103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:27.999103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:27.999103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:27.999103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:54:27.999103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:54:27.999103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:54:27.999103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:54:27.999103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:27.999103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:27.999103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:27.999103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:27.999103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:27.999103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:28.000075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:28.000075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:28.000075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:28.000075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:28.000075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:28.000075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:28.000075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:28.000075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:28.000075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:28.000075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:28.000075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:54:28.000075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:54:28.000075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 30 11:54:28.000075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:28.000075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 515/1054] 10.222.0.41 () {56 vars in 1105 bytes} [Mon May 30 11:54:27 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:28.005238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832df80-d475-4a91-8665-b1a6b5cd29b0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:28.031582 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:28.048670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a090ab4-4ce9-4c3a-a283-a7cca04658af None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:28.084412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f521d0e-8221-4ee0-b274-74fc54ac651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:28.085274 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f521d0e-8221-4ee0-b274-74fc54ac651e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:28.085561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f521d0e-8221-4ee0-b274-74fc54ac651e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:28.086243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f521d0e-8221-4ee0-b274-74fc54ac651e None admin] PATH_INFO: `/v3/projects/a2c3407301f34ef781de0b9230439605` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:28.087445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f521d0e-8221-4ee0-b274-74fc54ac651e None admin] RBAC: Authorizing `identity:get_project(project_id=a2c3407301f34ef781de0b9230439605)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:28.089679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f521d0e-8221-4ee0-b274-74fc54ac651e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:28.092327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 540/1055] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:54:27 2022] GET /identity/v3/projects/a2c3407301f34ef781de0b9230439605 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:28.098125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f521d0e-8221-4ee0-b274-74fc54ac651e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:28.112874 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832df80-d475-4a91-8665-b1a6b5cd29b0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:28.148418 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bd736-d4c2-4710-b378-19f802b22764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:28.149009 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:28.150269 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bd736-d4c2-4710-b378-19f802b22764 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:28.150743 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bd736-d4c2-4710-b378-19f802b22764 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:28.151204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bd736-d4c2-4710-b378-19f802b22764 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:28.152158 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bd736-d4c2-4710-b378-19f802b22764 None admin] RBAC: Adding query filter params (name=image) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:28.153783 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bd736-d4c2-4710-b378-19f802b22764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:28.155358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bd736-d4c2-4710-b378-19f802b22764 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:28.165745 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 516/1056] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:28.166912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bd736-d4c2-4710-b378-19f802b22764 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:28.202613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f521d0e-8221-4ee0-b274-74fc54ac651e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:28.244012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee776b-f949-4fff-97a9-688ca619f853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:28.244674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee776b-f949-4fff-97a9-688ca619f853 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:28.244962 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee776b-f949-4fff-97a9-688ca619f853 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:28.245543 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee776b-f949-4fff-97a9-688ca619f853 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:28.246418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee776b-f949-4fff-97a9-688ca619f853 None admin] RBAC: Adding query filter params (role.id=8196ef570097443bac15d3cf39878486, scope.project.id=a2c3407301f34ef781de0b9230439605, user.id=92c9e7eaeddb4eb095abc0a699ad346f) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:28.246798 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee776b-f949-4fff-97a9-688ca619f853 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:28.248431 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee776b-f949-4fff-97a9-688ca619f853 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:28.264082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 541/1057] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:54:28 2022] GET /identity/v3/role_assignments?user.id=92c9e7eaeddb4eb095abc0a699ad346f&scope.project.id=a2c3407301f34ef781de0b9230439605&role.id=8196ef570097443bac15d3cf39878486 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:28.264944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:28.276116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bd736-d4c2-4710-b378-19f802b22764 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:28.313902 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e24431-df22-4ec9-94ba-5a94e3128020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:28.314602 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e24431-df22-4ec9-94ba-5a94e3128020 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:28.314886 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e24431-df22-4ec9-94ba-5a94e3128020 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:28.315162 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e24431-df22-4ec9-94ba-5a94e3128020 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:28.315925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e24431-df22-4ec9-94ba-5a94e3128020 None admin] RBAC: Adding query filter params (type=image) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:28.316240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e24431-df22-4ec9-94ba-5a94e3128020 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:28.317671 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e24431-df22-4ec9-94ba-5a94e3128020 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:28.323649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 517/1058] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:28.329870 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee776b-f949-4fff-97a9-688ca619f853 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:28.440464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee776b-f949-4fff-97a9-688ca619f853 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:28.456076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:28.477711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec4555-2a28-4b96-9488-bda2d5e1aa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:28.478375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec4555-2a28-4b96-9488-bda2d5e1aa4b None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:28.478662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec4555-2a28-4b96-9488-bda2d5e1aa4b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:28.478967 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec4555-2a28-4b96-9488-bda2d5e1aa4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:28.479715 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec4555-2a28-4b96-9488-bda2d5e1aa4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:28.481168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec4555-2a28-4b96-9488-bda2d5e1aa4b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:28.500054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 542/1059] 10.222.0.41 () {60 vars in 1144 bytes} [Mon May 30 11:54:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:54:29.794415 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d1670-75bb-45eb-a2cd-b2a49c0cd5a9 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:29.794941 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d1670-75bb-45eb-a2cd-b2a49c0cd5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:29.795037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d1670-75bb-45eb-a2cd-b2a49c0cd5a9 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:29.796515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 518/1060] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:29.801558 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58323a-3f24-443b-ab8e-0f5972e21c9e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:29.801966 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58323a-3f24-443b-ab8e-0f5972e21c9e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:29.802143 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58323a-3f24-443b-ab8e-0f5972e21c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:29.819912 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2f58323a-3f24-443b-ab8e-0f5972e21c9e None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:29.821082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2f58323a-3f24-443b-ab8e-0f5972e21c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:29.894828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 543/1061] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:54:29.917628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d1670-75bb-45eb-a2cd-b2a49c0cd5a9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:30.026191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d1670-75bb-45eb-a2cd-b2a49c0cd5a9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:30.061280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbdbbb-fd03-441c-82ba-56e7fcc68165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:30.062096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbdbbb-fd03-441c-82ba-56e7fcc68165 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:30.062376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbdbbb-fd03-441c-82ba-56e7fcc68165 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:30.062648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbdbbb-fd03-441c-82ba-56e7fcc68165 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:30.073172 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbdbbb-fd03-441c-82ba-56e7fcc68165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:54:30.082431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d4bbdbbb-fd03-441c-82ba-56e7fcc68165 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:54:30.082431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:30.082431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:30.082431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:30.082431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:30.082431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:30.082431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:30.082431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:30.082431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:30.082431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:30.082431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:30.082431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:30.082431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:54:30.082431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:54:30.082431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:54:30.082431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:54:30.083392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:54:30.083392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:54:30.083392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:54:30.083392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:54:30.083392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:30.083392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:30.083392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:30.083392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:30.083392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:30.083392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:30.083392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:30.083392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:30.083392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:30.083392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:30.083392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:30.083392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:30.084310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:30.084310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:30.084310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:30.084310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:30.084310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:54:30.084310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:54:30.084310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:54:30.084310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:54:30.084310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:54:30.084310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:54:30.084310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:54:30.084310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:30.088154 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 519/1062] 10.222.0.41 () {56 vars in 1120 bytes} [Mon May 30 11:54:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:30.089524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58323a-3f24-443b-ab8e-0f5972e21c9e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:30.189918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:30.197950 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58323a-3f24-443b-ab8e-0f5972e21c9e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:30.236175 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2400b6-9100-46b4-af3f-11fa0db9ef55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:30.237215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2400b6-9100-46b4-af3f-11fa0db9ef55 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:30.237719 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2400b6-9100-46b4-af3f-11fa0db9ef55 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:30.238212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2400b6-9100-46b4-af3f-11fa0db9ef55 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:30.239176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2400b6-9100-46b4-af3f-11fa0db9ef55 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:30.239687 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2400b6-9100-46b4-af3f-11fa0db9ef55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:30.241252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2400b6-9100-46b4-af3f-11fa0db9ef55 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:30.254323 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 544/1063] 10.222.0.41 () {56 vars in 1115 bytes} [Mon May 30 11:54:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:30.255835 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbdbbb-fd03-441c-82ba-56e7fcc68165 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:30.269058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:30.361135 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbdbbb-fd03-441c-82ba-56e7fcc68165 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:30.396820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d32d6-8266-4933-804d-25b0d2b940bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:30.397997 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d32d6-8266-4933-804d-25b0d2b940bb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:30.398479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d32d6-8266-4933-804d-25b0d2b940bb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:30.398977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d32d6-8266-4933-804d-25b0d2b940bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:30.410319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d32d6-8266-4933-804d-25b0d2b940bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:30.412065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d32d6-8266-4933-804d-25b0d2b940bb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:30.430621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-ce5d32d6-8266-4933-804d-25b0d2b940bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:30.430621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:30.430621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:30.430621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:30.430621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:30.430621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:30.430621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:30.430621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:30.430621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:30.430621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:30.430621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:30.430621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:30.430621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:54:30.430621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:54:30.430621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:54:30.431593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:54:30.431593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:30.431593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:30.431593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:30.431593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:30.431593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:30.431593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:30.431593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:30.431593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:30.431593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:30.431593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:30.431593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:30.431593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:30.431593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:30.431593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:30.431593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:30.431593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:30.432514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:54:30.432514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:54:30.432514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:30.432514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:30.433287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 520/1064] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:30.439999 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2400b6-9100-46b4-af3f-11fa0db9ef55 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:30.522711 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc4a9d-dc3b-4f83-bec1-7c3c315ee2ef None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:30.523037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc4a9d-dc3b-4f83-bec1-7c3c315ee2ef None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:30.523285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc4a9d-dc3b-4f83-bec1-7c3c315ee2ef None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:30.524810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 521/1065] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:30.530115 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65faee-330b-488a-a28a-212ac4756fd8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:30.530403 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65faee-330b-488a-a28a-212ac4756fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:30.530682 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65faee-330b-488a-a28a-212ac4756fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:30.548214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9c65faee-330b-488a-a28a-212ac4756fd8 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:30.548418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2400b6-9100-46b4-af3f-11fa0db9ef55 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:30.549418 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9c65faee-330b-488a-a28a-212ac4756fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:30.584234 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea29302-bb66-400b-b8ec-d2df818bae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:30.584904 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea29302-bb66-400b-b8ec-d2df818bae34 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:30.585189 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea29302-bb66-400b-b8ec-d2df818bae34 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:30.585463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea29302-bb66-400b-b8ec-d2df818bae34 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:30.586191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea29302-bb66-400b-b8ec-d2df818bae34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:30.586494 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea29302-bb66-400b-b8ec-d2df818bae34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:30.587909 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea29302-bb66-400b-b8ec-d2df818bae34 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:30.600406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 545/1066] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:30.606280 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea29302-bb66-400b-b8ec-d2df818bae34 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:30.612116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:30.628026 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 522/1067] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:54:30.629521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:30.648702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65faee-330b-488a-a28a-212ac4756fd8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:30.719170 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea29302-bb66-400b-b8ec-d2df818bae34 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:30.755170 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01504f-eb46-4c6c-9e80-9fc635dfdb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:30.756006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01504f-eb46-4c6c-9e80-9fc635dfdb08 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:30.756295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01504f-eb46-4c6c-9e80-9fc635dfdb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:30.756576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01504f-eb46-4c6c-9e80-9fc635dfdb08 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:30.760740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65faee-330b-488a-a28a-212ac4756fd8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:30.765452 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01504f-eb46-4c6c-9e80-9fc635dfdb08 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:30.766928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01504f-eb46-4c6c-9e80-9fc635dfdb08 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:30.785581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-fa01504f-eb46-4c6c-9e80-9fc635dfdb08 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 30 11:54:30.785581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:30.785581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:30.785581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:30.785581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:30.785581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:30.785581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:30.785581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:30.785581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:30.785581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:30.785581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:30.785581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:30.785581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:54:30.785581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:54:30.785581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:54:30.785581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:54:30.786674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:30.786674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:30.786674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:54:30.786674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:54:30.786674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:54:30.786674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:54:30.786674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:30.786674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:30.786674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:30.786674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:30.786674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:30.786674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:30.786674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:30.786674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:30.786674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:30.786674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:30.786674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:30.786674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:30.787637 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:30.787637 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:30.787637 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:54:30.787637 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:54:30.787637 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:54:30.787637 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:54:30.787637 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:54:30.787637 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:54:30.787637 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 30 11:54:30.787637 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:30.787637 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 546/1068] 10.222.0.41 () {56 vars in 1093 bytes} [Mon May 30 11:54:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:30.788302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aec69a-ff19-4450-bd20-2a9a745ad6f8 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:30.788302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aec69a-ff19-4450-bd20-2a9a745ad6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:30.788672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aec69a-ff19-4450-bd20-2a9a745ad6f8 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:30.789803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 547/1069] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:30.792661 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aec69a-ff19-4450-bd20-2a9a745ad6f8 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:30.801872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37693431-51f0-4a1b-8f55-d606d822fb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:30.803092 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37693431-51f0-4a1b-8f55-d606d822fb56 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:30.803386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37693431-51f0-4a1b-8f55-d606d822fb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:30.803666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37693431-51f0-4a1b-8f55-d606d822fb56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:30.814738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37693431-51f0-4a1b-8f55-d606d822fb56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:54:30.822372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-37693431-51f0-4a1b-8f55-d606d822fb56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:54:30.822372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:30.822372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:30.822372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:30.822372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:30.822372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:30.822372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:30.822372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:30.822372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:30.822372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:30.822372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:30.822372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:30.822372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:54:30.822372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:54:30.822372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:54:30.822372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:54:30.823306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:54:30.823306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:54:30.823306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:54:30.823306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:54:30.823306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:30.823306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:30.823306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:30.823306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:30.823306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:30.823306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:30.823306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:30.823306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:30.823306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:30.823306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:30.823306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:30.823306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:30.824186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:30.824186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:30.824186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:30.824186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:30.824186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:54:30.824186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:54:30.824186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:54:30.824186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:54:30.824186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:54:30.824186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:54:30.824186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:54:30.824186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:30.824186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 523/1070] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:54:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:30.824949 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f187b-868b-480a-b9af-9c1fcf21dc29 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:30.825073 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f187b-868b-480a-b9af-9c1fcf21dc29 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:30.825353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f187b-868b-480a-b9af-9c1fcf21dc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:30.841182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a93f187b-868b-480a-b9af-9c1fcf21dc29 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:30.842373 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a93f187b-868b-480a-b9af-9c1fcf21dc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:30.876996 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:30.889999 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:30.899789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aec69a-ff19-4450-bd20-2a9a745ad6f8 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:30.910322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 524/1071] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:30.911144 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f187b-868b-480a-b9af-9c1fcf21dc29 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:30.937527 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b92b5-7917-4c1a-8e0d-28eef020b63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:30.938207 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b92b5-7917-4c1a-8e0d-28eef020b63c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:30.938495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b92b5-7917-4c1a-8e0d-28eef020b63c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:30.938774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b92b5-7917-4c1a-8e0d-28eef020b63c None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:30.939623 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b92b5-7917-4c1a-8e0d-28eef020b63c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:30.940034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b92b5-7917-4c1a-8e0d-28eef020b63c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:30.941458 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b92b5-7917-4c1a-8e0d-28eef020b63c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:30.958723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 548/1072] 10.222.0.41 () {56 vars in 1133 bytes} [Mon May 30 11:54:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:30.959526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b92b5-7917-4c1a-8e0d-28eef020b63c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:31.016915 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f187b-868b-480a-b9af-9c1fcf21dc29 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:31.052233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85750a5a-62d6-425c-a642-142f87c8e27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:31.052886 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85750a5a-62d6-425c-a642-142f87c8e27a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:31.053175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85750a5a-62d6-425c-a642-142f87c8e27a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:31.053458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85750a5a-62d6-425c-a642-142f87c8e27a None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:31.054205 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85750a5a-62d6-425c-a642-142f87c8e27a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:31.054516 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85750a5a-62d6-425c-a642-142f87c8e27a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:31.055921 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85750a5a-62d6-425c-a642-142f87c8e27a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:31.057234 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b92b5-7917-4c1a-8e0d-28eef020b63c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:31.063971 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 525/1073] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:54:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:31.064767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85750a5a-62d6-425c-a642-142f87c8e27a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:31.092731 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b89e7-dfc6-445a-9962-ff9b517ec178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:31.093389 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b89e7-dfc6-445a-9962-ff9b517ec178 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:31.093681 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b89e7-dfc6-445a-9962-ff9b517ec178 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:31.093964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b89e7-dfc6-445a-9962-ff9b517ec178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:31.097414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:31.119130 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:31.162278 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b89e7-dfc6-445a-9962-ff9b517ec178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:31.163726 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b89e7-dfc6-445a-9962-ff9b517ec178 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:31.173969 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85750a5a-62d6-425c-a642-142f87c8e27a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:31.206344 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316698b-4429-442e-90b0-a1ca232ad191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:31.207131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316698b-4429-442e-90b0-a1ca232ad191 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:31.207419 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316698b-4429-442e-90b0-a1ca232ad191 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:31.207695 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316698b-4429-442e-90b0-a1ca232ad191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:31.218676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316698b-4429-442e-90b0-a1ca232ad191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:31.220145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316698b-4429-442e-90b0-a1ca232ad191 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:31.237844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-9316698b-4429-442e-90b0-a1ca232ad191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:31.237844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:31.237844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:31.237844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:31.237844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:31.237844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:31.237844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:31.237844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:31.237844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:31.237844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:31.237844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:31.237844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:31.237844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:54:31.237844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:54:31.237844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:54:31.238926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:54:31.238926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:31.238926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:31.238926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:31.238926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:31.238926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:31.238926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:31.238926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:31.238926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:31.238926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:31.238926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:31.238926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:31.238926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:31.238926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:31.238926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:31.238926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:31.238926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:31.239847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:54:31.239847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:54:31.239847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:31.239847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:31.239847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 526/1074] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:31.239847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316698b-4429-442e-90b0-a1ca232ad191 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:31.264068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 549/1075] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:54:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:54:31.264849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b89e7-dfc6-445a-9962-ff9b517ec178 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:31.298896 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:31.342301 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:31.348648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316698b-4429-442e-90b0-a1ca232ad191 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:31.362487 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b89e7-dfc6-445a-9962-ff9b517ec178 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:31.383309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2b1b7-282b-4e72-bbe5-0fce5eda1dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:31.384438 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2b1b7-282b-4e72-bbe5-0fce5eda1dfd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:31.384719 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2b1b7-282b-4e72-bbe5-0fce5eda1dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:31.384994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2b1b7-282b-4e72-bbe5-0fce5eda1dfd None admin] PATH_INFO: `/v3/users/92c9e7eaeddb4eb095abc0a699ad346f` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:31.386169 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2b1b7-282b-4e72-bbe5-0fce5eda1dfd None admin] RBAC: Authorizing `identity:get_user(user_id=92c9e7eaeddb4eb095abc0a699ad346f)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:31.388104 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2b1b7-282b-4e72-bbe5-0fce5eda1dfd None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:31.389761 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 527/1076] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:54:31 2022] GET /identity/v3/users/92c9e7eaeddb4eb095abc0a699ad346f => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:31.390517 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2b1b7-282b-4e72-bbe5-0fce5eda1dfd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:31.396448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cee67d-7901-4961-a469-2b170d65a127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:31.397107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cee67d-7901-4961-a469-2b170d65a127 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:31.397395 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cee67d-7901-4961-a469-2b170d65a127 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:31.397676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cee67d-7901-4961-a469-2b170d65a127 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:31.398407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cee67d-7901-4961-a469-2b170d65a127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:31.398720 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cee67d-7901-4961-a469-2b170d65a127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:31.400105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cee67d-7901-4961-a469-2b170d65a127 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:31.416182 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 550/1077] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:31.416182 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cee67d-7901-4961-a469-2b170d65a127 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:31.496119 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2b1b7-282b-4e72-bbe5-0fce5eda1dfd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:31.509273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:31.516543 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cee67d-7901-4961-a469-2b170d65a127 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:31.530280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd6108-1a58-4fb1-b7aa-300af48a05e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:31.531074 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd6108-1a58-4fb1-b7aa-300af48a05e4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:31.531361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd6108-1a58-4fb1-b7aa-300af48a05e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:31.531638 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd6108-1a58-4fb1-b7aa-300af48a05e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:31.542133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd6108-1a58-4fb1-b7aa-300af48a05e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:31.544314 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd6108-1a58-4fb1-b7aa-300af48a05e4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:31.550530 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a36c6a-452d-47fc-97ca-9d879b4d1d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:31.551390 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a36c6a-452d-47fc-97ca-9d879b4d1d39 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:31.551676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a36c6a-452d-47fc-97ca-9d879b4d1d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:31.551998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a36c6a-452d-47fc-97ca-9d879b4d1d39 None admin] PATH_INFO: `/v3/projects/a2c3407301f34ef781de0b9230439605` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:31.553181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a36c6a-452d-47fc-97ca-9d879b4d1d39 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c3407301f34ef781de0b9230439605)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:31.554614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a36c6a-452d-47fc-97ca-9d879b4d1d39 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:31.556338 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 551/1078] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:54:31 2022] GET /identity/v3/projects/a2c3407301f34ef781de0b9230439605 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:31.557101 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a36c6a-452d-47fc-97ca-9d879b4d1d39 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:31.561931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-38bd6108-1a58-4fb1-b7aa-300af48a05e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:31.561931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:31.561931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:31.561931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:31.561931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:31.561931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:31.561931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:31.561931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:31.561931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:31.561931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:31.561931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:31.561931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:31.561931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:54:31.561931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:54:31.561931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:54:31.563003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:54:31.563003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:31.563003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:31.563003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:31.563003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:31.563003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:31.563003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:31.563003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:31.563003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:31.563003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:31.563003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:31.563003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:31.563003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:31.563003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:31.563003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:31.563003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:31.563003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:31.564246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:54:31.564246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:54:31.564246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:31.564246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:31.564246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 528/1079] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:31.564246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd6108-1a58-4fb1-b7aa-300af48a05e4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:31.584455 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:31.656945 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a36c6a-452d-47fc-97ca-9d879b4d1d39 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:31.665599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd6108-1a58-4fb1-b7aa-300af48a05e4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:31.691533 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d48ab-110d-47f2-8771-ead465cf1cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:31.692284 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d48ab-110d-47f2-8771-ead465cf1cae None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:31.692575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d48ab-110d-47f2-8771-ead465cf1cae None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:31.692855 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d48ab-110d-47f2-8771-ead465cf1cae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:31.698571 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a1dc2-76d5-484f-9b63-b737978586a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:31.699446 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a1dc2-76d5-484f-9b63-b737978586a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:31.700192 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d48ab-110d-47f2-8771-ead465cf1cae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:31.700321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a1dc2-76d5-484f-9b63-b737978586a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:31.700628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a1dc2-76d5-484f-9b63-b737978586a7 None admin] PATH_INFO: `/v3/projects/a2c3407301f34ef781de0b9230439605/users/92c9e7eaeddb4eb095abc0a699ad346f/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:31.701710 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d48ab-110d-47f2-8771-ead465cf1cae None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:31.702570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a1dc2-76d5-484f-9b63-b737978586a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2c3407301f34ef781de0b9230439605, user_id=92c9e7eaeddb4eb095abc0a699ad346f, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:31.704038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a1dc2-76d5-484f-9b63-b737978586a7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:31.716184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-2b2d48ab-110d-47f2-8771-ead465cf1cae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:54:31.716184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:31.716184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:31.716184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:31.716184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:31.716184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:31.716184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:31.716184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:31.716184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:31.716184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:31.716184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:31.716184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:31.716184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:54:31.716184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:54:31.716184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:54:31.717177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:54:31.717177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:31.717177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:31.717177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:31.717177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:31.717177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:31.717177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:31.717177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:31.717177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:31.717177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:31.717177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:31.717177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:31.717177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:31.717177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:31.717177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:31.717177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:31.717177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:31.718104 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:54:31.718104 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:54:31.718104 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:54:31.718104 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:54:31.718104 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:54:31.718104 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:54:31.718104 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:54:31.718104 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:31.718571 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 529/1080] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:54:31 2022] PUT /identity/v3/projects/a2c3407301f34ef781de0b9230439605/users/92c9e7eaeddb4eb095abc0a699ad346f/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:54:31.718644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 552/1081] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:54:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:31.718719 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a1dc2-76d5-484f-9b63-b737978586a7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:31.724894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d48ab-110d-47f2-8771-ead465cf1cae None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:31.758671 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:31.814932 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:31.845578 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d48ab-110d-47f2-8771-ead465cf1cae None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:31.847498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a1dc2-76d5-484f-9b63-b737978586a7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:31.884514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d97ef3-4daf-46b4-966b-73f2efe8b278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:31.885212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d97ef3-4daf-46b4-966b-73f2efe8b278 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:31.885477 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d97ef3-4daf-46b4-966b-73f2efe8b278 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:31.885757 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d97ef3-4daf-46b4-966b-73f2efe8b278 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:31.886572 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d97ef3-4daf-46b4-966b-73f2efe8b278 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:31.886957 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d97ef3-4daf-46b4-966b-73f2efe8b278 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:31.888712 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f3232-2761-48db-b68d-cb3abefa19ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:31.888978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d97ef3-4daf-46b4-966b-73f2efe8b278 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:31.889526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f3232-2761-48db-b68d-cb3abefa19ae None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:31.889880 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f3232-2761-48db-b68d-cb3abefa19ae None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:31.890226 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f3232-2761-48db-b68d-cb3abefa19ae None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:31.891073 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f3232-2761-48db-b68d-cb3abefa19ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:31.891433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f3232-2761-48db-b68d-cb3abefa19ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:31.892972 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f3232-2761-48db-b68d-cb3abefa19ae None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:31.903236 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 553/1082] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:54:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:31.906680 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 530/1083] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:31.910228 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d97ef3-4daf-46b4-966b-73f2efe8b278 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:32.009759 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:32.028557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d97ef3-4daf-46b4-966b-73f2efe8b278 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:32.066210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac08c09-40b0-4335-9b5d-2981b7e7dc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:32.067115 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac08c09-40b0-4335-9b5d-2981b7e7dc5b None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:32.067404 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac08c09-40b0-4335-9b5d-2981b7e7dc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:32.067690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac08c09-40b0-4335-9b5d-2981b7e7dc5b None admin] PATH_INFO: `/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/bb3820a613744c15b840681fe6b6e808/roles/f22986e64f7e44279ed898fdf581a644` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:32.070067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac08c09-40b0-4335-9b5d-2981b7e7dc5b None admin] RBAC: Authorizing `identity:create_grant(project_id=1e8426fd0e01433b8aa3a3797c687e03, user_id=bb3820a613744c15b840681fe6b6e808, role_id=f22986e64f7e44279ed898fdf581a644)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:32.071531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac08c09-40b0-4335-9b5d-2981b7e7dc5b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:32.087319 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 554/1084] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:54:31 2022] PUT /identity/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/bb3820a613744c15b840681fe6b6e808/roles/f22986e64f7e44279ed898fdf581a644 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:54:33.994162 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276af2a-df22-4919-9c9b-ea662aa3d854 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:33.994707 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276af2a-df22-4919-9c9b-ea662aa3d854 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:33.994707 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276af2a-df22-4919-9c9b-ea662aa3d854 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:33.996914 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 531/1085] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:34.003021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d16d7-15d6-4605-aab3-fada863e6c03 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:34.003594 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d16d7-15d6-4605-aab3-fada863e6c03 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:34.003684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d16d7-15d6-4605-aab3-fada863e6c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:34.022222 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d22d16d7-15d6-4605-aab3-fada863e6c03 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:34.023379 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d22d16d7-15d6-4605-aab3-fada863e6c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:34.089983 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 555/1086] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:34.113292 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276af2a-df22-4919-9c9b-ea662aa3d854 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:34.213872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276af2a-df22-4919-9c9b-ea662aa3d854 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:34.247526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22c4ed-a1f1-4e7e-b136-33d197a596c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:34.248348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c4ed-a1f1-4e7e-b136-33d197a596c7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:34.248635 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c4ed-a1f1-4e7e-b136-33d197a596c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:34.248911 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c4ed-a1f1-4e7e-b136-33d197a596c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:34.251537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:34.259840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22c4ed-a1f1-4e7e-b136-33d197a596c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:54:34.268202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-4a22c4ed-a1f1-4e7e-b136-33d197a596c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:54:34.268202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:34.268202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:34.268202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:34.268202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:34.268202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:34.268202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:34.268202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:34.268202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:34.268202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:34.268202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:34.268202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:34.268202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:54:34.268202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:54:34.268202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:54:34.268202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:54:34.269131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:54:34.269131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:54:34.269131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:54:34.269131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:54:34.269131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:34.269131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:34.269131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:34.269131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:34.269131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:34.269131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:34.269131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:34.269131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:34.269131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:34.269131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:34.269131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:34.269131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:34.270310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:34.270310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:34.270310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:34.270310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:34.270310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:54:34.270310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:54:34.270310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:54:34.270310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:54:34.270310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:54:34.270310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:54:34.270310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:54:34.270310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:34.270310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 532/1087] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:54:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:34.275416 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d16d7-15d6-4605-aab3-fada863e6c03 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:34.337539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd8c0e-764b-4909-9d5c-b192dea0e8e4 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:34.337824 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd8c0e-764b-4909-9d5c-b192dea0e8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:34.338108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd8c0e-764b-4909-9d5c-b192dea0e8e4 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:34.339471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 533/1088] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:34.344616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a18dc5-9d23-44e3-9dde-a6d89f5fda92 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:34.344905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a18dc5-9d23-44e3-9dde-a6d89f5fda92 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:34.345182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a18dc5-9d23-44e3-9dde-a6d89f5fda92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:34.349257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:34.363565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-92a18dc5-9d23-44e3-9dde-a6d89f5fda92 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:34.364780 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-92a18dc5-9d23-44e3-9dde-a6d89f5fda92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:34.375979 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d16d7-15d6-4605-aab3-fada863e6c03 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:34.409901 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7638d-2020-4c0d-85c2-fbe9217f3ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:34.410568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7638d-2020-4c0d-85c2-fbe9217f3ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:34.410849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7638d-2020-4c0d-85c2-fbe9217f3ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:34.411132 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7638d-2020-4c0d-85c2-fbe9217f3ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:34.411904 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7638d-2020-4c0d-85c2-fbe9217f3ac0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:34.412208 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7638d-2020-4c0d-85c2-fbe9217f3ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:34.413562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7638d-2020-4c0d-85c2-fbe9217f3ac0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:34.422744 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 556/1089] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:54:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:34.428173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7638d-2020-4c0d-85c2-fbe9217f3ac0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:34.430858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 534/1090] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:34.454730 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a18dc5-9d23-44e3-9dde-a6d89f5fda92 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:34.533630 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7638d-2020-4c0d-85c2-fbe9217f3ac0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:34.556628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a18dc5-9d23-44e3-9dde-a6d89f5fda92 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:34.566103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59493b24-e848-4b8d-8374-3e07dbe9624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:34.566972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59493b24-e848-4b8d-8374-3e07dbe9624b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:34.567262 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59493b24-e848-4b8d-8374-3e07dbe9624b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:34.567546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59493b24-e848-4b8d-8374-3e07dbe9624b None admin] PATH_INFO: `/v3/users/92c9e7eaeddb4eb095abc0a699ad346f` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:34.568777 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59493b24-e848-4b8d-8374-3e07dbe9624b None admin] RBAC: Authorizing `identity:get_user(user_id=92c9e7eaeddb4eb095abc0a699ad346f)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:34.570198 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59493b24-e848-4b8d-8374-3e07dbe9624b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:34.572155 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 557/1091] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:54:34 2022] GET /identity/v3/users/92c9e7eaeddb4eb095abc0a699ad346f => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:34.578545 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59493b24-e848-4b8d-8374-3e07dbe9624b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:34.582414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:34.582856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:34.592846 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd8e4e-aef9-4bb5-aa7a-253052f66ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:34.593662 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd8e4e-aef9-4bb5-aa7a-253052f66ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:34.593944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd8e4e-aef9-4bb5-aa7a-253052f66ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:34.594218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd8e4e-aef9-4bb5-aa7a-253052f66ef3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:34.604384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd8e4e-aef9-4bb5-aa7a-253052f66ef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:54:34.612758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-9dbd8e4e-aef9-4bb5-aa7a-253052f66ef3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:54:34.612758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:34.612758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:34.612758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:34.612758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:34.612758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:34.612758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:34.612758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:34.612758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:34.612758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:34.612758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:34.612758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:34.612758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:54:34.612758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:54:34.612758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:54:34.612758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:54:34.613678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:54:34.613678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:54:34.613678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:54:34.613678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:54:34.613678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:34.613678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:34.613678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:34.613678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:34.613678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:34.613678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:34.613678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:34.613678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:34.613678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:34.613678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:34.613678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:34.613678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:34.614512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:34.614512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:34.614512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:34.614512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:34.614512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:54:34.614512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:54:34.614512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:54:34.614512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:54:34.614512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:54:34.614512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:54:34.614512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:54:34.614512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:34.614512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 535/1092] 10.222.0.41 () {56 vars in 1120 bytes} [Mon May 30 11:54:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:34.619896 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd8e4e-aef9-4bb5-aa7a-253052f66ef3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:34.681766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59493b24-e848-4b8d-8374-3e07dbe9624b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:34.719143 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830c6f2-61f9-4217-b50d-903bffbc409b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:34.719794 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830c6f2-61f9-4217-b50d-903bffbc409b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:34.720109 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830c6f2-61f9-4217-b50d-903bffbc409b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:34.720394 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830c6f2-61f9-4217-b50d-903bffbc409b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:34.721534 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd8e4e-aef9-4bb5-aa7a-253052f66ef3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:34.755841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc4ca0-d512-4b84-9cd2-33a24a19f4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:34.756528 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc4ca0-d512-4b84-9cd2-33a24a19f4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:34.756811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc4ca0-d512-4b84-9cd2-33a24a19f4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:34.757089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc4ca0-d512-4b84-9cd2-33a24a19f4e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:34.757834 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc4ca0-d512-4b84-9cd2-33a24a19f4e4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:34.758144 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc4ca0-d512-4b84-9cd2-33a24a19f4e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:34.759515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc4ca0-d512-4b84-9cd2-33a24a19f4e4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:34.768676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 536/1093] 10.222.0.41 () {56 vars in 1115 bytes} [Mon May 30 11:54:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:34.773868 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc4ca0-d512-4b84-9cd2-33a24a19f4e4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:34.798798 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830c6f2-61f9-4217-b50d-903bffbc409b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:34.800213 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830c6f2-61f9-4217-b50d-903bffbc409b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:34.806795 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:34.823491 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:34.875650 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc4ca0-d512-4b84-9cd2-33a24a19f4e4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:34.907962 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 558/1094] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:54:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 30 11:54:34.909148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e88bcb-84c0-471a-9e8f-36d62d958f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:34.909947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e88bcb-84c0-471a-9e8f-36d62d958f0a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:34.910233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e88bcb-84c0-471a-9e8f-36d62d958f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:34.910512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e88bcb-84c0-471a-9e8f-36d62d958f0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:34.913794 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830c6f2-61f9-4217-b50d-903bffbc409b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:34.922513 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e88bcb-84c0-471a-9e8f-36d62d958f0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:34.924140 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e88bcb-84c0-471a-9e8f-36d62d958f0a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:34.941553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-e2e88bcb-84c0-471a-9e8f-36d62d958f0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:34.941553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:34.941553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:34.941553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:34.941553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:34.941553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:34.941553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:34.941553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:34.941553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:34.941553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:34.941553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:34.941553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:34.941553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:54:34.941553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:54:34.941553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:54:34.942489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:54:34.942489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:34.942489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:34.942489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:34.942489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:34.942489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:34.942489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:34.942489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:34.942489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:34.942489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:34.942489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:34.942489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:34.942489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:34.942489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:34.942489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:34.942489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:34.942489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:34.943386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:54:34.943386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:54:34.943386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:34.943386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:34.943386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 537/1095] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:34.948378 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e88bcb-84c0-471a-9e8f-36d62d958f0a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:35.013618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830c6f2-61f9-4217-b50d-903bffbc409b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:35.016365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:35.046729 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:35.048091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa5cbe-9712-40e5-8448-a631c9351fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:35.049107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa5cbe-9712-40e5-8448-a631c9351fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:35.049336 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa5cbe-9712-40e5-8448-a631c9351fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:35.049617 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa5cbe-9712-40e5-8448-a631c9351fc1 None admin] PATH_INFO: `/v3/projects/a2c3407301f34ef781de0b9230439605` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:35.049723 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e88bcb-84c0-471a-9e8f-36d62d958f0a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:35.050814 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa5cbe-9712-40e5-8448-a631c9351fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c3407301f34ef781de0b9230439605)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:35.052287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa5cbe-9712-40e5-8448-a631c9351fc1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:35.053993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 559/1096] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:54:34 2022] GET /identity/v3/projects/a2c3407301f34ef781de0b9230439605 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:35.060534 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa5cbe-9712-40e5-8448-a631c9351fc1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:35.086410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45d914-78f6-4458-ab24-c704ca30280c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:35.087079 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45d914-78f6-4458-ab24-c704ca30280c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:35.087364 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45d914-78f6-4458-ab24-c704ca30280c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:35.087644 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45d914-78f6-4458-ab24-c704ca30280c None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:35.088395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45d914-78f6-4458-ab24-c704ca30280c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:35.088776 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45d914-78f6-4458-ab24-c704ca30280c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:35.090152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45d914-78f6-4458-ab24-c704ca30280c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:35.101796 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 538/1097] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:35.107903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45d914-78f6-4458-ab24-c704ca30280c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:35.162062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa5cbe-9712-40e5-8448-a631c9351fc1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:35.195328 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dba37-acd8-481f-a693-147a38a1da31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:35.196010 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dba37-acd8-481f-a693-147a38a1da31 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:35.196298 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dba37-acd8-481f-a693-147a38a1da31 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:35.196586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dba37-acd8-481f-a693-147a38a1da31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:35.197423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dba37-acd8-481f-a693-147a38a1da31 None admin] RBAC: Adding query filter params (role.id=8196ef570097443bac15d3cf39878486, scope.project.id=a2c3407301f34ef781de0b9230439605, user.id=92c9e7eaeddb4eb095abc0a699ad346f) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:35.197742 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dba37-acd8-481f-a693-147a38a1da31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:35.199180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dba37-acd8-481f-a693-147a38a1da31 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:35.205541 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 560/1098] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:54:35 2022] GET /identity/v3/role_assignments?user.id=92c9e7eaeddb4eb095abc0a699ad346f&scope.project.id=a2c3407301f34ef781de0b9230439605&role.id=8196ef570097443bac15d3cf39878486 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:35.206399 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45d914-78f6-4458-ab24-c704ca30280c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:35.244793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79080f13-7c6d-47f6-98f5-dd9d10a97f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:35.245859 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79080f13-7c6d-47f6-98f5-dd9d10a97f5a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:35.246143 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79080f13-7c6d-47f6-98f5-dd9d10a97f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:35.247023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79080f13-7c6d-47f6-98f5-dd9d10a97f5a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:35.255101 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79080f13-7c6d-47f6-98f5-dd9d10a97f5a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:35.256598 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79080f13-7c6d-47f6-98f5-dd9d10a97f5a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:35.272538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-79080f13-7c6d-47f6-98f5-dd9d10a97f5a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 30 11:54:35.272538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:35.272538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:35.272538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:35.272538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:35.272538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:35.272538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:35.272538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:35.272538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:35.272538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:35.272538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:35.272538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:35.272538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:54:35.272538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:54:35.272538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:54:35.272538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:54:35.273640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:35.273640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:35.273640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:54:35.273640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:54:35.273640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:54:35.273640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:54:35.273640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:35.273640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:35.273640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:35.273640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:35.273640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:35.273640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:35.273640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:35.273640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:35.273640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:35.273640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:35.273640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:35.273640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:35.274587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:35.274587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:35.274587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:54:35.274587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:54:35.274587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:54:35.274587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:54:35.274587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:54:35.274587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:54:35.274587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 30 11:54:35.274587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:35.275131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 539/1099] 10.222.0.41 () {56 vars in 1093 bytes} [Mon May 30 11:54:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:54:35.280543 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dba37-acd8-481f-a693-147a38a1da31 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:35.317900 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:35.389624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dba37-acd8-481f-a693-147a38a1da31 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:35.426471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75adcaf-6d96-43b2-99b1-59b2bdc9a527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:35.427143 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75adcaf-6d96-43b2-99b1-59b2bdc9a527 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:35.427425 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75adcaf-6d96-43b2-99b1-59b2bdc9a527 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:35.427704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75adcaf-6d96-43b2-99b1-59b2bdc9a527 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:35.428600 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75adcaf-6d96-43b2-99b1-59b2bdc9a527 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:35.428918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75adcaf-6d96-43b2-99b1-59b2bdc9a527 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:35.430323 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75adcaf-6d96-43b2-99b1-59b2bdc9a527 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:35.448857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 561/1100] 10.222.0.41 () {56 vars in 1133 bytes} [Mon May 30 11:54:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:35.454698 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79080f13-7c6d-47f6-98f5-dd9d10a97f5a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:35.480004 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:35.560000 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79080f13-7c6d-47f6-98f5-dd9d10a97f5a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:35.594968 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dd5cb-5006-4b91-b5b8-9db4ce99b38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:35.595543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dd5cb-5006-4b91-b5b8-9db4ce99b38f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:35.595835 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dd5cb-5006-4b91-b5b8-9db4ce99b38f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:35.596121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dd5cb-5006-4b91-b5b8-9db4ce99b38f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:35.663300 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053dd5cb-5006-4b91-b5b8-9db4ce99b38f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:35.664802 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053dd5cb-5006-4b91-b5b8-9db4ce99b38f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:35.685721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:35.764587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 540/1101] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:54:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:54:35.769812 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75adcaf-6d96-43b2-99b1-59b2bdc9a527 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:35.864261 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:35.871755 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75adcaf-6d96-43b2-99b1-59b2bdc9a527 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:35.905316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec23b1d-2638-42ca-859a-94eeb2cc9056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:35.906099 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec23b1d-2638-42ca-859a-94eeb2cc9056 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:35.906382 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec23b1d-2638-42ca-859a-94eeb2cc9056 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:35.906660 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec23b1d-2638-42ca-859a-94eeb2cc9056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:35.916641 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec23b1d-2638-42ca-859a-94eeb2cc9056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:35.918080 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec23b1d-2638-42ca-859a-94eeb2cc9056 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:35.935243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-3ec23b1d-2638-42ca-859a-94eeb2cc9056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:35.935243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:35.935243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:35.935243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:35.935243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:35.935243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:35.935243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:35.935243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:35.935243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:35.935243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:35.935243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:35.935243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:35.935243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:54:35.935243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:54:35.935243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:54:35.936177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:54:35.936177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:35.936177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:35.936177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:35.936177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:35.936177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:35.936177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:35.936177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:35.936177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:35.936177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:35.936177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:35.936177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:35.936177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:35.936177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:35.936177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:35.936177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:35.936177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:35.937054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:54:35.937054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:54:35.937054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:54:35.937054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:35.937054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 562/1102] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:35.942166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dd5cb-5006-4b91-b5b8-9db4ce99b38f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:36.040556 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dd5cb-5006-4b91-b5b8-9db4ce99b38f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:36.060435 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:36.075645 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b7978-c609-40fb-980f-74d0277777c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:36.076346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b7978-c609-40fb-980f-74d0277777c9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:36.076633 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b7978-c609-40fb-980f-74d0277777c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:36.076913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b7978-c609-40fb-980f-74d0277777c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:36.077639 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b7978-c609-40fb-980f-74d0277777c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:36.077949 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b7978-c609-40fb-980f-74d0277777c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:36.079331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b7978-c609-40fb-980f-74d0277777c9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:36.091294 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 541/1103] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:36.096959 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec23b1d-2638-42ca-859a-94eeb2cc9056 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:36.193454 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec23b1d-2638-42ca-859a-94eeb2cc9056 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:36.226848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61338978-bd22-4102-beb6-ca37b442b37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:36.227630 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61338978-bd22-4102-beb6-ca37b442b37c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:36.227943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61338978-bd22-4102-beb6-ca37b442b37c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:36.228225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61338978-bd22-4102-beb6-ca37b442b37c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:36.234756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61338978-bd22-4102-beb6-ca37b442b37c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:36.236211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61338978-bd22-4102-beb6-ca37b442b37c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:36.250302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-61338978-bd22-4102-beb6-ca37b442b37c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:54:36.250302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:36.250302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:36.250302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:36.250302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:36.250302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:36.250302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:36.250302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:36.250302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:36.250302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:36.250302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:36.250302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:36.250302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:54:36.250302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:54:36.250302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:54:36.251329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:54:36.251329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:36.251329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:36.251329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:36.251329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:36.251329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:36.251329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:36.251329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:36.251329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:54:36.251329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:36.251329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:36.251329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:36.251329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:36.251329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:36.251329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:36.251329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:36.251329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:36.252503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:54:36.252503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:54:36.252503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:54:36.252503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:54:36.252503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:54:36.252503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:54:36.252503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:54:36.252503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:54:36.252503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 563/1104] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:54:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:36.257183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b7978-c609-40fb-980f-74d0277777c9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:36.353784 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b7978-c609-40fb-980f-74d0277777c9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:36.389165 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11c93b-c554-465e-a9b3-6f98e90e4381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:36.389828 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11c93b-c554-465e-a9b3-6f98e90e4381 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:36.390114 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11c93b-c554-465e-a9b3-6f98e90e4381 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:36.390391 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11c93b-c554-465e-a9b3-6f98e90e4381 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:36.391173 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11c93b-c554-465e-a9b3-6f98e90e4381 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:36.391485 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11c93b-c554-465e-a9b3-6f98e90e4381 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:36.392999 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11c93b-c554-465e-a9b3-6f98e90e4381 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:36.405513 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 542/1105] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:54:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:36.411484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61338978-bd22-4102-beb6-ca37b442b37c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:36.421389 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:36.511137 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61338978-bd22-4102-beb6-ca37b442b37c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:36.543912 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2e846-4b5a-46e4-8113-be5a49517a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:36.544557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2e846-4b5a-46e4-8113-be5a49517a2c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:36.544842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2e846-4b5a-46e4-8113-be5a49517a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:36.545120 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2e846-4b5a-46e4-8113-be5a49517a2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:36.545963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2e846-4b5a-46e4-8113-be5a49517a2c None admin] RBAC: Adding query filter params (role.id=f22986e64f7e44279ed898fdf581a644, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=bb3820a613744c15b840681fe6b6e808) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:36.546280 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2e846-4b5a-46e4-8113-be5a49517a2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:36.547707 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2e846-4b5a-46e4-8113-be5a49517a2c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:36.553423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 564/1106] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:54:36 2022] GET /identity/v3/role_assignments?user.id=bb3820a613744c15b840681fe6b6e808&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=f22986e64f7e44279ed898fdf581a644 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:54:37.515945 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d233e9-fc58-4796-b91a-2ed568607eda None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:37.516468 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d233e9-fc58-4796-b91a-2ed568607eda None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:37.516586 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d233e9-fc58-4796-b91a-2ed568607eda None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:37.517863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 543/1107] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:37.523143 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01445d-24b5-4f30-bdd8-c51838e64586 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:37.523540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01445d-24b5-4f30-bdd8-c51838e64586 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:37.523701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01445d-24b5-4f30-bdd8-c51838e64586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:37.540193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-4d01445d-24b5-4f30-bdd8-c51838e64586 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:37.541358 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4d01445d-24b5-4f30-bdd8-c51838e64586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:37.601031 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:37.606252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 565/1108] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:37.631164 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d233e9-fc58-4796-b91a-2ed568607eda None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:37.672937 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:37.729419 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d233e9-fc58-4796-b91a-2ed568607eda None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:37.762244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49387e72-cdd7-4d9f-8103-13cdf4219248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:37.763025 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49387e72-cdd7-4d9f-8103-13cdf4219248 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:37.763308 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49387e72-cdd7-4d9f-8103-13cdf4219248 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:37.763582 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49387e72-cdd7-4d9f-8103-13cdf4219248 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:37.764815 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49387e72-cdd7-4d9f-8103-13cdf4219248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:37.766309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49387e72-cdd7-4d9f-8103-13cdf4219248 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:37.767898 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 544/1109] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:37.773611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01445d-24b5-4f30-bdd8-c51838e64586 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:37.870882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01445d-24b5-4f30-bdd8-c51838e64586 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:37.903593 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8713c32-5c95-44cf-ad85-3a53a4cfd71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:37.904282 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8713c32-5c95-44cf-ad85-3a53a4cfd71c None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:37.904568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8713c32-5c95-44cf-ad85-3a53a4cfd71c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:37.904846 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8713c32-5c95-44cf-ad85-3a53a4cfd71c None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:37.905568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8713c32-5c95-44cf-ad85-3a53a4cfd71c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:37.906983 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8713c32-5c95-44cf-ad85-3a53a4cfd71c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:37.927240 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 566/1110] 10.222.0.41 () {60 vars in 1132 bytes} [Mon May 30 11:54:37 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:54:40.192567 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0c57c-b4d8-4528-84ad-1b518526d693 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:40.193125 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0c57c-b4d8-4528-84ad-1b518526d693 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:40.193125 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0c57c-b4d8-4528-84ad-1b518526d693 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:40.194494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 545/1111] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:40.199738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd4301-365b-48e8-96ce-258594927c74 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:40.200165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd4301-365b-48e8-96ce-258594927c74 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:40.200340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd4301-365b-48e8-96ce-258594927c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:40.217162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8cbd4301-365b-48e8-96ce-258594927c74 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:40.218335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8cbd4301-365b-48e8-96ce-258594927c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:40.267213 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:40.285272 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 567/1112] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:40.309911 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0c57c-b4d8-4528-84ad-1b518526d693 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:40.410276 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0c57c-b4d8-4528-84ad-1b518526d693 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:40.419344 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:40.444249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85fb59-2c1d-46bc-9342-3e642810cd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:40.445036 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85fb59-2c1d-46bc-9342-3e642810cd73 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:40.445324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85fb59-2c1d-46bc-9342-3e642810cd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:40.445606 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85fb59-2c1d-46bc-9342-3e642810cd73 None admin] PATH_INFO: `/v3/roles/d50989dd2d24440f9724d5d7975df7cf` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:40.447075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85fb59-2c1d-46bc-9342-3e642810cd73 None admin] RBAC: Authorizing `identity:get_role(role_id=d50989dd2d24440f9724d5d7975df7cf)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:40.448485 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85fb59-2c1d-46bc-9342-3e642810cd73 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:40.450392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 546/1113] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:54:40 2022] GET /identity/v3/roles/d50989dd2d24440f9724d5d7975df7cf => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:40.456107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd4301-365b-48e8-96ce-258594927c74 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:40.554605 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd4301-365b-48e8-96ce-258594927c74 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:40.587445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aa22a-1bc1-40db-a967-384f103a965d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:40.588329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aa22a-1bc1-40db-a967-384f103a965d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:40.588618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aa22a-1bc1-40db-a967-384f103a965d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:40.588899 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aa22a-1bc1-40db-a967-384f103a965d None admin] PATH_INFO: `/v3/users/b2efd6b5fccd4befbb797ebc48446fbb` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:40.602325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295aa22a-1bc1-40db-a967-384f103a965d None admin] RBAC: Authorizing `identity:get_user(user_id=b2efd6b5fccd4befbb797ebc48446fbb)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:40.603761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295aa22a-1bc1-40db-a967-384f103a965d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:40.605490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 568/1114] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:54:40 2022] GET /identity/v3/users/b2efd6b5fccd4befbb797ebc48446fbb => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:40.611202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85fb59-2c1d-46bc-9342-3e642810cd73 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:40.707673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85fb59-2c1d-46bc-9342-3e642810cd73 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:40.740273 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465dbb4-50e5-44d9-97ce-67057213cee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:40.740907 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465dbb4-50e5-44d9-97ce-67057213cee9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:40.741187 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465dbb4-50e5-44d9-97ce-67057213cee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:40.741462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465dbb4-50e5-44d9-97ce-67057213cee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:40.787365 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:40.810383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465dbb4-50e5-44d9-97ce-67057213cee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:40.811850 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465dbb4-50e5-44d9-97ce-67057213cee9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:40.907643 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 547/1115] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:54:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:54:40.913544 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aa22a-1bc1-40db-a967-384f103a965d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:40.958598 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:41.013169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aa22a-1bc1-40db-a967-384f103a965d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:41.046732 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abfd12-ec83-415b-b2c5-9a40a70c32d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:41.047567 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abfd12-ec83-415b-b2c5-9a40a70c32d9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:41.047871 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abfd12-ec83-415b-b2c5-9a40a70c32d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:41.048147 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abfd12-ec83-415b-b2c5-9a40a70c32d9 None admin] PATH_INFO: `/v3/projects/a2c3407301f34ef781de0b9230439605` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:41.049299 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abfd12-ec83-415b-b2c5-9a40a70c32d9 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c3407301f34ef781de0b9230439605)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:41.050707 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abfd12-ec83-415b-b2c5-9a40a70c32d9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:41.052392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 569/1116] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:54:40 2022] GET /identity/v3/projects/a2c3407301f34ef781de0b9230439605 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:41.058440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465dbb4-50e5-44d9-97ce-67057213cee9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:41.132217 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:41.155925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465dbb4-50e5-44d9-97ce-67057213cee9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:41.188533 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f1251-b6b0-45ea-b048-678f19fde7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:41.189179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f1251-b6b0-45ea-b048-678f19fde7cc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:41.189467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f1251-b6b0-45ea-b048-678f19fde7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:41.189745 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f1251-b6b0-45ea-b048-678f19fde7cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:41.190570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f1251-b6b0-45ea-b048-678f19fde7cc None admin] RBAC: Adding query filter params (role.id=d50989dd2d24440f9724d5d7975df7cf, scope.project.id=a2c3407301f34ef781de0b9230439605, user.id=b2efd6b5fccd4befbb797ebc48446fbb) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:41.190884 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f1251-b6b0-45ea-b048-678f19fde7cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:41.192361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f1251-b6b0-45ea-b048-678f19fde7cc None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:41.197613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 548/1117] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:54:41 2022] GET /identity/v3/role_assignments?user.id=b2efd6b5fccd4befbb797ebc48446fbb&scope.project.id=a2c3407301f34ef781de0b9230439605&role.id=d50989dd2d24440f9724d5d7975df7cf => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:43.412705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98de9c-94e1-4430-9636-e65b510ed72a None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:43.413257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98de9c-94e1-4430-9636-e65b510ed72a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:43.413257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98de9c-94e1-4430-9636-e65b510ed72a None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:43.414618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 570/1118] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:43.420670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dcadc-f011-4a4e-9815-cdf8b6bde72d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:43.421169 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dcadc-f011-4a4e-9815-cdf8b6bde72d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:43.421266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dcadc-f011-4a4e-9815-cdf8b6bde72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:43.438514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6d2dcadc-f011-4a4e-9815-cdf8b6bde72d None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:43.439700 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6d2dcadc-f011-4a4e-9815-cdf8b6bde72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:43.505377 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 549/1119] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:43.528847 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98de9c-94e1-4430-9636-e65b510ed72a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:43.629473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98de9c-94e1-4430-9636-e65b510ed72a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:43.642394 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:43.663481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01199d-c236-44f4-af37-cd9b9c2985ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:43.664290 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01199d-c236-44f4-af37-cd9b9c2985ab None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:43.664577 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01199d-c236-44f4-af37-cd9b9c2985ab None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:43.664858 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01199d-c236-44f4-af37-cd9b9c2985ab None admin] PATH_INFO: `/v3/roles/d50989dd2d24440f9724d5d7975df7cf` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:43.666411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01199d-c236-44f4-af37-cd9b9c2985ab None admin] RBAC: Authorizing `identity:get_role(role_id=d50989dd2d24440f9724d5d7975df7cf)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:43.668266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01199d-c236-44f4-af37-cd9b9c2985ab None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:43.669729 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 571/1120] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:54:43 2022] GET /identity/v3/roles/d50989dd2d24440f9724d5d7975df7cf => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:43.675398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dcadc-f011-4a4e-9815-cdf8b6bde72d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:43.743150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:43.775093 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dcadc-f011-4a4e-9815-cdf8b6bde72d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:43.809308 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5b9d3-8b9c-45f7-94e7-22f2d7929954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:43.810175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5b9d3-8b9c-45f7-94e7-22f2d7929954 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:43.810464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5b9d3-8b9c-45f7-94e7-22f2d7929954 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:43.810743 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5b9d3-8b9c-45f7-94e7-22f2d7929954 None admin] PATH_INFO: `/v3/users/b2efd6b5fccd4befbb797ebc48446fbb` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:43.811952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5b9d3-8b9c-45f7-94e7-22f2d7929954 None admin] RBAC: Authorizing `identity:get_user(user_id=b2efd6b5fccd4befbb797ebc48446fbb)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:43.813394 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5b9d3-8b9c-45f7-94e7-22f2d7929954 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:43.815054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 550/1121] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:54:43 2022] GET /identity/v3/users/b2efd6b5fccd4befbb797ebc48446fbb => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:43.820919 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01199d-c236-44f4-af37-cd9b9c2985ab None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:43.918577 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01199d-c236-44f4-af37-cd9b9c2985ab None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:43.952174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0f162-5709-4e04-bf08-facee1c6bf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:43.953011 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0f162-5709-4e04-bf08-facee1c6bf16 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:43.953293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0f162-5709-4e04-bf08-facee1c6bf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:43.953566 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0f162-5709-4e04-bf08-facee1c6bf16 None admin] PATH_INFO: `/v3/projects/a2c3407301f34ef781de0b9230439605` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:43.954718 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0f162-5709-4e04-bf08-facee1c6bf16 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c3407301f34ef781de0b9230439605)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:43.956150 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0f162-5709-4e04-bf08-facee1c6bf16 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:43.957779 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 572/1122] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:54:43 2022] GET /identity/v3/projects/a2c3407301f34ef781de0b9230439605 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:43.963568 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5b9d3-8b9c-45f7-94e7-22f2d7929954 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:44.061256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5b9d3-8b9c-45f7-94e7-22f2d7929954 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:44.094541 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e70a5d-8429-451a-94fc-d4ebbd945a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:44.095413 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e70a5d-8429-451a-94fc-d4ebbd945a39 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:44.095698 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e70a5d-8429-451a-94fc-d4ebbd945a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:44.096014 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e70a5d-8429-451a-94fc-d4ebbd945a39 None admin] PATH_INFO: `/v3/projects/a2c3407301f34ef781de0b9230439605/users/b2efd6b5fccd4befbb797ebc48446fbb/roles/d50989dd2d24440f9724d5d7975df7cf` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:44.098280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e70a5d-8429-451a-94fc-d4ebbd945a39 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2c3407301f34ef781de0b9230439605, user_id=b2efd6b5fccd4befbb797ebc48446fbb, role_id=d50989dd2d24440f9724d5d7975df7cf)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:44.099710 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e70a5d-8429-451a-94fc-d4ebbd945a39 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:44.108508 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:44.115356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 551/1123] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:54:43 2022] PUT /identity/v3/projects/a2c3407301f34ef781de0b9230439605/users/b2efd6b5fccd4befbb797ebc48446fbb/roles/d50989dd2d24440f9724d5d7975df7cf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:54:46.336103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0729080-6870-4515-b848-65b26324afe4 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:46.336624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0729080-6870-4515-b848-65b26324afe4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:46.336717 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0729080-6870-4515-b848-65b26324afe4 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:46.338035 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 573/1124] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:46.344076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ed80d-6cec-4287-b7fa-5a4f19472831 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:46.344443 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ed80d-6cec-4287-b7fa-5a4f19472831 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:46.344639 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ed80d-6cec-4287-b7fa-5a4f19472831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:46.361529 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7a7ed80d-6cec-4287-b7fa-5a4f19472831 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:46.362723 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7a7ed80d-6cec-4287-b7fa-5a4f19472831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:46.428545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 552/1125] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:46.452557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0729080-6870-4515-b848-65b26324afe4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:46.502924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:46.553240 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0729080-6870-4515-b848-65b26324afe4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:46.586499 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f9d55-9b6f-4164-9c96-5646c7dbff1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:46.587279 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f9d55-9b6f-4164-9c96-5646c7dbff1a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:46.587556 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f9d55-9b6f-4164-9c96-5646c7dbff1a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:46.587849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f9d55-9b6f-4164-9c96-5646c7dbff1a None admin] PATH_INFO: `/v3/roles/d50989dd2d24440f9724d5d7975df7cf` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:46.589295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f9d55-9b6f-4164-9c96-5646c7dbff1a None admin] RBAC: Authorizing `identity:get_role(role_id=d50989dd2d24440f9724d5d7975df7cf)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:46.591213 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f9d55-9b6f-4164-9c96-5646c7dbff1a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:46.592582 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 574/1126] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:54:46 2022] GET /identity/v3/roles/d50989dd2d24440f9724d5d7975df7cf => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:46.598274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ed80d-6cec-4287-b7fa-5a4f19472831 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:46.695956 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ed80d-6cec-4287-b7fa-5a4f19472831 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:46.721730 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:46.730168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecd030-80df-4a4a-b1e5-d1a89c9bafcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:46.731553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecd030-80df-4a4a-b1e5-d1a89c9bafcf None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:46.731860 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecd030-80df-4a4a-b1e5-d1a89c9bafcf None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:46.732144 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecd030-80df-4a4a-b1e5-d1a89c9bafcf None admin] PATH_INFO: `/v3/users/b2efd6b5fccd4befbb797ebc48446fbb` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:46.733327 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecd030-80df-4a4a-b1e5-d1a89c9bafcf None admin] RBAC: Authorizing `identity:get_user(user_id=b2efd6b5fccd4befbb797ebc48446fbb)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:46.734770 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecd030-80df-4a4a-b1e5-d1a89c9bafcf None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:46.736418 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 553/1127] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:54:46 2022] GET /identity/v3/users/b2efd6b5fccd4befbb797ebc48446fbb => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:46.742063 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f9d55-9b6f-4164-9c96-5646c7dbff1a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:46.845259 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f9d55-9b6f-4164-9c96-5646c7dbff1a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:46.861571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:46.879725 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b4834-befe-42e6-b61b-bede78262437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:46.880404 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b4834-befe-42e6-b61b-bede78262437 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:46.880692 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b4834-befe-42e6-b61b-bede78262437 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:46.880972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b4834-befe-42e6-b61b-bede78262437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:46.946563 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b4834-befe-42e6-b61b-bede78262437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:46.948033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b4834-befe-42e6-b61b-bede78262437 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:47.045155 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 575/1128] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:54:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:54:47.051065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecd030-80df-4a4a-b1e5-d1a89c9bafcf None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:47.147630 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecd030-80df-4a4a-b1e5-d1a89c9bafcf None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:47.180279 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e84b0f-046b-4eca-9911-be30002fb670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:47.181122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e84b0f-046b-4eca-9911-be30002fb670 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:47.181404 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e84b0f-046b-4eca-9911-be30002fb670 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:47.181683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e84b0f-046b-4eca-9911-be30002fb670 None admin] PATH_INFO: `/v3/projects/a2c3407301f34ef781de0b9230439605` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:47.182840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e84b0f-046b-4eca-9911-be30002fb670 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c3407301f34ef781de0b9230439605)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:47.184495 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e84b0f-046b-4eca-9911-be30002fb670 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:47.186154 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 554/1129] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:54:47 2022] GET /identity/v3/projects/a2c3407301f34ef781de0b9230439605 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:47.192099 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b4834-befe-42e6-b61b-bede78262437 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:47.209361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:47.290361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b4834-befe-42e6-b61b-bede78262437 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:47.322680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78586f0f-8b06-4ec7-a1ed-c6b2db7cad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:47.323324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78586f0f-8b06-4ec7-a1ed-c6b2db7cad83 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:47.323610 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78586f0f-8b06-4ec7-a1ed-c6b2db7cad83 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:47.324446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78586f0f-8b06-4ec7-a1ed-c6b2db7cad83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:47.325285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78586f0f-8b06-4ec7-a1ed-c6b2db7cad83 None admin] RBAC: Adding query filter params (role.id=d50989dd2d24440f9724d5d7975df7cf, scope.project.id=a2c3407301f34ef781de0b9230439605, user.id=b2efd6b5fccd4befbb797ebc48446fbb) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:47.325604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78586f0f-8b06-4ec7-a1ed-c6b2db7cad83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:47.327034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78586f0f-8b06-4ec7-a1ed-c6b2db7cad83 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:47.332823 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 576/1130] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:54:47 2022] GET /identity/v3/role_assignments?user.id=b2efd6b5fccd4befbb797ebc48446fbb&scope.project.id=a2c3407301f34ef781de0b9230439605&role.id=d50989dd2d24440f9724d5d7975df7cf => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:49.676721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe6c37-c08c-48ec-955c-0c7c55997cf0 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:49.677234 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe6c37-c08c-48ec-955c-0c7c55997cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:49.677319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe6c37-c08c-48ec-955c-0c7c55997cf0 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:49.678687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 555/1131] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:49.684448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1876f6-237d-4143-baec-36885f25880b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:49.684878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1876f6-237d-4143-baec-36885f25880b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:49.685007 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1876f6-237d-4143-baec-36885f25880b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:49.701433 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3a1876f6-237d-4143-baec-36885f25880b None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:49.702628 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3a1876f6-237d-4143-baec-36885f25880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:49.769373 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 577/1132] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:49.791553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe6c37-c08c-48ec-955c-0c7c55997cf0 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:49.852808 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:49.891131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe6c37-c08c-48ec-955c-0c7c55997cf0 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:49.923781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e73fe3-25fd-46a3-ae0a-e3964c124771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:49.924585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e73fe3-25fd-46a3-ae0a-e3964c124771 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:49.924867 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e73fe3-25fd-46a3-ae0a-e3964c124771 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:49.925141 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e73fe3-25fd-46a3-ae0a-e3964c124771 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:49.926291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e73fe3-25fd-46a3-ae0a-e3964c124771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:49.927766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e73fe3-25fd-46a3-ae0a-e3964c124771 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:49.929339 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 556/1133] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:49.935925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1876f6-237d-4143-baec-36885f25880b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:49.947396 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:50.033971 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1876f6-237d-4143-baec-36885f25880b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:50.067064 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbe33d-1562-4c09-97f3-b2e5f544ec85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:50.067721 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbe33d-1562-4c09-97f3-b2e5f544ec85 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:50.068036 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbe33d-1562-4c09-97f3-b2e5f544ec85 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:50.068317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbe33d-1562-4c09-97f3-b2e5f544ec85 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:50.069044 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbe33d-1562-4c09-97f3-b2e5f544ec85 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:50.070481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbe33d-1562-4c09-97f3-b2e5f544ec85 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:50.095478 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 578/1134] 10.222.0.41 () {60 vars in 1141 bytes} [Mon May 30 11:54:49 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:54:52.389709 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d1bdf-24b6-41b4-805a-d7998facfa27 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:52.390233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d1bdf-24b6-41b4-805a-d7998facfa27 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:52.390364 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d1bdf-24b6-41b4-805a-d7998facfa27 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:52.391638 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 557/1135] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:52.397019 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1f515-60ae-45d3-8d48-2c6a3c35ad78 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:52.397413 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1f515-60ae-45d3-8d48-2c6a3c35ad78 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:52.397590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1f515-60ae-45d3-8d48-2c6a3c35ad78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:52.414082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a4d1f515-60ae-45d3-8d48-2c6a3c35ad78 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:52.415268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a4d1f515-60ae-45d3-8d48-2c6a3c35ad78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:52.469924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:52.481903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 579/1136] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:52.507149 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d1bdf-24b6-41b4-805a-d7998facfa27 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:52.606379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d1bdf-24b6-41b4-805a-d7998facfa27 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:52.635193 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:52.640680 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0cceb-4bc9-4e8b-a7c7-bbf195a35361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:52.641405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0cceb-4bc9-4e8b-a7c7-bbf195a35361 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:52.641690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0cceb-4bc9-4e8b-a7c7-bbf195a35361 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:52.641964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0cceb-4bc9-4e8b-a7c7-bbf195a35361 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:52.643131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0cceb-4bc9-4e8b-a7c7-bbf195a35361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:52.644601 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0cceb-4bc9-4e8b-a7c7-bbf195a35361 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:52.646208 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 558/1137] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:54:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:52.651843 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1f515-60ae-45d3-8d48-2c6a3c35ad78 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:52.749088 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1f515-60ae-45d3-8d48-2c6a3c35ad78 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:52.783259 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91103070-301f-482a-b847-007d4a85f0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:52.783968 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91103070-301f-482a-b847-007d4a85f0ae None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:52.784256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91103070-301f-482a-b847-007d4a85f0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:52.784536 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91103070-301f-482a-b847-007d4a85f0ae None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:52.785352 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91103070-301f-482a-b847-007d4a85f0ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:52.786784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91103070-301f-482a-b847-007d4a85f0ae None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:52.807345 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 580/1138] 10.222.0.41 () {60 vars in 1132 bytes} [Mon May 30 11:54:52 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:54:55.115556 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1c927-9ad1-48e6-81d0-d9dd1b94f3d0 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:55.116088 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1c927-9ad1-48e6-81d0-d9dd1b94f3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:55.116088 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1c927-9ad1-48e6-81d0-d9dd1b94f3d0 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:55.117443 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 559/1139] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:55.123085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5812a3a-f2de-4cbb-974a-5728c74323cd None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:55.123463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5812a3a-f2de-4cbb-974a-5728c74323cd None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:55.123656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5812a3a-f2de-4cbb-974a-5728c74323cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:55.140159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c5812a3a-f2de-4cbb-974a-5728c74323cd None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:55.141347 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c5812a3a-f2de-4cbb-974a-5728c74323cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:55.184103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:55.208394 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 581/1140] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:55.232737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1c927-9ad1-48e6-81d0-d9dd1b94f3d0 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:55.332394 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1c927-9ad1-48e6-81d0-d9dd1b94f3d0 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:55.365123 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b2399-de4b-4bd2-b8ad-8bc6125dd0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:55.365956 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b2399-de4b-4bd2-b8ad-8bc6125dd0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:55.366187 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b2399-de4b-4bd2-b8ad-8bc6125dd0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:55.366467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b2399-de4b-4bd2-b8ad-8bc6125dd0a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:55.377328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b2399-de4b-4bd2-b8ad-8bc6125dd0a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:54:55.385045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-355b2399-de4b-4bd2-b8ad-8bc6125dd0a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:54:55.385045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:55.385045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:55.385045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:55.385045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:55.385045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:55.385045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:55.385045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:55.385045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:55.385045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:55.385045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:55.385045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:55.385045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:54:55.385045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:54:55.385045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:54:55.385045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:54:55.385939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:54:55.385939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:54:55.385939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:54:55.385939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:54:55.385939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:55.385939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:55.385939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:55.385939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:55.385939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:55.385939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:55.385939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:55.385939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:55.385939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:55.385939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:55.385939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:55.385939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:55.386875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:55.386875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:55.386875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:55.386875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:55.386875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:54:55.386875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:54:55.386875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:54:55.386875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:54:55.386875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:54:55.386875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:54:55.386875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:54:55.386875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:55.386875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 560/1141] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:54:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:55.392234 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5812a3a-f2de-4cbb-974a-5728c74323cd None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:55.487368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5812a3a-f2de-4cbb-974a-5728c74323cd None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:55.520266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7033e-fbad-42f1-89f1-d06d1467fffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:55.520916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7033e-fbad-42f1-89f1-d06d1467fffc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:55.521198 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7033e-fbad-42f1-89f1-d06d1467fffc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:55.521473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7033e-fbad-42f1-89f1-d06d1467fffc None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:55.522213 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7033e-fbad-42f1-89f1-d06d1467fffc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:55.522518 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7033e-fbad-42f1-89f1-d06d1467fffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:55.523887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7033e-fbad-42f1-89f1-d06d1467fffc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:55.531656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 582/1142] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:54:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:55.537396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b2399-de4b-4bd2-b8ad-8bc6125dd0a6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:55.596390 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:55.639046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b2399-de4b-4bd2-b8ad-8bc6125dd0a6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:55.671357 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0678ca-ea63-4151-aa2d-b10681ac131d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:55.672254 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0678ca-ea63-4151-aa2d-b10681ac131d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:55.672538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0678ca-ea63-4151-aa2d-b10681ac131d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:55.672810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0678ca-ea63-4151-aa2d-b10681ac131d None admin] PATH_INFO: `/v3/users/a6384dd9b69c4347b9e49787386cc7e0` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:55.686738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0678ca-ea63-4151-aa2d-b10681ac131d None admin] RBAC: Authorizing `identity:get_user(user_id=a6384dd9b69c4347b9e49787386cc7e0)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:55.688258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0678ca-ea63-4151-aa2d-b10681ac131d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:55.689918 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 561/1143] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:54:55 2022] GET /identity/v3/users/a6384dd9b69c4347b9e49787386cc7e0 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:55.695683 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7033e-fbad-42f1-89f1-d06d1467fffc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:55.738145 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:55.796180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7033e-fbad-42f1-89f1-d06d1467fffc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:55.828519 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd1ef5-eaf7-4591-85c1-6fd5008de987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:55.829156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd1ef5-eaf7-4591-85c1-6fd5008de987 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:55.829439 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd1ef5-eaf7-4591-85c1-6fd5008de987 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:55.829711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd1ef5-eaf7-4591-85c1-6fd5008de987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:55.895801 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd1ef5-eaf7-4591-85c1-6fd5008de987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:55.897261 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd1ef5-eaf7-4591-85c1-6fd5008de987 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:55.936861 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:55.993635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 583/1144] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:54:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:54:56.000343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0678ca-ea63-4151-aa2d-b10681ac131d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:56.096448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0678ca-ea63-4151-aa2d-b10681ac131d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:56.113297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:56.131256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de293034-5836-47dd-bd1b-abee40d652ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:56.132130 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de293034-5836-47dd-bd1b-abee40d652ae None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:56.132412 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de293034-5836-47dd-bd1b-abee40d652ae None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:56.132682 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de293034-5836-47dd-bd1b-abee40d652ae None admin] PATH_INFO: `/v3/projects/cd68155272bc4d8b91e62212c1082692` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:56.133844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de293034-5836-47dd-bd1b-abee40d652ae None admin] RBAC: Authorizing `identity:get_project(project_id=cd68155272bc4d8b91e62212c1082692)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:56.135271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de293034-5836-47dd-bd1b-abee40d652ae None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:56.137223 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 562/1145] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:54:55 2022] GET /identity/v3/projects/cd68155272bc4d8b91e62212c1082692 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:56.143233 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd1ef5-eaf7-4591-85c1-6fd5008de987 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:56.239217 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd1ef5-eaf7-4591-85c1-6fd5008de987 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:56.272319 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae055b-8814-46ae-a527-ee8f71d8458b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:56.272960 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae055b-8814-46ae-a527-ee8f71d8458b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:56.273245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae055b-8814-46ae-a527-ee8f71d8458b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:56.273521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae055b-8814-46ae-a527-ee8f71d8458b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:56.274352 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae055b-8814-46ae-a527-ee8f71d8458b None admin] RBAC: Adding query filter params (role.id=8196ef570097443bac15d3cf39878486, scope.project.id=cd68155272bc4d8b91e62212c1082692, user.id=a6384dd9b69c4347b9e49787386cc7e0) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:56.274665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae055b-8814-46ae-a527-ee8f71d8458b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:56.276105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae055b-8814-46ae-a527-ee8f71d8458b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:56.281475 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 584/1146] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:54:56 2022] GET /identity/v3/role_assignments?user.id=a6384dd9b69c4347b9e49787386cc7e0&scope.project.id=cd68155272bc4d8b91e62212c1082692&role.id=8196ef570097443bac15d3cf39878486 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:58.500615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ed71b-f216-4dc2-8532-3ea211ec0267 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:58.501164 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ed71b-f216-4dc2-8532-3ea211ec0267 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:58.501164 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ed71b-f216-4dc2-8532-3ea211ec0267 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:58.502537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 563/1147] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:54:58.507693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61316f9d-d1a6-4123-8da9-6450ff8d8432 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:58.508145 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61316f9d-d1a6-4123-8da9-6450ff8d8432 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:58.508295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61316f9d-d1a6-4123-8da9-6450ff8d8432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:58.514966 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:58.526346 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-61316f9d-d1a6-4123-8da9-6450ff8d8432 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:54:58.528714 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-61316f9d-d1a6-4123-8da9-6450ff8d8432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:54:58.596900 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 585/1148] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:54:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:54:58.622880 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ed71b-f216-4dc2-8532-3ea211ec0267 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:58.721929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ed71b-f216-4dc2-8532-3ea211ec0267 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:58.755214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f68dda-e2e9-478a-9460-5308a63e61cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:58.755968 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f68dda-e2e9-478a-9460-5308a63e61cd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:58.756256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f68dda-e2e9-478a-9460-5308a63e61cd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:58.756532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f68dda-e2e9-478a-9460-5308a63e61cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:58.766545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f68dda-e2e9-478a-9460-5308a63e61cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:54:58.774214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d5f68dda-e2e9-478a-9460-5308a63e61cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:54:58.774214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:54:58.774214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:54:58.774214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:54:58.774214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:54:58.774214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:54:58.774214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:54:58.774214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:54:58.774214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:54:58.774214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:54:58.774214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:54:58.774214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:54:58.774214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:54:58.774214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:54:58.774214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:54:58.774214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:54:58.775395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:54:58.775395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:54:58.775395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:54:58.775395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:54:58.775395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:54:58.775395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:54:58.775395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:54:58.775395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:54:58.775395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:54:58.775395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:54:58.775395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:54:58.775395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:54:58.775395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:54:58.775395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:54:58.775395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:54:58.775395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:54:58.777151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:54:58.777151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:54:58.777151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:54:58.777151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:54:58.777151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:54:58.777151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:54:58.777151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:54:58.777151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:54:58.777151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:54:58.777151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:54:58.777151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:54:58.777151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:54:58.777151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 564/1149] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:54:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:54:58.781906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61316f9d-d1a6-4123-8da9-6450ff8d8432 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:58.880313 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61316f9d-d1a6-4123-8da9-6450ff8d8432 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:58.913534 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc92ff-c34f-42f0-97c3-536b7694d63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:58.914187 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc92ff-c34f-42f0-97c3-536b7694d63c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:58.914467 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc92ff-c34f-42f0-97c3-536b7694d63c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:58.914740 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc92ff-c34f-42f0-97c3-536b7694d63c None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:58.915482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc92ff-c34f-42f0-97c3-536b7694d63c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:54:58.915789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc92ff-c34f-42f0-97c3-536b7694d63c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:58.917174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc92ff-c34f-42f0-97c3-536b7694d63c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:58.919598 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:58.926943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 586/1150] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:54:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:58.932858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f68dda-e2e9-478a-9460-5308a63e61cd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:58.978226 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:59.031268 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f68dda-e2e9-478a-9460-5308a63e61cd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:59.069209 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfeb29-3e09-4a30-ab42-df4d1667a849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:59.070069 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfeb29-3e09-4a30-ab42-df4d1667a849 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:59.070352 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfeb29-3e09-4a30-ab42-df4d1667a849 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:59.070625 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfeb29-3e09-4a30-ab42-df4d1667a849 None admin] PATH_INFO: `/v3/users/a6384dd9b69c4347b9e49787386cc7e0` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:59.071791 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfeb29-3e09-4a30-ab42-df4d1667a849 None admin] RBAC: Authorizing `identity:get_user(user_id=a6384dd9b69c4347b9e49787386cc7e0)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:59.073259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfeb29-3e09-4a30-ab42-df4d1667a849 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:59.075520 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 565/1151] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:54:58 2022] GET /identity/v3/users/a6384dd9b69c4347b9e49787386cc7e0 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:59.081253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc92ff-c34f-42f0-97c3-536b7694d63c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:59.179122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc92ff-c34f-42f0-97c3-536b7694d63c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:59.212557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b5e6d-297a-4cc4-8570-bb3253e648d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:59.213407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b5e6d-297a-4cc4-8570-bb3253e648d5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:59.213691 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b5e6d-297a-4cc4-8570-bb3253e648d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:59.213970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b5e6d-297a-4cc4-8570-bb3253e648d5 None admin] PATH_INFO: `/v3/projects/cd68155272bc4d8b91e62212c1082692` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:59.215716 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b5e6d-297a-4cc4-8570-bb3253e648d5 None admin] RBAC: Authorizing `identity:get_project(project_id=cd68155272bc4d8b91e62212c1082692)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:59.217160 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b5e6d-297a-4cc4-8570-bb3253e648d5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:59.218857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 587/1152] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:54:59 2022] GET /identity/v3/projects/cd68155272bc4d8b91e62212c1082692 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:54:59.224742 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfeb29-3e09-4a30-ab42-df4d1667a849 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:54:59.322251 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfeb29-3e09-4a30-ab42-df4d1667a849 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:54:59.336171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:54:59.357089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89936106-934a-46d5-92f3-842a94851d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:54:59.357970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89936106-934a-46d5-92f3-842a94851d10 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:54:59.358265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89936106-934a-46d5-92f3-842a94851d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:54:59.358543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89936106-934a-46d5-92f3-842a94851d10 None admin] PATH_INFO: `/v3/projects/cd68155272bc4d8b91e62212c1082692/users/a6384dd9b69c4347b9e49787386cc7e0/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:54:59.360510 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89936106-934a-46d5-92f3-842a94851d10 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd68155272bc4d8b91e62212c1082692, user_id=a6384dd9b69c4347b9e49787386cc7e0, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:54:59.361940 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89936106-934a-46d5-92f3-842a94851d10 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:54:59.375938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 566/1153] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:54:59 2022] PUT /identity/v3/projects/cd68155272bc4d8b91e62212c1082692/users/a6384dd9b69c4347b9e49787386cc7e0/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:55:01.612936 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf7452-5b21-46a0-95e1-2a0b3899b3f8 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:01.613493 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf7452-5b21-46a0-95e1-2a0b3899b3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:01.613493 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf7452-5b21-46a0-95e1-2a0b3899b3f8 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:01.614854 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 588/1154] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:01.620368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516afc86-7289-43b6-b68b-e7bd3d401f7f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:01.621949 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516afc86-7289-43b6-b68b-e7bd3d401f7f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:01.621949 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516afc86-7289-43b6-b68b-e7bd3d401f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:01.638193 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-516afc86-7289-43b6-b68b-e7bd3d401f7f None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:01.639381 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-516afc86-7289-43b6-b68b-e7bd3d401f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:01.706399 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 567/1155] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:55:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:55:01.729917 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf7452-5b21-46a0-95e1-2a0b3899b3f8 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:01.791744 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:01.831122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf7452-5b21-46a0-95e1-2a0b3899b3f8 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:01.862365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbad40-b763-44df-aeef-eef053879dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:01.863191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbad40-b763-44df-aeef-eef053879dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:01.863416 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbad40-b763-44df-aeef-eef053879dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:01.863685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbad40-b763-44df-aeef-eef053879dd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:01.874647 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbad40-b763-44df-aeef-eef053879dd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:01.882090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-40fbad40-b763-44df-aeef-eef053879dd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:01.882090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:01.882090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:01.882090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:01.882090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:01.882090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:01.882090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:01.882090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:01.882090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:01.882090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:01.882090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:01.882090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:01.882090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:01.882090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:01.882090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:01.882090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:01.883212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:01.883212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:01.883212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:01.883212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:01.883212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:01.883212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:01.883212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:01.883212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:01.883212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:01.883212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:01.883212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:01.883212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:55:01.883212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:01.883212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:01.883212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:01.883212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:01.884105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:01.884105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:01.884105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:01.884105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:01.884105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:01.884105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:01.884105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:01.884105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:01.884105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:01.884105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:01.884105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:01.884105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:55:01.884105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 589/1156] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:55:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:01.890129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516afc86-7289-43b6-b68b-e7bd3d401f7f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:01.986550 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516afc86-7289-43b6-b68b-e7bd3d401f7f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:01.988829 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:02.022858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835ec81-64b4-4a6b-be12-261c1fdc5a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:02.023522 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835ec81-64b4-4a6b-be12-261c1fdc5a1f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:02.023809 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835ec81-64b4-4a6b-be12-261c1fdc5a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:02.024117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835ec81-64b4-4a6b-be12-261c1fdc5a1f None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:02.024866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835ec81-64b4-4a6b-be12-261c1fdc5a1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:02.025174 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835ec81-64b4-4a6b-be12-261c1fdc5a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:02.026592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835ec81-64b4-4a6b-be12-261c1fdc5a1f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:02.034600 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 568/1157] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:55:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:02.040340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbad40-b763-44df-aeef-eef053879dd4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:02.138154 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbad40-b763-44df-aeef-eef053879dd4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:02.172287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:02.185856 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730018f0-8770-4772-9928-274f98cd5a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:02.186734 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730018f0-8770-4772-9928-274f98cd5a66 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:02.187017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730018f0-8770-4772-9928-274f98cd5a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:02.187294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730018f0-8770-4772-9928-274f98cd5a66 None admin] PATH_INFO: `/v3/users/a6384dd9b69c4347b9e49787386cc7e0` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:02.188592 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730018f0-8770-4772-9928-274f98cd5a66 None admin] RBAC: Authorizing `identity:get_user(user_id=a6384dd9b69c4347b9e49787386cc7e0)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:02.190042 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730018f0-8770-4772-9928-274f98cd5a66 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:02.191694 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 590/1158] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:55:02 2022] GET /identity/v3/users/a6384dd9b69c4347b9e49787386cc7e0 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:02.197517 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835ec81-64b4-4a6b-be12-261c1fdc5a1f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:02.299717 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835ec81-64b4-4a6b-be12-261c1fdc5a1f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:02.333356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e13112-df2a-4d62-a144-0a211fb2be65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:02.334007 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e13112-df2a-4d62-a144-0a211fb2be65 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:02.334290 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e13112-df2a-4d62-a144-0a211fb2be65 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:02.334568 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e13112-df2a-4d62-a144-0a211fb2be65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:02.369743 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:02.404994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e13112-df2a-4d62-a144-0a211fb2be65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:02.406407 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e13112-df2a-4d62-a144-0a211fb2be65 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:02.505612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 569/1159] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:55:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:55:02.512229 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730018f0-8770-4772-9928-274f98cd5a66 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:02.607472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730018f0-8770-4772-9928-274f98cd5a66 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:02.640513 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4017a5-b635-471b-8bb8-44b9c4efba7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:02.641350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4017a5-b635-471b-8bb8-44b9c4efba7e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:02.641633 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4017a5-b635-471b-8bb8-44b9c4efba7e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:02.641909 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4017a5-b635-471b-8bb8-44b9c4efba7e None admin] PATH_INFO: `/v3/projects/cd68155272bc4d8b91e62212c1082692` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:02.643070 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4017a5-b635-471b-8bb8-44b9c4efba7e None admin] RBAC: Authorizing `identity:get_project(project_id=cd68155272bc4d8b91e62212c1082692)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:02.644510 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4017a5-b635-471b-8bb8-44b9c4efba7e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:02.646159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 591/1160] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:55:02 2022] GET /identity/v3/projects/cd68155272bc4d8b91e62212c1082692 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:02.653033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e13112-df2a-4d62-a144-0a211fb2be65 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:02.717580 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:02.752427 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e13112-df2a-4d62-a144-0a211fb2be65 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:02.786476 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcd912-9041-4a14-9f2b-481e376cdfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:02.787126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcd912-9041-4a14-9f2b-481e376cdfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:02.787407 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcd912-9041-4a14-9f2b-481e376cdfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:02.787680 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcd912-9041-4a14-9f2b-481e376cdfb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:02.788542 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcd912-9041-4a14-9f2b-481e376cdfb2 None admin] RBAC: Adding query filter params (role.id=8196ef570097443bac15d3cf39878486, scope.project.id=cd68155272bc4d8b91e62212c1082692, user.id=a6384dd9b69c4347b9e49787386cc7e0) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:02.788854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcd912-9041-4a14-9f2b-481e376cdfb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:02.790283 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcd912-9041-4a14-9f2b-481e376cdfb2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:02.796552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 570/1161] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:55:02 2022] GET /identity/v3/role_assignments?user.id=a6384dd9b69c4347b9e49787386cc7e0&scope.project.id=cd68155272bc4d8b91e62212c1082692&role.id=8196ef570097443bac15d3cf39878486 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:05.053892 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7b41b-7889-4684-9b41-586fe1c25468 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:05.054393 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7b41b-7889-4684-9b41-586fe1c25468 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:05.054393 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7b41b-7889-4684-9b41-586fe1c25468 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:05.055701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 592/1162] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:05.061810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8975e2-59d7-4be8-81fd-452fc9364426 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:05.062256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8975e2-59d7-4be8-81fd-452fc9364426 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:05.062355 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8975e2-59d7-4be8-81fd-452fc9364426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:05.079487 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ca8975e2-59d7-4be8-81fd-452fc9364426 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:05.080716 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ca8975e2-59d7-4be8-81fd-452fc9364426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:05.145462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 571/1163] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:55:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:55:05.168230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7b41b-7889-4684-9b41-586fe1c25468 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:05.226768 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:05.267554 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7b41b-7889-4684-9b41-586fe1c25468 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:05.300580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea09eb6-6092-44cd-b65f-ada7efb56eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:05.301214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea09eb6-6092-44cd-b65f-ada7efb56eba None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:05.301496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea09eb6-6092-44cd-b65f-ada7efb56eba None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:05.301772 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea09eb6-6092-44cd-b65f-ada7efb56eba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:05.367405 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea09eb6-6092-44cd-b65f-ada7efb56eba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:05.368865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea09eb6-6092-44cd-b65f-ada7efb56eba None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:05.425290 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:05.466182 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 593/1164] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:55:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:55:05.472187 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8975e2-59d7-4be8-81fd-452fc9364426 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:05.529914 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:05.569529 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8975e2-59d7-4be8-81fd-452fc9364426 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:05.602746 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3a63d-d829-4d61-bd80-7884e334f9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:05.603535 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3a63d-d829-4d61-bd80-7884e334f9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:05.603840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3a63d-d829-4d61-bd80-7884e334f9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:05.604118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3a63d-d829-4d61-bd80-7884e334f9c7 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:05.611017 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3a63d-d829-4d61-bd80-7884e334f9c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:05.612495 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3a63d-d829-4d61-bd80-7884e334f9c7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:05.628009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-f3c3a63d-d829-4d61-bd80-7884e334f9c7 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 30 11:55:05.628009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:05.628009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 30 11:55:05.628009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 30 11:55:05.628009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:55:05.628009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:55:05.628009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:55:05.628009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:55:05.628009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 30 11:55:05.628009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:55:05.628009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:55:05.628009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:55:05.628009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:05.628009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:05.628009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:05.628009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:05.628009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:05.629214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:05.629214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:05.629214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:05.629214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:05.629214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:05.629214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:05.629214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:55:05.629214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:55:05.629214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:55:05.629214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:55:05.629214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:05.629214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:05.629214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:05.629214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:05.629214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:05.629214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:05.630348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:05.630348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:55:05.630348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:05.630348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:05.630348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:05.630348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:05.630348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:05.630348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:05.630348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:05.630348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:05.630348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 30 11:55:05.630348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:55:05.630348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 30 11:55:05.630348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:55:05.630348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 572/1165] 10.222.0.41 () {56 vars in 1117 bytes} [Mon May 30 11:55:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:05.635179 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea09eb6-6092-44cd-b65f-ada7efb56eba None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:05.731120 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea09eb6-6092-44cd-b65f-ada7efb56eba None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:05.765707 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cef32-d990-440b-85c7-721140ed037c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:05.766365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cef32-d990-440b-85c7-721140ed037c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:05.766651 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cef32-d990-440b-85c7-721140ed037c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:05.766927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cef32-d990-440b-85c7-721140ed037c None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:05.767650 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cef32-d990-440b-85c7-721140ed037c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:05.767990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cef32-d990-440b-85c7-721140ed037c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:05.769346 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cef32-d990-440b-85c7-721140ed037c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:05.776956 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 594/1166] 10.222.0.41 () {56 vars in 1115 bytes} [Mon May 30 11:55:05 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:07.996204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56b755-7eda-4be1-b933-2c488e1ceee0 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:07.996764 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56b755-7eda-4be1-b933-2c488e1ceee0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:07.996860 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56b755-7eda-4be1-b933-2c488e1ceee0 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:07.998204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 573/1167] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:55:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:08.003463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e58fd8-64d5-4afd-b6cd-922720afe190 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:08.003900 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e58fd8-64d5-4afd-b6cd-922720afe190 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:08.004054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e58fd8-64d5-4afd-b6cd-922720afe190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:08.020455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-17e58fd8-64d5-4afd-b6cd-922720afe190 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:08.021575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-17e58fd8-64d5-4afd-b6cd-922720afe190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:08.038893 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:08.087688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 595/1168] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:55:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:55:08.111007 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56b755-7eda-4be1-b933-2c488e1ceee0 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:08.211527 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56b755-7eda-4be1-b933-2c488e1ceee0 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:08.231387 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:08.246014 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc749a-c3bd-49ea-a637-474a1910d379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:08.246670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc749a-c3bd-49ea-a637-474a1910d379 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:08.246955 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc749a-c3bd-49ea-a637-474a1910d379 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:08.247230 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc749a-c3bd-49ea-a637-474a1910d379 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:08.248006 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc749a-c3bd-49ea-a637-474a1910d379 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:08.249370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc749a-c3bd-49ea-a637-474a1910d379 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:08.263789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 574/1169] 10.222.0.41 () {60 vars in 1138 bytes} [Mon May 30 11:55:08 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:55:10.553908 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c329478-50ad-418a-aeb0-e98ef30ff519 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:10.554452 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c329478-50ad-418a-aeb0-e98ef30ff519 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:10.554452 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c329478-50ad-418a-aeb0-e98ef30ff519 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:10.555806 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 596/1170] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:10.561395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def5097-7d62-4663-ae5e-edb372ba79eb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:10.561835 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def5097-7d62-4663-ae5e-edb372ba79eb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:10.561966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def5097-7d62-4663-ae5e-edb372ba79eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:10.579075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2def5097-7d62-4663-ae5e-edb372ba79eb None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:10.580299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2def5097-7d62-4663-ae5e-edb372ba79eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:10.645264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 575/1171] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:55:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:55:10.670356 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c329478-50ad-418a-aeb0-e98ef30ff519 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:10.767984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c329478-50ad-418a-aeb0-e98ef30ff519 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:10.801710 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5b97a-91e2-4731-8de9-bed27b515f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:10.802560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5b97a-91e2-4731-8de9-bed27b515f2b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:10.802846 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5b97a-91e2-4731-8de9-bed27b515f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:10.803126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5b97a-91e2-4731-8de9-bed27b515f2b None admin] PATH_INFO: `/v3/domains/1d1aba0ae2b24b1e97f67d3e4c23f8b5` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:10.813842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5b97a-91e2-4731-8de9-bed27b515f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=1d1aba0ae2b24b1e97f67d3e4c23f8b5)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:10.815250 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5b97a-91e2-4731-8de9-bed27b515f2b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:10.816884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 597/1172] 10.222.0.41 () {56 vars in 1183 bytes} [Mon May 30 11:55:10 2022] GET /identity/v3/domains/1d1aba0ae2b24b1e97f67d3e4c23f8b5 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:10.822715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def5097-7d62-4663-ae5e-edb372ba79eb None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:10.919172 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def5097-7d62-4663-ae5e-edb372ba79eb None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:10.929410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:10.954387 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3b418-9aed-41e9-b8d6-e93d74f36e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:10.955046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3b418-9aed-41e9-b8d6-e93d74f36e29 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:10.955335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3b418-9aed-41e9-b8d6-e93d74f36e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:10.955617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3b418-9aed-41e9-b8d6-e93d74f36e29 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:10.956367 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3b418-9aed-41e9-b8d6-e93d74f36e29 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:10.957806 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3b418-9aed-41e9-b8d6-e93d74f36e29 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:10.981787 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 576/1173] 10.222.0.41 () {60 vars in 1141 bytes} [Mon May 30 11:55:10 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:55:13.263350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4a368-c484-4393-82ad-3cda06a65c76 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:13.263887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4a368-c484-4393-82ad-3cda06a65c76 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:13.263995 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4a368-c484-4393-82ad-3cda06a65c76 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:13.265302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 598/1174] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:13.270657 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b3017-3854-49b3-a22c-0cdcc0ddc826 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:13.271020 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b3017-3854-49b3-a22c-0cdcc0ddc826 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:13.271221 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b3017-3854-49b3-a22c-0cdcc0ddc826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:13.287669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f73b3017-3854-49b3-a22c-0cdcc0ddc826 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:13.288871 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f73b3017-3854-49b3-a22c-0cdcc0ddc826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:13.355586 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 577/1175] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:55:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:55:13.380797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4a368-c484-4393-82ad-3cda06a65c76 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:13.396783 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:13.481482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4a368-c484-4393-82ad-3cda06a65c76 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:13.514668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35914ccd-bf07-41b6-8a3e-a05d5ee0cb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:13.515449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35914ccd-bf07-41b6-8a3e-a05d5ee0cb7b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:13.515735 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35914ccd-bf07-41b6-8a3e-a05d5ee0cb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:13.516041 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35914ccd-bf07-41b6-8a3e-a05d5ee0cb7b None admin] PATH_INFO: `/v3/domains/1d1aba0ae2b24b1e97f67d3e4c23f8b5` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:13.517223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35914ccd-bf07-41b6-8a3e-a05d5ee0cb7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=1d1aba0ae2b24b1e97f67d3e4c23f8b5)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:13.518642 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35914ccd-bf07-41b6-8a3e-a05d5ee0cb7b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:13.520277 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 599/1176] 10.222.0.41 () {56 vars in 1183 bytes} [Mon May 30 11:55:13 2022] GET /identity/v3/domains/1d1aba0ae2b24b1e97f67d3e4c23f8b5 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:13.525994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b3017-3854-49b3-a22c-0cdcc0ddc826 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:13.613824 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:13.623253 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b3017-3854-49b3-a22c-0cdcc0ddc826 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:13.656996 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a85b7c-1a64-406e-838f-6e03a29730e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:13.657659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a85b7c-1a64-406e-838f-6e03a29730e4 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:13.657949 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a85b7c-1a64-406e-838f-6e03a29730e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:13.658230 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a85b7c-1a64-406e-838f-6e03a29730e4 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:13.658937 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a85b7c-1a64-406e-838f-6e03a29730e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:13.660538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a85b7c-1a64-406e-838f-6e03a29730e4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:13.679359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 578/1177] 10.222.0.41 () {60 vars in 1132 bytes} [Mon May 30 11:55:13 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:55:15.963111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b510f3-cdba-4080-8530-73a6a3ac9f7f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:15.963624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b510f3-cdba-4080-8530-73a6a3ac9f7f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:15.963731 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b510f3-cdba-4080-8530-73a6a3ac9f7f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:15.965636 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 600/1178] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:55:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:15.971196 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e735058-c71e-48e4-90c2-8f4b04c42a5d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:15.971611 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e735058-c71e-48e4-90c2-8f4b04c42a5d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:15.971758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e735058-c71e-48e4-90c2-8f4b04c42a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:15.988675 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1e735058-c71e-48e4-90c2-8f4b04c42a5d None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:15.989857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1e735058-c71e-48e4-90c2-8f4b04c42a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:16.054772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 579/1179] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:55:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:55:16.078397 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b510f3-cdba-4080-8530-73a6a3ac9f7f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:16.159984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:16.179170 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b510f3-cdba-4080-8530-73a6a3ac9f7f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:16.211080 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ff167-57bf-42bf-bbd9-409f7f7a92f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:16.211878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ff167-57bf-42bf-bbd9-409f7f7a92f8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:16.212167 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ff167-57bf-42bf-bbd9-409f7f7a92f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:16.212447 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ff167-57bf-42bf-bbd9-409f7f7a92f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:16.222752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ff167-57bf-42bf-bbd9-409f7f7a92f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:16.230322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ac1ff167-57bf-42bf-bbd9-409f7f7a92f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:16.230322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:16.230322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:16.230322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:16.230322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:16.230322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:16.230322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:16.230322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:16.230322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:16.230322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:16.230322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:16.230322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:16.230322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:16.230322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:16.230322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:16.230322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:16.235927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:16.235927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:16.235927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:16.235927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:16.235927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:16.235927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:16.235927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:16.235927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:16.235927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:16.235927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:16.235927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:16.235927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:55:16.235927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:16.235927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:16.235927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:16.235927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:16.237021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:16.237021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:16.237021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:16.237021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:16.237021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:16.237021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:16.237021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:16.237021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:16.237021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:16.237021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:16.237021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:16.237021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:55:16.237021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 601/1180] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:55:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:16.238194 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e735058-c71e-48e4-90c2-8f4b04c42a5d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:16.313859 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:16.335665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e735058-c71e-48e4-90c2-8f4b04c42a5d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:16.368795 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bbf35-c5c9-4796-a0c4-e1e1596f4f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:16.369709 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bbf35-c5c9-4796-a0c4-e1e1596f4f6f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:16.369991 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bbf35-c5c9-4796-a0c4-e1e1596f4f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:16.370268 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bbf35-c5c9-4796-a0c4-e1e1596f4f6f None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:16.371012 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bbf35-c5c9-4796-a0c4-e1e1596f4f6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:16.371520 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bbf35-c5c9-4796-a0c4-e1e1596f4f6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:16.372937 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bbf35-c5c9-4796-a0c4-e1e1596f4f6f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:16.380718 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 580/1181] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:55:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:16.386375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ff167-57bf-42bf-bbd9-409f7f7a92f8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:16.484865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ff167-57bf-42bf-bbd9-409f7f7a92f8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:16.518088 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63064e-9acc-4ac1-9e1d-f640a4696792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:16.518940 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63064e-9acc-4ac1-9e1d-f640a4696792 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:16.519218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63064e-9acc-4ac1-9e1d-f640a4696792 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:16.519490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63064e-9acc-4ac1-9e1d-f640a4696792 None admin] PATH_INFO: `/v3/users/2c24e6f4e3554509874e80aec6504d80` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:16.531021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:16.533603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63064e-9acc-4ac1-9e1d-f640a4696792 None admin] RBAC: Authorizing `identity:get_user(user_id=2c24e6f4e3554509874e80aec6504d80)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:16.535398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63064e-9acc-4ac1-9e1d-f640a4696792 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:16.539870 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 602/1182] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:55:16 2022] GET /identity/v3/users/2c24e6f4e3554509874e80aec6504d80 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:16.542847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bbf35-c5c9-4796-a0c4-e1e1596f4f6f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:16.639970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bbf35-c5c9-4796-a0c4-e1e1596f4f6f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:16.672387 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a11d08-7613-4d9b-9348-3875c1c5c376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:16.673036 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a11d08-7613-4d9b-9348-3875c1c5c376 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:16.673325 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a11d08-7613-4d9b-9348-3875c1c5c376 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:16.673608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a11d08-7613-4d9b-9348-3875c1c5c376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:16.684256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:16.740369 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a11d08-7613-4d9b-9348-3875c1c5c376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:16.741815 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a11d08-7613-4d9b-9348-3875c1c5c376 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:16.838094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 581/1183] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:55:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:55:16.844609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63064e-9acc-4ac1-9e1d-f640a4696792 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:16.941897 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63064e-9acc-4ac1-9e1d-f640a4696792 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:16.982815 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cba23-e530-416f-b7d9-3f1110b72e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:16.983657 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cba23-e530-416f-b7d9-3f1110b72e8a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:16.984032 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cba23-e530-416f-b7d9-3f1110b72e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:16.984310 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cba23-e530-416f-b7d9-3f1110b72e8a None admin] PATH_INFO: `/v3/projects/a6bb0054c8224dd890a4b37fa3ccc23e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:16.985471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cba23-e530-416f-b7d9-3f1110b72e8a None admin] RBAC: Authorizing `identity:get_project(project_id=a6bb0054c8224dd890a4b37fa3ccc23e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:16.986888 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cba23-e530-416f-b7d9-3f1110b72e8a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:16.988584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 603/1184] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:55:16 2022] GET /identity/v3/projects/a6bb0054c8224dd890a4b37fa3ccc23e => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:16.994930 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a11d08-7613-4d9b-9348-3875c1c5c376 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:17.035527 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:17.093521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a11d08-7613-4d9b-9348-3875c1c5c376 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:17.126590 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab324a13-45bf-42c6-801c-69db80e45155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:17.127241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab324a13-45bf-42c6-801c-69db80e45155 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:17.127523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab324a13-45bf-42c6-801c-69db80e45155 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:17.127796 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab324a13-45bf-42c6-801c-69db80e45155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:17.128675 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab324a13-45bf-42c6-801c-69db80e45155 None admin] RBAC: Adding query filter params (role.id=8196ef570097443bac15d3cf39878486, scope.project.id=a6bb0054c8224dd890a4b37fa3ccc23e, user.id=2c24e6f4e3554509874e80aec6504d80) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:17.128987 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab324a13-45bf-42c6-801c-69db80e45155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:17.130405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab324a13-45bf-42c6-801c-69db80e45155 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:17.135682 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 582/1185] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:55:16 2022] GET /identity/v3/role_assignments?user.id=2c24e6f4e3554509874e80aec6504d80&scope.project.id=a6bb0054c8224dd890a4b37fa3ccc23e&role.id=8196ef570097443bac15d3cf39878486 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:19.343655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11a946-3520-4ee5-b900-6a49d1b777dd None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:19.344208 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11a946-3520-4ee5-b900-6a49d1b777dd None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:19.344297 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11a946-3520-4ee5-b900-6a49d1b777dd None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:19.345586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 604/1186] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:19.350715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dbe11-6ffc-484e-9807-6d971caeb3c8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:19.351156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dbe11-6ffc-484e-9807-6d971caeb3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:19.351276 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dbe11-6ffc-484e-9807-6d971caeb3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:19.368215 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-082dbe11-6ffc-484e-9807-6d971caeb3c8 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:19.369646 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-082dbe11-6ffc-484e-9807-6d971caeb3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:19.434341 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 583/1187] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:55:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:55:19.456997 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11a946-3520-4ee5-b900-6a49d1b777dd None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:19.523425 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:19.556710 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11a946-3520-4ee5-b900-6a49d1b777dd None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:19.589589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c5ae8-6159-4160-adbb-7189bdb14e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:19.590401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c5ae8-6159-4160-adbb-7189bdb14e25 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:19.590685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c5ae8-6159-4160-adbb-7189bdb14e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:19.590967 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c5ae8-6159-4160-adbb-7189bdb14e25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:19.600892 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c5ae8-6159-4160-adbb-7189bdb14e25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:19.608922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-047c5ae8-6159-4160-adbb-7189bdb14e25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:19.608922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:19.608922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:19.608922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:19.608922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:19.608922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:19.608922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:19.608922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:19.608922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:19.608922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:19.608922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:19.608922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:19.608922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:19.608922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:19.608922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:19.608922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:19.610026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:19.610026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:19.610026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:19.610026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:19.610026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:19.610026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:19.610026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:19.610026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:19.610026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:19.610026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:19.610026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:19.610026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:55:19.610026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:19.610026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:19.610026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:19.610026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:19.611058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:19.611058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:19.611058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:19.611058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:19.611058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:19.611058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:19.611058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:19.611058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:19.611058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:19.611058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:19.611058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:19.611058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:55:19.611058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 605/1188] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:55:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:19.616122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dbe11-6ffc-484e-9807-6d971caeb3c8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:19.649412 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:19.716782 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dbe11-6ffc-484e-9807-6d971caeb3c8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:19.750793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce35a05-5602-40aa-9964-8d4086491bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:19.751457 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce35a05-5602-40aa-9964-8d4086491bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:19.751742 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce35a05-5602-40aa-9964-8d4086491bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:19.752052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce35a05-5602-40aa-9964-8d4086491bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:19.752802 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce35a05-5602-40aa-9964-8d4086491bb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:19.753113 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce35a05-5602-40aa-9964-8d4086491bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:19.754498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce35a05-5602-40aa-9964-8d4086491bb6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:19.762559 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 584/1189] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:55:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:19.768639 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c5ae8-6159-4160-adbb-7189bdb14e25 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:19.867936 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c5ae8-6159-4160-adbb-7189bdb14e25 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:19.893271 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:19.901371 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f130ca-2b3f-4079-b9d6-75f379f56a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:19.902801 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f130ca-2b3f-4079-b9d6-75f379f56a1b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:19.903159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f130ca-2b3f-4079-b9d6-75f379f56a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:19.903445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f130ca-2b3f-4079-b9d6-75f379f56a1b None admin] PATH_INFO: `/v3/users/2c24e6f4e3554509874e80aec6504d80` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:19.904688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f130ca-2b3f-4079-b9d6-75f379f56a1b None admin] RBAC: Authorizing `identity:get_user(user_id=2c24e6f4e3554509874e80aec6504d80)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:19.906122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f130ca-2b3f-4079-b9d6-75f379f56a1b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:19.907726 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 606/1190] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:55:19 2022] GET /identity/v3/users/2c24e6f4e3554509874e80aec6504d80 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:19.913369 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce35a05-5602-40aa-9964-8d4086491bb6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:20.005998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:20.012375 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce35a05-5602-40aa-9964-8d4086491bb6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:20.045893 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a2f2a-9a95-4420-9286-9b3d1779f8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:20.046744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a2f2a-9a95-4420-9286-9b3d1779f8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:20.047029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a2f2a-9a95-4420-9286-9b3d1779f8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:20.047308 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a2f2a-9a95-4420-9286-9b3d1779f8f3 None admin] PATH_INFO: `/v3/projects/a6bb0054c8224dd890a4b37fa3ccc23e` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:20.048493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a2f2a-9a95-4420-9286-9b3d1779f8f3 None admin] RBAC: Authorizing `identity:get_project(project_id=a6bb0054c8224dd890a4b37fa3ccc23e)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:20.049926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a2f2a-9a95-4420-9286-9b3d1779f8f3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:20.051608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 585/1191] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:55:19 2022] GET /identity/v3/projects/a6bb0054c8224dd890a4b37fa3ccc23e => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:20.057497 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f130ca-2b3f-4079-b9d6-75f379f56a1b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:20.155071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f130ca-2b3f-4079-b9d6-75f379f56a1b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:20.188198 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2a2f6-fa02-4f2f-8309-cd49980ef1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:20.189068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2a2f6-fa02-4f2f-8309-cd49980ef1b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:20.189351 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2a2f6-fa02-4f2f-8309-cd49980ef1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:20.189627 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2a2f6-fa02-4f2f-8309-cd49980ef1b4 None admin] PATH_INFO: `/v3/projects/a6bb0054c8224dd890a4b37fa3ccc23e/users/2c24e6f4e3554509874e80aec6504d80/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:20.191557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2a2f6-fa02-4f2f-8309-cd49980ef1b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6bb0054c8224dd890a4b37fa3ccc23e, user_id=2c24e6f4e3554509874e80aec6504d80, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:20.193005 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2a2f6-fa02-4f2f-8309-cd49980ef1b4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:20.206142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 607/1192] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:55:20 2022] PUT /identity/v3/projects/a6bb0054c8224dd890a4b37fa3ccc23e/users/2c24e6f4e3554509874e80aec6504d80/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:55:22.441630 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a23cc-dfba-43f6-806c-9a4307a1a210 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:22.442192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a23cc-dfba-43f6-806c-9a4307a1a210 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:22.442192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a23cc-dfba-43f6-806c-9a4307a1a210 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:22.443529 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 586/1193] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:22.448694 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5c0eb-fc18-4357-aa0e-7757f3ae7b8d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:22.449112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5c0eb-fc18-4357-aa0e-7757f3ae7b8d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:22.449278 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5c0eb-fc18-4357-aa0e-7757f3ae7b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:22.467010 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-20b5c0eb-fc18-4357-aa0e-7757f3ae7b8d None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:22.468306 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-20b5c0eb-fc18-4357-aa0e-7757f3ae7b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:22.517657 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:22.535544 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 608/1194] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:55:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:55:22.559334 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a23cc-dfba-43f6-806c-9a4307a1a210 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:22.659097 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a23cc-dfba-43f6-806c-9a4307a1a210 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:22.691982 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930f32a-9cdb-4063-8693-76854bf2c1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:22.692699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930f32a-9cdb-4063-8693-76854bf2c1ee None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:22.692985 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930f32a-9cdb-4063-8693-76854bf2c1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:22.693263 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930f32a-9cdb-4063-8693-76854bf2c1ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:22.704153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930f32a-9cdb-4063-8693-76854bf2c1ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:22.711737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-4930f32a-9cdb-4063-8693-76854bf2c1ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:22.711737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:22.711737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:22.711737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:22.711737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:22.711737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:22.711737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:22.711737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:22.711737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:22.711737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:22.711737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:22.711737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:22.711737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:22.711737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:22.711737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:22.711737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:22.712856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:22.712856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:22.712856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:22.712856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:22.712856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:22.712856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:22.712856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:22.712856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:22.712856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:22.712856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:22.712856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:22.712856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:55:22.712856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:22.712856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:22.712856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:22.712856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:22.713752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:22.713752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:22.713752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:22.713752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:22.713752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:22.713752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:22.713752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:22.713752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:22.713752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:22.713752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:22.713752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:22.713752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:55:22.713752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 587/1195] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:55:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:22.718907 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5c0eb-fc18-4357-aa0e-7757f3ae7b8d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:22.822059 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5c0eb-fc18-4357-aa0e-7757f3ae7b8d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:22.856266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5e8b2-db2f-4987-a07f-fbce61cd9387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:22.856929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5e8b2-db2f-4987-a07f-fbce61cd9387 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:22.857216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5e8b2-db2f-4987-a07f-fbce61cd9387 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:22.857497 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5e8b2-db2f-4987-a07f-fbce61cd9387 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:22.858245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5e8b2-db2f-4987-a07f-fbce61cd9387 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:22.858555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5e8b2-db2f-4987-a07f-fbce61cd9387 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:22.859939 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5e8b2-db2f-4987-a07f-fbce61cd9387 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:22.867708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 609/1196] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:55:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:22.876095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930f32a-9cdb-4063-8693-76854bf2c1ee None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:22.901402 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:22.977303 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930f32a-9cdb-4063-8693-76854bf2c1ee None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:23.012704 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646ab33-2e42-4391-8439-806ae570b651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:23.013588 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646ab33-2e42-4391-8439-806ae570b651 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:23.013875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646ab33-2e42-4391-8439-806ae570b651 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:23.014149 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646ab33-2e42-4391-8439-806ae570b651 None admin] PATH_INFO: `/v3/users/2c24e6f4e3554509874e80aec6504d80` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:23.015335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646ab33-2e42-4391-8439-806ae570b651 None admin] RBAC: Authorizing `identity:get_user(user_id=2c24e6f4e3554509874e80aec6504d80)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:23.016797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646ab33-2e42-4391-8439-806ae570b651 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:23.023856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 588/1197] 10.222.0.41 () {56 vars in 1177 bytes} [Mon May 30 11:55:22 2022] GET /identity/v3/users/2c24e6f4e3554509874e80aec6504d80 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:23.024216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5e8b2-db2f-4987-a07f-fbce61cd9387 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:23.074818 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:23.132064 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5e8b2-db2f-4987-a07f-fbce61cd9387 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:23.165828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3aea7-f8f6-4c03-9131-6a12ea635f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:23.166865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3aea7-f8f6-4c03-9131-6a12ea635f45 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:23.167152 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3aea7-f8f6-4c03-9131-6a12ea635f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:23.167427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3aea7-f8f6-4c03-9131-6a12ea635f45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:23.235011 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3aea7-f8f6-4c03-9131-6a12ea635f45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:23.236441 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3aea7-f8f6-4c03-9131-6a12ea635f45 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:23.282126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:23.333018 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 610/1198] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:55:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 30 11:55:23.338836 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646ab33-2e42-4391-8439-806ae570b651 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:23.426272 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:23.435032 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646ab33-2e42-4391-8439-806ae570b651 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:23.467186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bba569-dfd8-47e9-8d3b-bbacc65ef403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:23.468050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bba569-dfd8-47e9-8d3b-bbacc65ef403 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:23.468342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bba569-dfd8-47e9-8d3b-bbacc65ef403 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:23.468600 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bba569-dfd8-47e9-8d3b-bbacc65ef403 None admin] PATH_INFO: `/v3/projects/a6bb0054c8224dd890a4b37fa3ccc23e` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:23.469752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bba569-dfd8-47e9-8d3b-bbacc65ef403 None admin] RBAC: Authorizing `identity:get_project(project_id=a6bb0054c8224dd890a4b37fa3ccc23e)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:23.471171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bba569-dfd8-47e9-8d3b-bbacc65ef403 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:23.472879 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 589/1199] 10.222.0.41 () {56 vars in 1186 bytes} [Mon May 30 11:55:23 2022] GET /identity/v3/projects/a6bb0054c8224dd890a4b37fa3ccc23e => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:23.478973 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3aea7-f8f6-4c03-9131-6a12ea635f45 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:23.576927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3aea7-f8f6-4c03-9131-6a12ea635f45 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:23.609545 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd089387-5049-411d-abe8-34a308e488de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:23.610185 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd089387-5049-411d-abe8-34a308e488de None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:23.610473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd089387-5049-411d-abe8-34a308e488de None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:23.610755 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd089387-5049-411d-abe8-34a308e488de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:23.611587 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd089387-5049-411d-abe8-34a308e488de None admin] RBAC: Adding query filter params (role.id=8196ef570097443bac15d3cf39878486, scope.project.id=a6bb0054c8224dd890a4b37fa3ccc23e, user.id=2c24e6f4e3554509874e80aec6504d80) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:23.611932 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd089387-5049-411d-abe8-34a308e488de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:23.613349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd089387-5049-411d-abe8-34a308e488de None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:23.619315 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 611/1200] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:55:23 2022] GET /identity/v3/role_assignments?user.id=2c24e6f4e3554509874e80aec6504d80&scope.project.id=a6bb0054c8224dd890a4b37fa3ccc23e&role.id=8196ef570097443bac15d3cf39878486 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:33.462627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=20 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:33.616497 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=94 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:25.477486 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5dc99-5190-4eac-bdcd-67ea545140c4 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:25.478757 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5dc99-5190-4eac-bdcd-67ea545140c4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:25.478757 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5dc99-5190-4eac-bdcd-67ea545140c4 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:25.481186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 590/1201] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:56:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:25.489718 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238fc32-2f89-46da-9fc0-145f8e985173 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:25.490357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238fc32-2f89-46da-9fc0-145f8e985173 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:25.490357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238fc32-2f89-46da-9fc0-145f8e985173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:25.510896 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2238fc32-2f89-46da-9fc0-145f8e985173 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:25.512312 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2238fc32-2f89-46da-9fc0-145f8e985173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:25.615940 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 612/1202] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:56:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:56:25.645728 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5dc99-5190-4eac-bdcd-67ea545140c4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:25.779570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5dc99-5190-4eac-bdcd-67ea545140c4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:25.824176 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aebae0-fcf8-42c2-93c1-4375cc18e5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:25.825002 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aebae0-fcf8-42c2-93c1-4375cc18e5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:25.825319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aebae0-fcf8-42c2-93c1-4375cc18e5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:25.825608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aebae0-fcf8-42c2-93c1-4375cc18e5e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:25.840685 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aebae0-fcf8-42c2-93c1-4375cc18e5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:25.842481 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aebae0-fcf8-42c2-93c1-4375cc18e5e7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:25.866218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-98aebae0-fcf8-42c2-93c1-4375cc18e5e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:25.866218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:25.866218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:25.866218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:25.866218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:25.866218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:25.866218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:25.866218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:25.866218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:25.866218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:25.866218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:25.866218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:25.866218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:25.866218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:25.866218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:25.867324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:25.867324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:25.867324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:25.867324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:25.867324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:25.867324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:25.867324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:25.867324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:25.867324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:56:25.867324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:25.867324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:25.867324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:25.867324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:25.867324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:25.867324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:25.867324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:25.867324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:25.869091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:25.869091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:25.869091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:25.869091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:56:25.869091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 591/1203] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:25.874920 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238fc32-2f89-46da-9fc0-145f8e985173 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:25.999692 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238fc32-2f89-46da-9fc0-145f8e985173 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:26.041277 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:26.048767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0897f7-b3ae-45ad-91ef-2d977f47886d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:26.051762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0897f7-b3ae-45ad-91ef-2d977f47886d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:26.051762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0897f7-b3ae-45ad-91ef-2d977f47886d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:26.051762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0897f7-b3ae-45ad-91ef-2d977f47886d None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:26.051762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0897f7-b3ae-45ad-91ef-2d977f47886d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:26.051762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0897f7-b3ae-45ad-91ef-2d977f47886d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:26.052542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0897f7-b3ae-45ad-91ef-2d977f47886d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:26.066462 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 613/1204] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:26.073105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aebae0-fcf8-42c2-93c1-4375cc18e5e7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:26.144618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:26.203867 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aebae0-fcf8-42c2-93c1-4375cc18e5e7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:26.247264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f652ab-0b2e-4d3a-a7ed-b47f4de5d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:26.247963 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f652ab-0b2e-4d3a-a7ed-b47f4de5d870 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:26.248287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f652ab-0b2e-4d3a-a7ed-b47f4de5d870 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:26.248569 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f652ab-0b2e-4d3a-a7ed-b47f4de5d870 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:26.249299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f652ab-0b2e-4d3a-a7ed-b47f4de5d870 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:26.250789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f652ab-0b2e-4d3a-a7ed-b47f4de5d870 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:26.279852 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 592/1205] 10.222.0.41 () {60 vars in 1132 bytes} [Mon May 30 11:56:26 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:56:28.945285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de18ac7-19d6-419f-a5d2-79ecd4c0c7fc None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:28.947458 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de18ac7-19d6-419f-a5d2-79ecd4c0c7fc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:28.947458 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de18ac7-19d6-419f-a5d2-79ecd4c0c7fc None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:28.948305 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 614/1206] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:56:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:28.953664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c114cc-0c7a-4766-8a62-d92947a32ddc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:28.954109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c114cc-0c7a-4766-8a62-d92947a32ddc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:28.954260 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c114cc-0c7a-4766-8a62-d92947a32ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:28.975565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-61c114cc-0c7a-4766-8a62-d92947a32ddc None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:28.976960 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-61c114cc-0c7a-4766-8a62-d92947a32ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:29.066603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 593/1207] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:56:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:56:29.093092 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de18ac7-19d6-419f-a5d2-79ecd4c0c7fc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:29.221318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de18ac7-19d6-419f-a5d2-79ecd4c0c7fc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:29.266453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460e2f0-1c3b-46c3-aa84-c32b7a4af657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:29.267423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460e2f0-1c3b-46c3-aa84-c32b7a4af657 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:29.267721 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460e2f0-1c3b-46c3-aa84-c32b7a4af657 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:29.268044 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460e2f0-1c3b-46c3-aa84-c32b7a4af657 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:29.286607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460e2f0-1c3b-46c3-aa84-c32b7a4af657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:29.295677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-e460e2f0-1c3b-46c3-aa84-c32b7a4af657 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:29.295677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:29.295677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:29.295677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:29.295677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:29.295677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:29.295677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:29.295677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:29.295677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:29.295677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:29.295677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:29.295677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:29.295677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:29.295677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:29.295677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:29.295677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:29.297309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:29.297309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:29.297309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:29.297309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:29.297309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:29.297309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:29.297309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:29.297309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:29.297309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:29.297309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:29.297309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:29.297309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:56:29.297309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:29.297309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:29.297309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:29.297309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:29.298448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:29.298448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:29.298448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:29.298448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:29.298448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:29.298448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:29.298448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:29.298448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:29.298448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:29.298448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:29.298448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:29.298448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:56:29.302303 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 615/1208] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:56:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:29.303563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c114cc-0c7a-4766-8a62-d92947a32ddc None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:29.352240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:29.438872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c114cc-0c7a-4766-8a62-d92947a32ddc None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:29.481227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608f8a1-c43d-4a0d-a30d-4d20b5892f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:29.481883 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608f8a1-c43d-4a0d-a30d-4d20b5892f80 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:29.482171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608f8a1-c43d-4a0d-a30d-4d20b5892f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:29.482443 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608f8a1-c43d-4a0d-a30d-4d20b5892f80 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:29.483206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608f8a1-c43d-4a0d-a30d-4d20b5892f80 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:29.483513 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608f8a1-c43d-4a0d-a30d-4d20b5892f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:29.485094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608f8a1-c43d-4a0d-a30d-4d20b5892f80 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:29.497070 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 594/1209] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:56:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:29.503799 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460e2f0-1c3b-46c3-aa84-c32b7a4af657 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:29.567632 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:29.636355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460e2f0-1c3b-46c3-aa84-c32b7a4af657 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:29.681710 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f8f8b-448c-40a3-8dc4-13d0d652e565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:29.682666 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f8f8b-448c-40a3-8dc4-13d0d652e565 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:29.682952 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f8f8b-448c-40a3-8dc4-13d0d652e565 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:29.683234 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f8f8b-448c-40a3-8dc4-13d0d652e565 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:29.696097 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f8f8b-448c-40a3-8dc4-13d0d652e565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:29.698349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f8f8b-448c-40a3-8dc4-13d0d652e565 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:29.717113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-1b8f8f8b-448c-40a3-8dc4-13d0d652e565 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:29.717113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:29.717113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:29.717113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:29.717113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:29.717113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:29.717113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:29.717113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:29.717113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:29.717113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:29.717113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:29.717113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:29.717113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:29.717113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:29.717113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:29.718304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:29.718304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:29.718304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:29.718304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:29.718304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:29.718304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:29.718304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:29.718304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:29.718304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:56:29.718304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:29.718304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:29.718304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:29.718304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:29.718304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:29.718304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:29.718304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:29.718304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:29.719354 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:29.719354 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:29.719354 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:29.719354 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:56:29.719584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 616/1210] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:29.725735 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608f8a1-c43d-4a0d-a30d-4d20b5892f80 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:29.859676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:29.862780 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608f8a1-c43d-4a0d-a30d-4d20b5892f80 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:29.906392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a17134-f34e-4b3e-9107-51b55fc51ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:29.907181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a17134-f34e-4b3e-9107-51b55fc51ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:29.907520 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a17134-f34e-4b3e-9107-51b55fc51ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:29.907901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a17134-f34e-4b3e-9107-51b55fc51ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:29.908981 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a17134-f34e-4b3e-9107-51b55fc51ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:29.909572 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a17134-f34e-4b3e-9107-51b55fc51ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:29.911240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a17134-f34e-4b3e-9107-51b55fc51ad6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:29.930493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 595/1211] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:29.938201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f8f8b-448c-40a3-8dc4-13d0d652e565 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:30.078877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f8f8b-448c-40a3-8dc4-13d0d652e565 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:30.080945 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:30.118828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d3fdd-7d6b-49e0-aa19-3c9f1a0eb91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:30.119996 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d3fdd-7d6b-49e0-aa19-3c9f1a0eb91f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.120391 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d3fdd-7d6b-49e0-aa19-3c9f1a0eb91f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.120773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d3fdd-7d6b-49e0-aa19-3c9f1a0eb91f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.129126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d3fdd-7d6b-49e0-aa19-3c9f1a0eb91f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:30.130680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d3fdd-7d6b-49e0-aa19-3c9f1a0eb91f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:30.147609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-a96d3fdd-7d6b-49e0-aa19-3c9f1a0eb91f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 30 11:56:30.147609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:30.147609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:30.147609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:30.147609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:30.147609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:30.147609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:30.147609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:30.147609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:30.147609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:30.147609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:30.147609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:30.147609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:30.147609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:30.147609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:30.147609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:30.148877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:30.148877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:30.148877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:30.148877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:30.148877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:30.148877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:30.148877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:30.148877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:30.148877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:30.148877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:30.148877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:30.148877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:56:30.148877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:30.148877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:30.148877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:30.148877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:30.148877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:30.148877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:30.150264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:30.150264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:30.150264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:30.150264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:30.150264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:30.150264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:30.150264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:30.150264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:30.150264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 30 11:56:30.150264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:56:30.150264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 617/1212] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:30.155122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a17134-f34e-4b3e-9107-51b55fc51ad6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:30.291635 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a17134-f34e-4b3e-9107-51b55fc51ad6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:30.328812 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c88d23-c6dc-43c3-9a08-3d9436ab0936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:30.329559 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c88d23-c6dc-43c3-9a08-3d9436ab0936 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.329891 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c88d23-c6dc-43c3-9a08-3d9436ab0936 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.330234 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c88d23-c6dc-43c3-9a08-3d9436ab0936 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.330980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c88d23-c6dc-43c3-9a08-3d9436ab0936 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:30.331357 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c88d23-c6dc-43c3-9a08-3d9436ab0936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:30.332910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c88d23-c6dc-43c3-9a08-3d9436ab0936 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:30.353415 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 596/1213] 10.222.0.41 () {56 vars in 1143 bytes} [Mon May 30 11:56:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:30.359237 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d3fdd-7d6b-49e0-aa19-3c9f1a0eb91f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:30.475996 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d3fdd-7d6b-49e0-aa19-3c9f1a0eb91f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:30.521456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dc90f-c2c3-4da8-9131-643df282dc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:30.522174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dc90f-c2c3-4da8-9131-643df282dc48 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.522594 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dc90f-c2c3-4da8-9131-643df282dc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.522879 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dc90f-c2c3-4da8-9131-643df282dc48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.557463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:30.598749 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dc90f-c2c3-4da8-9131-643df282dc48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:30.600234 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dc90f-c2c3-4da8-9131-643df282dc48 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:30.713296 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 618/1214] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:56:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:56:30.719210 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c88d23-c6dc-43c3-9a08-3d9436ab0936 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:30.741434 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:30.848497 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c88d23-c6dc-43c3-9a08-3d9436ab0936 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:30.889298 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83735e82-2e3e-4199-9570-46b397daa1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:30.890177 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735e82-2e3e-4199-9570-46b397daa1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.890526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735e82-2e3e-4199-9570-46b397daa1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.890797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735e82-2e3e-4199-9570-46b397daa1e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.905288 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83735e82-2e3e-4199-9570-46b397daa1e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:30.906933 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83735e82-2e3e-4199-9570-46b397daa1e3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:30.926959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-83735e82-2e3e-4199-9570-46b397daa1e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:30.926959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:30.926959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:30.926959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:30.926959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:30.926959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:30.926959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:30.926959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:30.926959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:30.926959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:30.926959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:30.926959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:30.926959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:30.926959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:30.926959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:30.928122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:30.928122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:30.928122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:30.928122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:30.928122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:30.928122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:30.928122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:30.928122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:30.928122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:56:30.928122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:30.928122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:30.928122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:30.928122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:30.928122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:30.928122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:30.928122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:30.928122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:30.929492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:30.929492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:30.929492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:30.929492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:56:30.929492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 597/1215] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:30.934456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dc90f-c2c3-4da8-9131-643df282dc48 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:31.005170 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:31.049604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dc90f-c2c3-4da8-9131-643df282dc48 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:31.090287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551f53d-414c-41d3-ba5e-65c966426865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:31.090996 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551f53d-414c-41d3-ba5e-65c966426865 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:31.091258 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551f53d-414c-41d3-ba5e-65c966426865 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:31.091629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551f53d-414c-41d3-ba5e-65c966426865 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:31.092528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551f53d-414c-41d3-ba5e-65c966426865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:31.092912 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551f53d-414c-41d3-ba5e-65c966426865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:31.094454 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551f53d-414c-41d3-ba5e-65c966426865 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:31.111947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 619/1216] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:31.115206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83735e82-2e3e-4199-9570-46b397daa1e3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:31.210182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:31.238307 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83735e82-2e3e-4199-9570-46b397daa1e3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:31.279531 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e542a7-4b09-43fc-b46a-492a1bfe6510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:31.280451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e542a7-4b09-43fc-b46a-492a1bfe6510 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:31.280740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e542a7-4b09-43fc-b46a-492a1bfe6510 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:31.281016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e542a7-4b09-43fc-b46a-492a1bfe6510 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:31.291085 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e542a7-4b09-43fc-b46a-492a1bfe6510 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:31.292771 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e542a7-4b09-43fc-b46a-492a1bfe6510 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:31.310961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-e5e542a7-4b09-43fc-b46a-492a1bfe6510 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:31.310961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:31.310961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:31.310961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:31.310961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:31.310961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:31.310961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:31.310961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:31.310961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:31.310961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:31.310961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:31.310961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:31.310961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:31.310961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:31.310961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:31.312156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:31.312156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:31.312156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:31.312156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:31.312156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:31.312156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:31.312156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:31.312156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:31.312156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:56:31.312156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:31.312156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:31.312156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:31.312156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:31.312156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:31.312156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:31.312156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:31.312156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:31.313267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:31.313267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:31.313267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:31.313267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:31.313267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:31.313267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:31.313267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:31.313267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:56:31.317731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 598/1217] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:56:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:31.318863 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551f53d-414c-41d3-ba5e-65c966426865 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:31.449496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551f53d-414c-41d3-ba5e-65c966426865 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:31.476236 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:31.496260 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30259d-a190-4290-b6de-a9fd5a62c9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:31.498495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30259d-a190-4290-b6de-a9fd5a62c9bd None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:31.498495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30259d-a190-4290-b6de-a9fd5a62c9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:31.498495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30259d-a190-4290-b6de-a9fd5a62c9bd None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:31.498925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30259d-a190-4290-b6de-a9fd5a62c9bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:31.499380 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30259d-a190-4290-b6de-a9fd5a62c9bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:31.501497 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30259d-a190-4290-b6de-a9fd5a62c9bd None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:31.520348 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 620/1218] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:56:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:31.528237 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e542a7-4b09-43fc-b46a-492a1bfe6510 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:31.652295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e542a7-4b09-43fc-b46a-492a1bfe6510 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:31.687884 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:31.694979 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971fb46-b88e-44dd-b10a-f78cb53d4bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:31.696033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971fb46-b88e-44dd-b10a-f78cb53d4bfb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:31.697084 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971fb46-b88e-44dd-b10a-f78cb53d4bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:31.697710 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971fb46-b88e-44dd-b10a-f78cb53d4bfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:31.698615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971fb46-b88e-44dd-b10a-f78cb53d4bfb None admin] RBAC: Adding query filter params (role.id=dc57e0b7f67947e0b6b63c4ad0148358, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=48b43eb1a0ac4db5adee3512453459aa) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:31.698926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971fb46-b88e-44dd-b10a-f78cb53d4bfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:31.700562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971fb46-b88e-44dd-b10a-f78cb53d4bfb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:31.707259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 599/1219] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:56:31 2022] GET /identity/v3/role_assignments?user.id=48b43eb1a0ac4db5adee3512453459aa&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=dc57e0b7f67947e0b6b63c4ad0148358 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:34.200462 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bbc93-e444-45eb-ab2e-bc5a5bc3f9cc None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:34.200987 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bbc93-e444-45eb-ab2e-bc5a5bc3f9cc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:34.201102 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bbc93-e444-45eb-ab2e-bc5a5bc3f9cc None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:34.202365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 621/1220] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:34.208020 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23d792-5246-4320-b0ed-c5cfe0e6f6dc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:34.208447 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23d792-5246-4320-b0ed-c5cfe0e6f6dc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:34.208591 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23d792-5246-4320-b0ed-c5cfe0e6f6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:34.225816 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2d23d792-5246-4320-b0ed-c5cfe0e6f6dc None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:34.227012 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2d23d792-5246-4320-b0ed-c5cfe0e6f6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:34.297004 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 600/1221] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:56:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:56:34.322683 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bbc93-e444-45eb-ab2e-bc5a5bc3f9cc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:34.437322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bbc93-e444-45eb-ab2e-bc5a5bc3f9cc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:34.473704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d4c0a-6a43-4f58-99c0-bc8801039ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:34.474516 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d4c0a-6a43-4f58-99c0-bc8801039ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:34.474800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d4c0a-6a43-4f58-99c0-bc8801039ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:34.475076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d4c0a-6a43-4f58-99c0-bc8801039ea4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:34.492619 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d4c0a-6a43-4f58-99c0-bc8801039ea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:34.501685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-1c4d4c0a-6a43-4f58-99c0-bc8801039ea4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:34.501685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:34.501685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:34.501685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:34.501685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:34.501685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:34.501685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:34.501685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:34.501685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:34.501685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:34.501685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:34.501685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:34.501685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:34.501685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:34.501685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:34.501685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:34.503014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:34.503014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:34.503014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:34.503014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:34.503014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:34.503014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:34.503014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:34.503014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:34.503014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:34.503014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:34.503014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:34.503014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:56:34.503014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:34.503014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:34.503014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:34.503014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:34.504062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:34.504062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:34.504062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:34.504062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:34.504062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:34.504062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:34.504062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:34.504062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:34.504062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:34.504062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:34.504062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:34.504062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:56:34.504062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 622/1222] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:56:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:34.509903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23d792-5246-4320-b0ed-c5cfe0e6f6dc None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:34.626117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23d792-5246-4320-b0ed-c5cfe0e6f6dc None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:34.652389 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:34.664019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfbf3e-8644-4125-a5a1-d384206af80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:34.664691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfbf3e-8644-4125-a5a1-d384206af80b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:34.664987 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfbf3e-8644-4125-a5a1-d384206af80b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:34.666373 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfbf3e-8644-4125-a5a1-d384206af80b None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:34.667214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfbf3e-8644-4125-a5a1-d384206af80b None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:34.667458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfbf3e-8644-4125-a5a1-d384206af80b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:34.668859 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfbf3e-8644-4125-a5a1-d384206af80b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:34.677766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 601/1223] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:56:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:34.684974 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d4c0a-6a43-4f58-99c0-bc8801039ea4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:34.732432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:34.799860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d4c0a-6a43-4f58-99c0-bc8801039ea4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:34.839384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5fd63-3396-48c2-913d-23d8940185d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:34.840265 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5fd63-3396-48c2-913d-23d8940185d8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:34.840543 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5fd63-3396-48c2-913d-23d8940185d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:34.840858 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5fd63-3396-48c2-913d-23d8940185d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:34.851699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5fd63-3396-48c2-913d-23d8940185d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:34.853905 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5fd63-3396-48c2-913d-23d8940185d8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:34.871708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-a9d5fd63-3396-48c2-913d-23d8940185d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:34.871708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:34.871708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:34.871708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:34.871708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:34.871708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:34.871708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:34.871708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:34.871708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:34.871708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:34.871708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:34.871708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:34.871708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:34.871708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:34.871708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:34.872964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:34.872964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:34.872964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:34.872964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:34.872964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:34.872964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:34.872964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:34.872964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:34.872964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:56:34.872964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:34.872964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:34.872964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:34.872964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:34.872964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:34.872964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:34.872964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:34.872964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:34.874240 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:34.874240 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:34.874240 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:34.874240 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:56:34.874240 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 623/1224] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:34.878838 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfbf3e-8644-4125-a5a1-d384206af80b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:34.993004 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfbf3e-8644-4125-a5a1-d384206af80b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:35.027192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0903a2-1ca7-437c-91de-d289da86cf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:35.027899 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0903a2-1ca7-437c-91de-d289da86cf31 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:35.028184 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0903a2-1ca7-437c-91de-d289da86cf31 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:35.028495 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0903a2-1ca7-437c-91de-d289da86cf31 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:35.029186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0903a2-1ca7-437c-91de-d289da86cf31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:35.029530 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0903a2-1ca7-437c-91de-d289da86cf31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:35.030877 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0903a2-1ca7-437c-91de-d289da86cf31 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:35.044167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 602/1225] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:35.052934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5fd63-3396-48c2-913d-23d8940185d8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:35.155879 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:35.163195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5fd63-3396-48c2-913d-23d8940185d8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:35.199414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bda12c-2760-45cc-9090-fc9685967485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:35.200238 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bda12c-2760-45cc-9090-fc9685967485 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:35.200524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bda12c-2760-45cc-9090-fc9685967485 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:35.201150 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bda12c-2760-45cc-9090-fc9685967485 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:35.209247 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bda12c-2760-45cc-9090-fc9685967485 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:35.210767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bda12c-2760-45cc-9090-fc9685967485 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:35.225906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-79bda12c-2760-45cc-9090-fc9685967485 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 30 11:56:35.225906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:35.225906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:35.225906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:35.225906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:35.225906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:35.225906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:35.225906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:35.225906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:35.225906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:35.225906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:35.225906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:35.225906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:35.225906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:35.225906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:35.225906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:35.227098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:35.227098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:35.227098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:35.227098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:35.227098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:35.227098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:35.227098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:35.227098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:35.227098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:35.227098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:35.227098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:35.227098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:56:35.227098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:35.227098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:35.227098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:35.227098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:35.227098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:35.227098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:35.228677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:35.228677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:35.228677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:35.228677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:35.228677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:35.228677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:35.228677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:35.228677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:35.228677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 30 11:56:35.228677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:56:35.228677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 624/1226] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:35.233887 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0903a2-1ca7-437c-91de-d289da86cf31 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:35.284622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:35.348802 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0903a2-1ca7-437c-91de-d289da86cf31 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:35.390011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4d294-7278-4b2f-8c3a-84cf16c4f5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:35.390778 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4d294-7278-4b2f-8c3a-84cf16c4f5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:35.391128 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4d294-7278-4b2f-8c3a-84cf16c4f5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:35.391490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4d294-7278-4b2f-8c3a-84cf16c4f5a4 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:35.392413 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4d294-7278-4b2f-8c3a-84cf16c4f5a4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:35.392735 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4d294-7278-4b2f-8c3a-84cf16c4f5a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:35.394173 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4d294-7278-4b2f-8c3a-84cf16c4f5a4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:35.414405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 603/1227] 10.222.0.41 () {56 vars in 1143 bytes} [Mon May 30 11:56:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:35.420980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bda12c-2760-45cc-9090-fc9685967485 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:35.542479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bda12c-2760-45cc-9090-fc9685967485 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:35.579230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6542f2-2937-47aa-811c-ac9568d38321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:35.580055 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6542f2-2937-47aa-811c-ac9568d38321 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:35.580390 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6542f2-2937-47aa-811c-ac9568d38321 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:35.580648 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6542f2-2937-47aa-811c-ac9568d38321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:35.593714 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6542f2-2937-47aa-811c-ac9568d38321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:35.595362 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6542f2-2937-47aa-811c-ac9568d38321 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:35.614690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-9d6542f2-2937-47aa-811c-ac9568d38321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:35.614690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:35.614690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:35.614690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:35.614690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:35.614690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:35.614690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:35.614690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:35.614690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:35.614690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:35.614690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:35.614690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:35.614690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:35.614690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:35.614690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:35.615635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:35.615635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:35.615635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:35.615635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:35.615635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:35.615635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:35.615635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:35.615635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:35.615635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:56:35.615635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:35.615635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:35.615635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:35.615635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:35.615635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:35.615635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:35.615635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:35.615635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:35.616794 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:35.616794 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:35.616794 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:35.616794 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:56:35.616794 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 625/1228] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:35.622493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4d294-7278-4b2f-8c3a-84cf16c4f5a4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:35.737340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4d294-7278-4b2f-8c3a-84cf16c4f5a4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:35.740092 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:35.780517 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902f6a3-12af-41f6-883c-93b5fc224323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:35.781193 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902f6a3-12af-41f6-883c-93b5fc224323 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:35.781475 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902f6a3-12af-41f6-883c-93b5fc224323 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:35.781752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902f6a3-12af-41f6-883c-93b5fc224323 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:35.782602 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902f6a3-12af-41f6-883c-93b5fc224323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:35.782917 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902f6a3-12af-41f6-883c-93b5fc224323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:35.784466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902f6a3-12af-41f6-883c-93b5fc224323 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:35.796830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 604/1229] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:35.802517 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6542f2-2937-47aa-811c-ac9568d38321 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:35.811852 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:35.917879 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6542f2-2937-47aa-811c-ac9568d38321 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:35.952819 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55309ca4-f943-4230-b021-4b7886ef4f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:35.953615 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55309ca4-f943-4230-b021-4b7886ef4f3f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:35.953900 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55309ca4-f943-4230-b021-4b7886ef4f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:35.954179 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55309ca4-f943-4230-b021-4b7886ef4f3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:35.963867 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55309ca4-f943-4230-b021-4b7886ef4f3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:35.965318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55309ca4-f943-4230-b021-4b7886ef4f3f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:35.983253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-55309ca4-f943-4230-b021-4b7886ef4f3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:35.983253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:35.983253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:35.983253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:35.983253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:35.983253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:35.983253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:35.983253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:35.983253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:35.983253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:35.983253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:35.983253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:35.983253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:35.983253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:35.983253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:35.984414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:35.984414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:35.984414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:35.984414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:35.984414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:35.984414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:35.984414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:35.984414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:35.984414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:56:35.984414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:35.984414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:35.984414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:35.984414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:35.984414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:35.984414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:35.984414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:35.984414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:35.985680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:35.985680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:35.985680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:35.985680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:35.985680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:35.985680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:35.985680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:35.985680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:56:35.985680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 626/1230] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:56:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:35.990504 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902f6a3-12af-41f6-883c-93b5fc224323 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:36.108981 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902f6a3-12af-41f6-883c-93b5fc224323 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:36.149155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556769a3-eab8-4f23-9604-bd5a7afa91f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:36.150394 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556769a3-eab8-4f23-9604-bd5a7afa91f0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:36.150729 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556769a3-eab8-4f23-9604-bd5a7afa91f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:36.151007 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556769a3-eab8-4f23-9604-bd5a7afa91f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:36.151795 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556769a3-eab8-4f23-9604-bd5a7afa91f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:36.152134 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556769a3-eab8-4f23-9604-bd5a7afa91f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:36.153664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556769a3-eab8-4f23-9604-bd5a7afa91f0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:36.166451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 605/1231] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:56:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:36.172305 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55309ca4-f943-4230-b021-4b7886ef4f3f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:36.242868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:36.280845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55309ca4-f943-4230-b021-4b7886ef4f3f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:36.317420 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c7983-9ef5-4e30-844e-d7143ff9d8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:36.318295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c7983-9ef5-4e30-844e-d7143ff9d8fc None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:36.318586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c7983-9ef5-4e30-844e-d7143ff9d8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:36.318862 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c7983-9ef5-4e30-844e-d7143ff9d8fc None admin] PATH_INFO: `/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/48b43eb1a0ac4db5adee3512453459aa/roles/dc57e0b7f67947e0b6b63c4ad0148358` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:36.335248 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c7983-9ef5-4e30-844e-d7143ff9d8fc None admin] RBAC: Authorizing `identity:create_grant(project_id=1e8426fd0e01433b8aa3a3797c687e03, user_id=48b43eb1a0ac4db5adee3512453459aa, role_id=dc57e0b7f67947e0b6b63c4ad0148358)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:36.336969 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c7983-9ef5-4e30-844e-d7143ff9d8fc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:36.351209 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 627/1232] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:56:36 2022] PUT /identity/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/48b43eb1a0ac4db5adee3512453459aa/roles/dc57e0b7f67947e0b6b63c4ad0148358 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 11:56:38.676182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76590d-9a9a-4d05-815e-69074d1e44da None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:38.676182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76590d-9a9a-4d05-815e-69074d1e44da None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:38.676182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76590d-9a9a-4d05-815e-69074d1e44da None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:38.677563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 606/1233] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:56:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:38.685430 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e10c3-b686-4170-96f6-d5df4501a0eb None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:38.685928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e10c3-b686-4170-96f6-d5df4501a0eb None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:38.686022 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e10c3-b686-4170-96f6-d5df4501a0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:38.704008 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-cf9e10c3-b686-4170-96f6-d5df4501a0eb None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:38.705366 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cf9e10c3-b686-4170-96f6-d5df4501a0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:38.793172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 628/1234] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:56:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:56:38.819410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76590d-9a9a-4d05-815e-69074d1e44da None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:38.850770 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:38.939368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76590d-9a9a-4d05-815e-69074d1e44da None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:38.984029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01704127-8714-42c9-925e-3460ad3e35cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:38.984835 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01704127-8714-42c9-925e-3460ad3e35cc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:38.985123 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01704127-8714-42c9-925e-3460ad3e35cc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:38.985399 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01704127-8714-42c9-925e-3460ad3e35cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:38.998373 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01704127-8714-42c9-925e-3460ad3e35cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:39.007429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-01704127-8714-42c9-925e-3460ad3e35cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:39.007429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:39.007429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:39.007429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:39.007429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:39.007429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:39.007429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:39.007429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:39.007429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:39.007429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:39.007429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:39.007429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:39.007429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:39.007429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:39.007429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:39.007429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:39.009202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:39.009202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:39.009202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:39.009202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:39.009202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:39.009202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:39.009202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:39.009202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:39.009202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:39.009202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:39.009202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:39.009202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:56:39.009202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:39.009202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:39.009202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:39.009202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:39.010096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:39.010096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:39.010096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:39.010096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:39.010096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:39.010096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:39.010096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:39.010096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:39.010096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:39.010096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:39.010096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:39.010096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:56:39.010096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 607/1235] 10.222.0.41 () {56 vars in 1102 bytes} [Mon May 30 11:56:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:39.015580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e10c3-b686-4170-96f6-d5df4501a0eb None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:39.068148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:39.128255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e10c3-b686-4170-96f6-d5df4501a0eb None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:39.167140 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f63170-a869-4c45-97c9-8bc38b44c473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:39.167831 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f63170-a869-4c45-97c9-8bc38b44c473 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:39.168124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f63170-a869-4c45-97c9-8bc38b44c473 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:39.168402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f63170-a869-4c45-97c9-8bc38b44c473 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:39.169155 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f63170-a869-4c45-97c9-8bc38b44c473 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:39.169464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f63170-a869-4c45-97c9-8bc38b44c473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:39.170828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f63170-a869-4c45-97c9-8bc38b44c473 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:39.184872 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 629/1236] 10.222.0.41 () {56 vars in 1103 bytes} [Mon May 30 11:56:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:39.186496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01704127-8714-42c9-925e-3460ad3e35cc None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:39.286235 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:39.305363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01704127-8714-42c9-925e-3460ad3e35cc None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:39.343592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6658e-dc04-47d0-ad8e-c5e4655c3a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:39.344463 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6658e-dc04-47d0-ad8e-c5e4655c3a5a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:39.344766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6658e-dc04-47d0-ad8e-c5e4655c3a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:39.345090 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6658e-dc04-47d0-ad8e-c5e4655c3a5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:39.358185 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6658e-dc04-47d0-ad8e-c5e4655c3a5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:39.359767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6658e-dc04-47d0-ad8e-c5e4655c3a5a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:39.379150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-32e6658e-dc04-47d0-ad8e-c5e4655c3a5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:39.379150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:39.379150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:39.379150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:39.379150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:39.379150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:39.379150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:39.379150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:39.379150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:39.379150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:39.379150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:39.379150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:39.379150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:39.379150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:39.379150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:39.380322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:39.380322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:39.380322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:39.380322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:39.380322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:39.380322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:39.380322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:39.380322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:39.380322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:56:39.380322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:39.380322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:39.380322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:39.380322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:39.380322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:39.380322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:39.380322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:39.380322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:39.381243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:39.381243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:39.381243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:39.381243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:56:39.387882 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 608/1237] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:39.388128 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f63170-a869-4c45-97c9-8bc38b44c473 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:39.506343 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f63170-a869-4c45-97c9-8bc38b44c473 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:39.516013 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:39.549071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43db52-45c3-41cd-b367-10090358a705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:39.549780 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43db52-45c3-41cd-b367-10090358a705 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:39.550071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43db52-45c3-41cd-b367-10090358a705 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:39.550346 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43db52-45c3-41cd-b367-10090358a705 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:39.551086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43db52-45c3-41cd-b367-10090358a705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:39.551400 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43db52-45c3-41cd-b367-10090358a705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:39.552850 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43db52-45c3-41cd-b367-10090358a705 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:39.565446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 630/1238] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:39.571960 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6658e-dc04-47d0-ad8e-c5e4655c3a5a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:39.680011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6658e-dc04-47d0-ad8e-c5e4655c3a5a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:39.715718 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47216e11-7e6b-4cd8-84ed-6d36d9cbba80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:39.716551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47216e11-7e6b-4cd8-84ed-6d36d9cbba80 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:39.716839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47216e11-7e6b-4cd8-84ed-6d36d9cbba80 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:39.717116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47216e11-7e6b-4cd8-84ed-6d36d9cbba80 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:39.719794 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:39.725111 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47216e11-7e6b-4cd8-84ed-6d36d9cbba80 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:39.726760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47216e11-7e6b-4cd8-84ed-6d36d9cbba80 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:39.741676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-47216e11-7e6b-4cd8-84ed-6d36d9cbba80 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 30 11:56:39.741676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:39.741676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:39.741676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:39.741676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:39.741676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:39.741676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:39.741676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:39.741676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:39.741676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:39.741676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:39.741676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:39.741676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:39.741676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:39.741676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:39.741676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:39.743885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:39.743885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:39.743885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:39.743885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:39.743885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:39.743885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:39.743885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:39.743885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:39.743885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:39.743885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:39.743885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:39.743885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:56:39.743885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:39.743885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:39.743885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:39.743885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:39.743885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:39.743885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:39.745734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:39.745734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:39.745734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:39.745734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:39.745734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:39.745734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:39.745734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:39.745734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:39.745734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 30 11:56:39.745734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:56:39.750140 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 609/1239] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:39.750304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43db52-45c3-41cd-b367-10090358a705 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:39.859184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43db52-45c3-41cd-b367-10090358a705 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:39.898905 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1dff4-b827-48bf-89e5-fa41e004049d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:39.900328 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1dff4-b827-48bf-89e5-fa41e004049d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:39.900653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1dff4-b827-48bf-89e5-fa41e004049d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:39.900945 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1dff4-b827-48bf-89e5-fa41e004049d None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:39.901864 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1dff4-b827-48bf-89e5-fa41e004049d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:39.902240 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1dff4-b827-48bf-89e5-fa41e004049d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:39.903766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1dff4-b827-48bf-89e5-fa41e004049d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:39.922524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 631/1240] 10.222.0.41 () {56 vars in 1143 bytes} [Mon May 30 11:56:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:39.928334 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47216e11-7e6b-4cd8-84ed-6d36d9cbba80 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:40.038287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47216e11-7e6b-4cd8-84ed-6d36d9cbba80 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:40.076404 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0c417-efcf-473c-a859-10516730ccce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:40.077126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0c417-efcf-473c-a859-10516730ccce None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:40.077487 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0c417-efcf-473c-a859-10516730ccce None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:40.077818 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0c417-efcf-473c-a859-10516730ccce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:40.147519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:40.154702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0c417-efcf-473c-a859-10516730ccce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:40.156218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0c417-efcf-473c-a859-10516730ccce None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:40.267099 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 610/1241] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:56:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 30 11:56:40.273262 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1dff4-b827-48bf-89e5-fa41e004049d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:40.305023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:40.384614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1dff4-b827-48bf-89e5-fa41e004049d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:40.421973 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e650fd8-b4bc-476b-9ece-d320fa915e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:40.422692 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e650fd8-b4bc-476b-9ece-d320fa915e1c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:40.422980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e650fd8-b4bc-476b-9ece-d320fa915e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:40.423257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e650fd8-b4bc-476b-9ece-d320fa915e1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:40.433462 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e650fd8-b4bc-476b-9ece-d320fa915e1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:40.434900 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e650fd8-b4bc-476b-9ece-d320fa915e1c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:40.456918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-3e650fd8-b4bc-476b-9ece-d320fa915e1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:40.456918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:40.456918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:40.456918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:40.456918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:40.456918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:40.456918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:40.456918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:40.456918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:40.456918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:40.456918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:40.456918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:40.456918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:40.456918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:40.456918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:40.458024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:40.458024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:40.458024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:40.458024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:40.458024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:40.458024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:40.458024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:40.458024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:40.458024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:56:40.458024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:40.458024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:40.458024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:40.458024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:40.458024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:40.458024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:40.458024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:40.458024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:40.464018 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:40.464018 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:40.464018 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:40.464018 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:56:40.464018 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 632/1242] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:40.464382 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0c417-efcf-473c-a859-10516730ccce None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:40.575592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:40.582603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0c417-efcf-473c-a859-10516730ccce None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:40.624154 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af43668-ee04-4107-bbd5-41015ea02a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:40.624838 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af43668-ee04-4107-bbd5-41015ea02a39 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:40.625166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af43668-ee04-4107-bbd5-41015ea02a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:40.625456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af43668-ee04-4107-bbd5-41015ea02a39 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:40.626190 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af43668-ee04-4107-bbd5-41015ea02a39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:40.626505 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af43668-ee04-4107-bbd5-41015ea02a39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:40.628039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af43668-ee04-4107-bbd5-41015ea02a39 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:40.640944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 611/1243] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:40.647369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e650fd8-b4bc-476b-9ece-d320fa915e1c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:40.738519 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:40.763668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e650fd8-b4bc-476b-9ece-d320fa915e1c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:40.803766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f607f-cf77-4ee5-9e78-834eb6005752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:40.804604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f607f-cf77-4ee5-9e78-834eb6005752 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:40.804890 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f607f-cf77-4ee5-9e78-834eb6005752 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:40.805172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f607f-cf77-4ee5-9e78-834eb6005752 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:40.814879 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f607f-cf77-4ee5-9e78-834eb6005752 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:40.816908 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f607f-cf77-4ee5-9e78-834eb6005752 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:40.832701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-410f607f-cf77-4ee5-9e78-834eb6005752 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:40.832701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:40.832701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:40.832701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:40.832701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:40.832701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:40.832701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:40.832701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:40.832701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:40.832701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:40.832701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:40.832701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:40.832701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:40.832701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:40.832701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:40.833793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:40.833793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:40.833793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:40.833793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:40.833793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:40.833793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:40.833793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:40.833793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:40.833793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:56:40.833793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:40.833793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:40.833793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:40.833793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:40.833793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:40.833793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:40.833793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:40.833793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:40.834842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:40.834842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:40.834842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:40.834842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:40.834842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:40.834842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:40.834842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:40.834842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:56:40.834842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 633/1244] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:56:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:40.840660 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af43668-ee04-4107-bbd5-41015ea02a39 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:40.951273 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af43668-ee04-4107-bbd5-41015ea02a39 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:40.989053 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216a154-e740-4e07-b18e-69b0cceb625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:40.989756 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216a154-e740-4e07-b18e-69b0cceb625c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:40.990044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216a154-e740-4e07-b18e-69b0cceb625c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:40.990360 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216a154-e740-4e07-b18e-69b0cceb625c None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:40.991325 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216a154-e740-4e07-b18e-69b0cceb625c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:40.991643 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216a154-e740-4e07-b18e-69b0cceb625c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:40.994361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216a154-e740-4e07-b18e-69b0cceb625c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:41.010046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 612/1245] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:56:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:41.016172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f607f-cf77-4ee5-9e78-834eb6005752 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:41.130185 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f607f-cf77-4ee5-9e78-834eb6005752 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:41.168577 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54da3a-a909-4b4b-9cdf-97e3a8698521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:41.169229 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54da3a-a909-4b4b-9cdf-97e3a8698521 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:41.169524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54da3a-a909-4b4b-9cdf-97e3a8698521 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:41.169815 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54da3a-a909-4b4b-9cdf-97e3a8698521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:41.170650 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54da3a-a909-4b4b-9cdf-97e3a8698521 None admin] RBAC: Adding query filter params (role.id=dc57e0b7f67947e0b6b63c4ad0148358, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=48b43eb1a0ac4db5adee3512453459aa) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:41.170964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54da3a-a909-4b4b-9cdf-97e3a8698521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:41.172471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54da3a-a909-4b4b-9cdf-97e3a8698521 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:41.191852 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 634/1246] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:56:41 2022] GET /identity/v3/role_assignments?user.id=48b43eb1a0ac4db5adee3512453459aa&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=dc57e0b7f67947e0b6b63c4ad0148358 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:43.779165 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f35353-fc8e-40a9-9915-c8320fec45b2 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:43.779610 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f35353-fc8e-40a9-9915-c8320fec45b2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:43.779805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f35353-fc8e-40a9-9915-c8320fec45b2 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:43.781606 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 613/1247] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:56:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:43.787370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7d733-52de-4b0e-88a3-9ed4dc2172bb None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:43.787891 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7d733-52de-4b0e-88a3-9ed4dc2172bb None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:43.788045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7d733-52de-4b0e-88a3-9ed4dc2172bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:43.794690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:43.808909 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-fbd7d733-52de-4b0e-88a3-9ed4dc2172bb None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:43.810222 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-fbd7d733-52de-4b0e-88a3-9ed4dc2172bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:43.888002 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 635/1248] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:56:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:56:43.913697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f35353-fc8e-40a9-9915-c8320fec45b2 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:43.933594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:44.020410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f35353-fc8e-40a9-9915-c8320fec45b2 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:44.055757 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60184e6d-9450-404e-add1-726d9f0b4540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:44.056616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60184e6d-9450-404e-add1-726d9f0b4540 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:44.056898 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60184e6d-9450-404e-add1-726d9f0b4540 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:44.057170 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60184e6d-9450-404e-add1-726d9f0b4540 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:44.068074 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60184e6d-9450-404e-add1-726d9f0b4540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:44.076356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-60184e6d-9450-404e-add1-726d9f0b4540 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:56:44.076356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:44.076356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:44.076356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:44.076356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:44.076356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:44.076356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:44.076356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:44.076356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:44.076356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:44.076356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:44.076356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:44.076356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:44.076356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:44.076356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:44.076356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:44.077562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:44.077562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:44.077562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:44.077562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:44.077562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:44.077562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:44.077562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:44.077562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:44.077562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:44.077562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:44.077562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:44.077562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:56:44.077562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:44.077562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:44.077562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:44.077562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:44.078629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:44.078629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:44.078629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:44.078629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:44.078629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:44.078629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:44.078629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:44.078629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:44.078629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:44.078629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:44.078629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:56:44.078629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:56:44.078629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 614/1249] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:56:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:44.083517 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7d733-52de-4b0e-88a3-9ed4dc2172bb None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:44.196480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7d733-52de-4b0e-88a3-9ed4dc2172bb None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:44.228010 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:44.233791 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343bcec-99f4-4cb6-8783-f30009e111a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:44.234526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343bcec-99f4-4cb6-8783-f30009e111a6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:44.234811 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343bcec-99f4-4cb6-8783-f30009e111a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:44.235095 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343bcec-99f4-4cb6-8783-f30009e111a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:44.235863 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343bcec-99f4-4cb6-8783-f30009e111a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:44.236176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343bcec-99f4-4cb6-8783-f30009e111a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:44.237529 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343bcec-99f4-4cb6-8783-f30009e111a6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:44.247472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 636/1250] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:56:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:44.253275 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60184e6d-9450-404e-add1-726d9f0b4540 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:44.342030 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:44.368512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60184e6d-9450-404e-add1-726d9f0b4540 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:44.408018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac03f0-f6a8-430d-a153-58d955bc4937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:44.408820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac03f0-f6a8-430d-a153-58d955bc4937 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:44.409107 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac03f0-f6a8-430d-a153-58d955bc4937 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:44.409383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac03f0-f6a8-430d-a153-58d955bc4937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:44.420416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac03f0-f6a8-430d-a153-58d955bc4937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:44.421951 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac03f0-f6a8-430d-a153-58d955bc4937 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:44.441577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-42ac03f0-f6a8-430d-a153-58d955bc4937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:44.441577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:44.441577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:44.441577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:44.441577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:44.441577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:44.441577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:44.441577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:44.441577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:44.441577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:44.441577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:44.441577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:44.441577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:44.441577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:44.441577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:44.442690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:44.442690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:44.442690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:44.442690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:44.442690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:44.442690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:44.442690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:44.442690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:44.442690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:56:44.442690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:44.442690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:44.442690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:44.442690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:44.442690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:44.442690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:44.442690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:44.442690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:44.443608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:44.443608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:44.443608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:44.443608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:56:44.443608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 615/1251] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:44.449476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343bcec-99f4-4cb6-8783-f30009e111a6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:44.573478 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343bcec-99f4-4cb6-8783-f30009e111a6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:44.612109 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb8e78-0aa5-49eb-8f78-1734a8354765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:44.612698 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb8e78-0aa5-49eb-8f78-1734a8354765 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:44.613058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb8e78-0aa5-49eb-8f78-1734a8354765 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:44.613338 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb8e78-0aa5-49eb-8f78-1734a8354765 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:44.614202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb8e78-0aa5-49eb-8f78-1734a8354765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:44.614578 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb8e78-0aa5-49eb-8f78-1734a8354765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:44.616065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb8e78-0aa5-49eb-8f78-1734a8354765 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:44.629956 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 637/1252] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:44.637106 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac03f0-f6a8-430d-a153-58d955bc4937 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:44.749191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac03f0-f6a8-430d-a153-58d955bc4937 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:44.783604 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:44.793035 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510541ef-7097-42d6-8abe-ae553ed58a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:44.793914 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510541ef-7097-42d6-8abe-ae553ed58a87 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:44.794210 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510541ef-7097-42d6-8abe-ae553ed58a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:44.794487 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510541ef-7097-42d6-8abe-ae553ed58a87 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:44.804144 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510541ef-7097-42d6-8abe-ae553ed58a87 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:44.805667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510541ef-7097-42d6-8abe-ae553ed58a87 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:44.822159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-510541ef-7097-42d6-8abe-ae553ed58a87 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 30 11:56:44.822159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:44.822159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:44.822159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:44.822159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:44.822159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:44.822159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:44.822159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:44.822159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:44.822159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:44.822159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:44.822159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:44.822159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:44.822159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:44.822159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:44.822159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:44.823379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:44.823379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:44.823379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:44.823379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:44.823379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:44.823379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:44.823379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:44.823379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:44.823379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:44.823379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:44.823379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:44.823379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:56:44.823379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:44.823379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:44.823379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:44.823379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:44.823379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:44.823379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:44.829692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:44.829692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:44.829692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:44.829692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:44.829692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:44.829692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:44.829692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:44.829692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:44.829692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 30 11:56:44.829692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:56:44.829692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 616/1253] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:44.830903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb8e78-0aa5-49eb-8f78-1734a8354765 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:44.892105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:44.939110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb8e78-0aa5-49eb-8f78-1734a8354765 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:44.976596 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761d6a2-01a1-485f-9bba-f38a10cd8b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:44.978255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761d6a2-01a1-485f-9bba-f38a10cd8b1c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:44.978546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761d6a2-01a1-485f-9bba-f38a10cd8b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:44.978820 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761d6a2-01a1-485f-9bba-f38a10cd8b1c None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:44.979677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761d6a2-01a1-485f-9bba-f38a10cd8b1c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:44.980020 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761d6a2-01a1-485f-9bba-f38a10cd8b1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:44.981481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761d6a2-01a1-485f-9bba-f38a10cd8b1c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:45.006037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 638/1254] 10.222.0.41 () {56 vars in 1143 bytes} [Mon May 30 11:56:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:45.007268 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510541ef-7097-42d6-8abe-ae553ed58a87 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:45.112809 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510541ef-7097-42d6-8abe-ae553ed58a87 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:45.149056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996401e-b5a8-4a82-915f-315bc652b6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:45.150432 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996401e-b5a8-4a82-915f-315bc652b6bf None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:45.150540 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996401e-b5a8-4a82-915f-315bc652b6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:45.150773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996401e-b5a8-4a82-915f-315bc652b6bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:45.208851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:45.221537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996401e-b5a8-4a82-915f-315bc652b6bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:45.223007 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996401e-b5a8-4a82-915f-315bc652b6bf None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:45.324945 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 617/1255] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:56:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:56:45.330842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761d6a2-01a1-485f-9bba-f38a10cd8b1c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:45.433495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761d6a2-01a1-485f-9bba-f38a10cd8b1c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:45.446835 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:45.470771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ee1c4-9914-4406-98a7-f61b694cf612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:45.471574 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ee1c4-9914-4406-98a7-f61b694cf612 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:45.471982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ee1c4-9914-4406-98a7-f61b694cf612 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:45.472219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ee1c4-9914-4406-98a7-f61b694cf612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:45.485173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ee1c4-9914-4406-98a7-f61b694cf612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:45.486796 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ee1c4-9914-4406-98a7-f61b694cf612 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:45.508082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-9c6ee1c4-9914-4406-98a7-f61b694cf612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:45.508082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:45.508082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:45.508082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:45.508082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:45.508082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:45.508082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:45.508082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:45.508082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:45.508082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:45.508082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:45.508082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:45.508082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:45.508082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:45.508082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:45.509215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:45.509215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:45.509215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:45.509215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:45.509215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:45.509215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:45.509215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:45.509215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:45.509215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:56:45.509215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:45.509215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:45.509215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:45.509215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:45.509215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:45.509215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:45.509215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:45.509215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:45.510325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:45.510325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:45.510325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:45.510325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:56:45.510325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 639/1256] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:45.516332 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996401e-b5a8-4a82-915f-315bc652b6bf None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:45.603176 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:45.615005 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996401e-b5a8-4a82-915f-315bc652b6bf None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:45.648174 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a1b42-4e31-4984-8110-62a40a38f33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:45.648828 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a1b42-4e31-4984-8110-62a40a38f33e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:45.649197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a1b42-4e31-4984-8110-62a40a38f33e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:45.649479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a1b42-4e31-4984-8110-62a40a38f33e None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:45.650198 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a1b42-4e31-4984-8110-62a40a38f33e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:45.650510 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a1b42-4e31-4984-8110-62a40a38f33e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:45.651899 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a1b42-4e31-4984-8110-62a40a38f33e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:45.662820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 618/1257] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:45.668845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ee1c4-9914-4406-98a7-f61b694cf612 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:45.765367 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ee1c4-9914-4406-98a7-f61b694cf612 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:45.800746 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e1cfc-b7eb-485a-b4d0-972d637b496e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:45.801523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e1cfc-b7eb-485a-b4d0-972d637b496e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:45.801807 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e1cfc-b7eb-485a-b4d0-972d637b496e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:45.802084 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e1cfc-b7eb-485a-b4d0-972d637b496e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:45.809357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e1cfc-b7eb-485a-b4d0-972d637b496e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:45.810790 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e1cfc-b7eb-485a-b4d0-972d637b496e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:45.824340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ec8e1cfc-b7eb-485a-b4d0-972d637b496e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:45.824340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:45.824340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:45.824340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:45.824340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:45.824340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:45.824340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:45.824340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:45.824340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:45.824340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:45.824340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:45.824340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:45.824340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:45.824340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:45.824340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:45.825388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:45.825388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:45.825388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:45.825388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:45.825388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:45.825388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:45.825388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:45.825388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:45.825388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:56:45.825388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:45.825388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:45.825388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:45.825388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:45.825388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:45.825388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:45.825388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:45.825388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:45.826357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:45.826357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:45.826357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:45.826357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:45.826357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:45.826357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:45.826357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:45.826357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:56:45.826357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 640/1258] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:56:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:45.831216 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a1b42-4e31-4984-8110-62a40a38f33e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:45.929058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a1b42-4e31-4984-8110-62a40a38f33e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:45.962142 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325f3d9-7928-4731-8d31-0ae00219f6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:45.962790 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325f3d9-7928-4731-8d31-0ae00219f6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:45.963076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325f3d9-7928-4731-8d31-0ae00219f6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:45.963357 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325f3d9-7928-4731-8d31-0ae00219f6b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:45.964166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325f3d9-7928-4731-8d31-0ae00219f6b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:45.964482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325f3d9-7928-4731-8d31-0ae00219f6b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:45.965913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325f3d9-7928-4731-8d31-0ae00219f6b6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:45.978307 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 619/1259] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:56:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:45.984321 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e1cfc-b7eb-485a-b4d0-972d637b496e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:46.009526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:46.081516 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e1cfc-b7eb-485a-b4d0-972d637b496e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:46.113840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8265a-081b-47fe-8216-8ed1829375e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:46.114480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8265a-081b-47fe-8216-8ed1829375e7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:46.114780 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8265a-081b-47fe-8216-8ed1829375e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:46.115039 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8265a-081b-47fe-8216-8ed1829375e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:46.115896 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8265a-081b-47fe-8216-8ed1829375e7 None admin] RBAC: Adding query filter params (role.id=8196ef570097443bac15d3cf39878486, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=48b43eb1a0ac4db5adee3512453459aa) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:46.116212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8265a-081b-47fe-8216-8ed1829375e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:46.118689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8265a-081b-47fe-8216-8ed1829375e7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:46.123735 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 641/1260] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:56:45 2022] GET /identity/v3/role_assignments?user.id=48b43eb1a0ac4db5adee3512453459aa&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=8196ef570097443bac15d3cf39878486 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:48.337341 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d475a7-74a5-44da-90e9-4fb6d8770ccf None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:48.337909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d475a7-74a5-44da-90e9-4fb6d8770ccf None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:48.338331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d475a7-74a5-44da-90e9-4fb6d8770ccf None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:48.340420 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 620/1261] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:56:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:48.345678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a978c-156e-4834-8400-f5085118f292 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:48.346047 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a978c-156e-4834-8400-f5085118f292 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:48.346246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a978c-156e-4834-8400-f5085118f292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:48.363944 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8e1a978c-156e-4834-8400-f5085118f292 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:48.365126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8e1a978c-156e-4834-8400-f5085118f292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:48.430547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 642/1262] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:56:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:56:48.453111 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d475a7-74a5-44da-90e9-4fb6d8770ccf None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:48.464298 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:48.568987 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d475a7-74a5-44da-90e9-4fb6d8770ccf None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:48.604837 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0fc4d-c31f-40af-a9ac-b1e597d9e9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:48.605558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0fc4d-c31f-40af-a9ac-b1e597d9e9cd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:48.605837 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0fc4d-c31f-40af-a9ac-b1e597d9e9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:48.606108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0fc4d-c31f-40af-a9ac-b1e597d9e9cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:48.615733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0fc4d-c31f-40af-a9ac-b1e597d9e9cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:48.624029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-1be0fc4d-c31f-40af-a9ac-b1e597d9e9cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:56:48.624029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:48.624029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:48.624029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:48.624029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:48.624029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:48.624029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:48.624029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:48.624029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:48.624029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:48.624029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:48.624029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:48.624029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:48.624029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:48.624029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:48.624029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:48.625126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:48.625126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:48.625126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:48.625126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:48.625126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:48.625126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:48.625126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:48.625126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:48.625126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:48.625126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:48.625126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:48.625126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:56:48.625126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:48.625126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:48.625126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:48.625126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:48.626028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:48.626028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:48.626028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:48.626028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:48.626028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:48.626028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:48.626028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:48.626028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:48.626028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:48.626028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:48.626028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:56:48.626028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:56:48.626028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 621/1263] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:56:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:48.631205 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a978c-156e-4834-8400-f5085118f292 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:48.650191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:48.730006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a978c-156e-4834-8400-f5085118f292 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:48.763340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b569da-40fe-4e98-94ac-41f66d2fad4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:48.764035 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b569da-40fe-4e98-94ac-41f66d2fad4c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:48.764326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b569da-40fe-4e98-94ac-41f66d2fad4c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:48.764608 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b569da-40fe-4e98-94ac-41f66d2fad4c None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:48.765363 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b569da-40fe-4e98-94ac-41f66d2fad4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:48.765675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b569da-40fe-4e98-94ac-41f66d2fad4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:48.767049 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b569da-40fe-4e98-94ac-41f66d2fad4c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:48.776854 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 643/1264] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:56:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:48.782622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0fc4d-c31f-40af-a9ac-b1e597d9e9cd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:48.847295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:48.880310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0fc4d-c31f-40af-a9ac-b1e597d9e9cd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:48.913616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea9bfc-0418-4837-a93f-6c5c0d8875a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:48.914393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea9bfc-0418-4837-a93f-6c5c0d8875a2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:48.914705 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea9bfc-0418-4837-a93f-6c5c0d8875a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:48.914979 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea9bfc-0418-4837-a93f-6c5c0d8875a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:48.925320 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea9bfc-0418-4837-a93f-6c5c0d8875a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:48.926768 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea9bfc-0418-4837-a93f-6c5c0d8875a2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:48.943858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-ccea9bfc-0418-4837-a93f-6c5c0d8875a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:48.943858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:48.943858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:48.943858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:48.943858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:48.943858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:48.943858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:48.943858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:48.943858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:48.943858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:48.943858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:48.943858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:48.943858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:48.943858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:48.943858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:48.944738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:48.944738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:48.944738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:48.944738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:48.944738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:48.944738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:48.944738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:48.944738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:48.944738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:56:48.944738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:48.944738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:48.944738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:48.944738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:48.944738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:48.944738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:48.944738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:48.944738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:48.945616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:48.945616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:48.945616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:48.945616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:56:48.945616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 622/1265] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:48.951381 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b569da-40fe-4e98-94ac-41f66d2fad4c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:49.030902 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:49.049929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b569da-40fe-4e98-94ac-41f66d2fad4c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:49.083326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491d97c-a3bf-47f5-ae73-384fbec98652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:49.084006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491d97c-a3bf-47f5-ae73-384fbec98652 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:49.084295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491d97c-a3bf-47f5-ae73-384fbec98652 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:49.084572 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491d97c-a3bf-47f5-ae73-384fbec98652 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:49.085297 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491d97c-a3bf-47f5-ae73-384fbec98652 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:49.085606 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491d97c-a3bf-47f5-ae73-384fbec98652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:49.086966 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491d97c-a3bf-47f5-ae73-384fbec98652 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:49.098437 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 644/1266] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:49.104458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea9bfc-0418-4837-a93f-6c5c0d8875a2 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:49.202051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea9bfc-0418-4837-a93f-6c5c0d8875a2 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:49.220855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:49.234986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd1229-56a7-4a92-9abf-9ffc825ef1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:49.235780 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd1229-56a7-4a92-9abf-9ffc825ef1ac None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:49.236089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd1229-56a7-4a92-9abf-9ffc825ef1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:49.236369 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd1229-56a7-4a92-9abf-9ffc825ef1ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:49.244739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd1229-56a7-4a92-9abf-9ffc825ef1ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:49.246178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd1229-56a7-4a92-9abf-9ffc825ef1ac None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:49.260805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-9edd1229-56a7-4a92-9abf-9ffc825ef1ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 30 11:56:49.260805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:49.260805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:49.260805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:49.260805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:49.260805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:49.260805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:49.260805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:49.260805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:49.260805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:49.260805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:49.260805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:49.260805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:49.260805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:49.260805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:49.260805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:49.261903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:49.261903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:49.261903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:49.261903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:49.261903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:49.261903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:49.261903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:49.261903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:49.261903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:49.261903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:49.261903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:49.261903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:56:49.261903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:49.261903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:49.261903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:49.261903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:49.261903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:49.261903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:49.263067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:49.263067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:49.263067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:49.263067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:49.263067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:49.263067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:49.263067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:49.263067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:49.263067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 30 11:56:49.263067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:56:49.263067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 623/1267] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:49.267743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491d97c-a3bf-47f5-ae73-384fbec98652 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:49.364234 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491d97c-a3bf-47f5-ae73-384fbec98652 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:49.397662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f16207-3951-4a46-8309-24291d0ea9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:49.398312 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f16207-3951-4a46-8309-24291d0ea9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:49.398592 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f16207-3951-4a46-8309-24291d0ea9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:49.398889 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f16207-3951-4a46-8309-24291d0ea9d6 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:49.400253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f16207-3951-4a46-8309-24291d0ea9d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:49.400565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f16207-3951-4a46-8309-24291d0ea9d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:49.401971 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f16207-3951-4a46-8309-24291d0ea9d6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:49.410212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:49.419204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 645/1268] 10.222.0.41 () {56 vars in 1143 bytes} [Mon May 30 11:56:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:49.424776 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd1229-56a7-4a92-9abf-9ffc825ef1ac None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:49.529189 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd1229-56a7-4a92-9abf-9ffc825ef1ac None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:49.562834 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b140e-56e2-4205-9a91-2b780aea9235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:49.563616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b140e-56e2-4205-9a91-2b780aea9235 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:49.563932 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b140e-56e2-4205-9a91-2b780aea9235 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:49.564214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b140e-56e2-4205-9a91-2b780aea9235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:49.574839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b140e-56e2-4205-9a91-2b780aea9235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:49.576336 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b140e-56e2-4205-9a91-2b780aea9235 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:49.593618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-535b140e-56e2-4205-9a91-2b780aea9235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:49.593618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:49.593618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:49.593618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:49.593618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:49.593618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:49.593618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:49.593618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:49.593618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:49.593618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:49.593618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:49.593618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:49.593618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:49.593618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:49.593618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:49.594721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:49.594721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:49.594721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:49.594721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:49.594721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:49.594721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:49.594721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:49.594721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:49.594721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:56:49.594721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:49.594721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:49.594721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:49.594721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:49.594721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:49.594721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:49.594721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:49.594721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:49.595648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:49.595648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:49.595648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:49.595648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:56:49.595648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 624/1269] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:49.600484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f16207-3951-4a46-8309-24291d0ea9d6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:49.697838 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f16207-3951-4a46-8309-24291d0ea9d6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:49.731066 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a8262-29d5-4063-b2c2-ff16a6cab341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:49.731720 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a8262-29d5-4063-b2c2-ff16a6cab341 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:49.732040 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a8262-29d5-4063-b2c2-ff16a6cab341 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:49.732326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a8262-29d5-4063-b2c2-ff16a6cab341 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:49.733046 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a8262-29d5-4063-b2c2-ff16a6cab341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:49.733358 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a8262-29d5-4063-b2c2-ff16a6cab341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:49.734722 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a8262-29d5-4063-b2c2-ff16a6cab341 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:49.746307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 646/1270] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:49.751859 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b140e-56e2-4205-9a91-2b780aea9235 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:49.783475 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:49.855902 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b140e-56e2-4205-9a91-2b780aea9235 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:49.888406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c07c0a-ec65-4b5f-9aae-94687182527f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:49.889192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c07c0a-ec65-4b5f-9aae-94687182527f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:49.889481 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c07c0a-ec65-4b5f-9aae-94687182527f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:49.889760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c07c0a-ec65-4b5f-9aae-94687182527f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:49.896318 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c07c0a-ec65-4b5f-9aae-94687182527f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:49.897774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c07c0a-ec65-4b5f-9aae-94687182527f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:49.915654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-16c07c0a-ec65-4b5f-9aae-94687182527f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:49.915654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:49.915654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:49.915654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:49.915654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:49.915654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:49.915654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:49.915654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:49.915654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:49.915654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:49.915654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:49.915654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:49.915654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:49.915654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:49.915654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:49.916855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:49.916855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:49.916855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:49.916855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:49.916855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:49.916855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:49.916855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:49.916855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:49.916855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:56:49.916855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:49.916855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:49.916855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:49.916855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:49.916855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:49.916855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:49.916855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:49.916855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:49.917977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:49.917977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:49.917977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:49.917977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:49.917977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:49.917977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:49.917977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:49.917977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:56:49.918545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 625/1271] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:56:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:49.924833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a8262-29d5-4063-b2c2-ff16a6cab341 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:50.000325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:50.045692 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a8262-29d5-4063-b2c2-ff16a6cab341 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:50.080558 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280903d-5d6d-4524-9715-c94cff28e3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:50.081218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280903d-5d6d-4524-9715-c94cff28e3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:50.081496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280903d-5d6d-4524-9715-c94cff28e3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:50.081769 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280903d-5d6d-4524-9715-c94cff28e3f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:50.082560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280903d-5d6d-4524-9715-c94cff28e3f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:50.082868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280903d-5d6d-4524-9715-c94cff28e3f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:50.084337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280903d-5d6d-4524-9715-c94cff28e3f0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:50.097837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 647/1272] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:56:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:50.104175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c07c0a-ec65-4b5f-9aae-94687182527f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:50.206321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:50.216370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c07c0a-ec65-4b5f-9aae-94687182527f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:50.254277 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2606f-e63e-4cdd-a51f-5a705a54675c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:50.255160 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2606f-e63e-4cdd-a51f-5a705a54675c None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:50.255445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2606f-e63e-4cdd-a51f-5a705a54675c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:50.255723 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2606f-e63e-4cdd-a51f-5a705a54675c None admin] PATH_INFO: `/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/48b43eb1a0ac4db5adee3512453459aa/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:50.258034 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2606f-e63e-4cdd-a51f-5a705a54675c None admin] RBAC: Authorizing `identity:create_grant(project_id=1e8426fd0e01433b8aa3a3797c687e03, user_id=48b43eb1a0ac4db5adee3512453459aa, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:50.260038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2606f-e63e-4cdd-a51f-5a705a54675c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:50.276437 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 626/1273] 10.222.0.41 () {58 vars in 1439 bytes} [Mon May 30 11:56:50 2022] PUT /identity/v3/projects/1e8426fd0e01433b8aa3a3797c687e03/users/48b43eb1a0ac4db5adee3512453459aa/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:56:52.514345 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd732f40-59c1-4809-912f-e223d067a6f5 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:52.514947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd732f40-59c1-4809-912f-e223d067a6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:52.515047 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd732f40-59c1-4809-912f-e223d067a6f5 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:52.516665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 648/1274] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:56:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:52.522000 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d4f4e-fd7a-4d87-878e-2df22a21fec3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:52.522393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d4f4e-fd7a-4d87-878e-2df22a21fec3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:52.522604 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d4f4e-fd7a-4d87-878e-2df22a21fec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:52.542465 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ef9d4f4e-fd7a-4d87-878e-2df22a21fec3 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:52.543894 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ef9d4f4e-fd7a-4d87-878e-2df22a21fec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:52.609067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 627/1275] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:56:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:56:52.633818 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd732f40-59c1-4809-912f-e223d067a6f5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:52.730079 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd732f40-59c1-4809-912f-e223d067a6f5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:52.747069 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:52.767216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0e4b9-dea5-4ed2-8590-9ea290d9b4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:52.767216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0e4b9-dea5-4ed2-8590-9ea290d9b4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:52.767216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0e4b9-dea5-4ed2-8590-9ea290d9b4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:52.767216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0e4b9-dea5-4ed2-8590-9ea290d9b4b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:52.777050 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0e4b9-dea5-4ed2-8590-9ea290d9b4b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:52.784526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-d7a0e4b9-dea5-4ed2-8590-9ea290d9b4b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:56:52.784526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:52.784526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:52.784526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:52.784526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:52.784526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:52.784526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:52.784526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:52.784526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:52.784526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:52.784526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:52.784526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:52.784526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:52.784526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:52.784526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:52.784526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:52.785546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:52.785546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:52.785546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:52.785546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:52.785546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:52.785546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:52.785546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:52.785546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:52.785546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:52.785546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:52.785546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:52.785546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:56:52.785546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:52.785546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:52.785546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:52.785546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:52.786368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:52.786368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:52.786368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:52.786368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:52.786368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:52.786368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:52.786368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:52.786368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:52.786368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:52.786368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:52.786368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:56:52.786368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:56:52.786368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 649/1276] 10.222.0.41 () {56 vars in 1096 bytes} [Mon May 30 11:56:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:52.791681 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d4f4e-fd7a-4d87-878e-2df22a21fec3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:52.870304 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:52.890077 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d4f4e-fd7a-4d87-878e-2df22a21fec3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:52.922345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5e9e7-6bba-4064-9973-3d127d59dc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:52.923003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5e9e7-6bba-4064-9973-3d127d59dc38 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:52.923289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5e9e7-6bba-4064-9973-3d127d59dc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:52.923566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5e9e7-6bba-4064-9973-3d127d59dc38 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:52.924337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5e9e7-6bba-4064-9973-3d127d59dc38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:52.924653 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5e9e7-6bba-4064-9973-3d127d59dc38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:52.926014 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5e9e7-6bba-4064-9973-3d127d59dc38 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:52.934333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 628/1277] 10.222.0.41 () {56 vars in 1099 bytes} [Mon May 30 11:56:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:52.940071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0e4b9-dea5-4ed2-8590-9ea290d9b4b9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:53.043810 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0e4b9-dea5-4ed2-8590-9ea290d9b4b9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:53.077196 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450f795-bace-4ba3-ad98-41e3cfeb924c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:53.077964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450f795-bace-4ba3-ad98-41e3cfeb924c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:53.078240 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450f795-bace-4ba3-ad98-41e3cfeb924c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:53.078510 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450f795-bace-4ba3-ad98-41e3cfeb924c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:53.089210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450f795-bace-4ba3-ad98-41e3cfeb924c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:53.090632 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450f795-bace-4ba3-ad98-41e3cfeb924c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:53.108016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-4450f795-bace-4ba3-ad98-41e3cfeb924c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:53.108016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:53.108016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:53.108016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:53.108016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:53.108016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:53.108016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:53.108016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:53.108016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:53.108016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:53.108016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:53.108016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:53.108016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:53.108016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:53.108016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:53.109098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:53.109098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:53.109098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:53.109098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:53.109098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:53.109098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:53.109098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:53.109098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:53.109098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:56:53.109098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:53.109098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:53.109098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:53.109098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:53.109098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:53.109098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:53.109098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:53.109098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:53.110231 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:53.110231 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:53.110231 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:53.110231 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:56:53.110231 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 650/1278] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:53.114947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5e9e7-6bba-4064-9973-3d127d59dc38 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:53.212060 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5e9e7-6bba-4064-9973-3d127d59dc38 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:53.244672 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2c81d-713e-4f2b-999d-56e6fcb65fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:53.245326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2c81d-713e-4f2b-999d-56e6fcb65fbb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:53.245614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2c81d-713e-4f2b-999d-56e6fcb65fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:53.245894 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2c81d-713e-4f2b-999d-56e6fcb65fbb None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:53.246623 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2c81d-713e-4f2b-999d-56e6fcb65fbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:53.246935 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2c81d-713e-4f2b-999d-56e6fcb65fbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:53.248340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2c81d-713e-4f2b-999d-56e6fcb65fbb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:53.260399 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 629/1279] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:53.266093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450f795-bace-4ba3-ad98-41e3cfeb924c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:53.296847 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:53.365384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450f795-bace-4ba3-ad98-41e3cfeb924c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:53.398774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d3867-5e0c-41d0-a4aa-c4ca6345ba05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:53.399565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d3867-5e0c-41d0-a4aa-c4ca6345ba05 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:53.400223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d3867-5e0c-41d0-a4aa-c4ca6345ba05 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:53.400354 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d3867-5e0c-41d0-a4aa-c4ca6345ba05 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:53.407542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d3867-5e0c-41d0-a4aa-c4ca6345ba05 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:53.409012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d3867-5e0c-41d0-a4aa-c4ca6345ba05 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:53.423086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-d03d3867-5e0c-41d0-a4aa-c4ca6345ba05 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 30 11:56:53.423086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:53.423086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:53.423086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:53.423086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:53.423086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:53.423086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:53.423086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:53.423086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:53.423086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:53.423086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:53.423086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:53.423086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:53.423086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:53.423086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:53.423086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:53.424232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:53.424232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:53.424232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:53.424232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:53.424232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:53.424232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:53.424232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:53.424232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:53.424232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:53.424232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:53.424232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:53.424232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:56:53.424232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:53.424232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:53.424232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:53.424232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:53.424232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:53.424232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:53.425302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:53.425302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:53.425302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:53.425302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:53.425302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:53.425302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:53.425302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:53.425302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:53.425302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 30 11:56:53.425302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:56:53.425302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 651/1280] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:53.430142 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2c81d-713e-4f2b-999d-56e6fcb65fbb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:53.434527 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:53.530906 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2c81d-713e-4f2b-999d-56e6fcb65fbb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:53.563958 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96a6c8-8ce3-42ed-9883-23ad01a43f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:53.564571 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96a6c8-8ce3-42ed-9883-23ad01a43f3c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:53.564859 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96a6c8-8ce3-42ed-9883-23ad01a43f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:53.565140 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96a6c8-8ce3-42ed-9883-23ad01a43f3c None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:53.565988 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96a6c8-8ce3-42ed-9883-23ad01a43f3c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:53.566303 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96a6c8-8ce3-42ed-9883-23ad01a43f3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:53.567738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96a6c8-8ce3-42ed-9883-23ad01a43f3c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:53.585761 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 630/1281] 10.222.0.41 () {56 vars in 1143 bytes} [Mon May 30 11:56:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:53.592008 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d3867-5e0c-41d0-a4aa-c4ca6345ba05 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:53.680269 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:53.690491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d3867-5e0c-41d0-a4aa-c4ca6345ba05 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:53.723375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad3bf9-43db-4f5c-93f6-2a1bb81d658e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:53.724034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad3bf9-43db-4f5c-93f6-2a1bb81d658e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:53.724324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad3bf9-43db-4f5c-93f6-2a1bb81d658e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:53.724606 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad3bf9-43db-4f5c-93f6-2a1bb81d658e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:53.791350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad3bf9-43db-4f5c-93f6-2a1bb81d658e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:53.792832 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad3bf9-43db-4f5c-93f6-2a1bb81d658e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:53.881141 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:53.891475 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 652/1282] 10.222.0.41 () {58 vars in 1282 bytes} [Mon May 30 11:56:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:56:53.897257 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96a6c8-8ce3-42ed-9883-23ad01a43f3c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:53.956321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:53.994850 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96a6c8-8ce3-42ed-9883-23ad01a43f3c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:54.027470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f86e79-171c-4aa7-b6c4-f0df64505cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:54.028287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f86e79-171c-4aa7-b6c4-f0df64505cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:54.028573 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f86e79-171c-4aa7-b6c4-f0df64505cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:54.028851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f86e79-171c-4aa7-b6c4-f0df64505cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:54.038627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f86e79-171c-4aa7-b6c4-f0df64505cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:54.040093 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f86e79-171c-4aa7-b6c4-f0df64505cb3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:54.058207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-49f86e79-171c-4aa7-b6c4-f0df64505cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:54.058207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:54.058207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:54.058207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:54.058207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:54.058207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:54.058207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:54.058207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:54.058207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:54.058207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:54.058207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:54.058207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:54.058207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:54.058207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:54.058207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:54.059228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:54.059228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:54.059228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:54.059228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:54.059228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:54.059228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:54.059228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:54.059228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:54.059228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:56:54.059228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:54.059228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:54.059228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:54.059228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:54.059228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:54.059228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:54.059228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:54.059228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:54.060219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:54.060219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:54.060219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:54.060219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:56:54.060219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 631/1283] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 11:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:54.064994 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad3bf9-43db-4f5c-93f6-2a1bb81d658e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:54.160614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad3bf9-43db-4f5c-93f6-2a1bb81d658e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:54.194950 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff5774-d20a-4274-b83b-f2274c1afa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:54.195593 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff5774-d20a-4274-b83b-f2274c1afa6d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:54.195903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff5774-d20a-4274-b83b-f2274c1afa6d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:54.196181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff5774-d20a-4274-b83b-f2274c1afa6d None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:54.197019 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff5774-d20a-4274-b83b-f2274c1afa6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:54.197328 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff5774-d20a-4274-b83b-f2274c1afa6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:54.198678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff5774-d20a-4274-b83b-f2274c1afa6d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:54.209536 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 653/1284] 10.222.0.41 () {56 vars in 1109 bytes} [Mon May 30 11:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:54.215603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f86e79-171c-4aa7-b6c4-f0df64505cb3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:54.312026 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f86e79-171c-4aa7-b6c4-f0df64505cb3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:54.325714 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:54.346387 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84071c67-e9b9-4ab7-aade-fbc60190f8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:54.347166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84071c67-e9b9-4ab7-aade-fbc60190f8ba None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:54.347483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84071c67-e9b9-4ab7-aade-fbc60190f8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:54.347763 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84071c67-e9b9-4ab7-aade-fbc60190f8ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:54.354898 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84071c67-e9b9-4ab7-aade-fbc60190f8ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:54.356370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84071c67-e9b9-4ab7-aade-fbc60190f8ba None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:54.370240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-84071c67-e9b9-4ab7-aade-fbc60190f8ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:54.370240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:54.370240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:54.370240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:54.370240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:54.370240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:54.370240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:54.370240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:54.370240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:54.370240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:54.370240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:54.370240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:54.370240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:54.370240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:54.370240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:54.371291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:54.371291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:54.371291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:54.371291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:54.371291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:54.371291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:54.371291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:54.371291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:54.371291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 30 11:56:54.371291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:54.371291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:54.371291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:54.371291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:54.371291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:54.371291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:54.371291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:54.371291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:54.372444 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:54.372444 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:54.372444 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:54.372444 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:54.372444 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:54.372444 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:54.372444 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:54.372444 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 30 11:56:54.372444 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 632/1285] 10.222.0.41 () {56 vars in 1111 bytes} [Mon May 30 11:56:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:54.377158 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff5774-d20a-4274-b83b-f2274c1afa6d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:54.425886 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:54.473873 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff5774-d20a-4274-b83b-f2274c1afa6d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:54.508050 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92037b-4337-45e8-938e-5fb0e99030aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:54.508701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92037b-4337-45e8-938e-5fb0e99030aa None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:54.508982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92037b-4337-45e8-938e-5fb0e99030aa None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:54.510113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92037b-4337-45e8-938e-5fb0e99030aa None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:54.510901 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92037b-4337-45e8-938e-5fb0e99030aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:54.511213 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92037b-4337-45e8-938e-5fb0e99030aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:54.512653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92037b-4337-45e8-938e-5fb0e99030aa None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:54.524330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 654/1286] 10.222.0.41 () {56 vars in 1148 bytes} [Mon May 30 11:56:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:54.531138 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84071c67-e9b9-4ab7-aade-fbc60190f8ba None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:54.629190 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84071c67-e9b9-4ab7-aade-fbc60190f8ba None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:54.662456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04973fda-3706-409c-8449-323bb0fbbbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:54.663104 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04973fda-3706-409c-8449-323bb0fbbbcb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:54.663393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04973fda-3706-409c-8449-323bb0fbbbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:54.663674 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04973fda-3706-409c-8449-323bb0fbbbcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:54.664529 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04973fda-3706-409c-8449-323bb0fbbbcb None admin] RBAC: Adding query filter params (role.id=8196ef570097443bac15d3cf39878486, scope.project.id=1e8426fd0e01433b8aa3a3797c687e03, user.id=48b43eb1a0ac4db5adee3512453459aa) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:54.664846 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04973fda-3706-409c-8449-323bb0fbbbcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:54.666315 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04973fda-3706-409c-8449-323bb0fbbbcb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:54.671994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 633/1287] 10.222.0.41 () {56 vars in 1374 bytes} [Mon May 30 11:56:54 2022] GET /identity/v3/role_assignments?user.id=48b43eb1a0ac4db5adee3512453459aa&scope.project.id=1e8426fd0e01433b8aa3a3797c687e03&role.id=8196ef570097443bac15d3cf39878486 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:56.907590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bacfe-315c-4d90-955b-7afd4d41390c None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:56.908131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bacfe-315c-4d90-955b-7afd4d41390c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:56.908221 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bacfe-315c-4d90-955b-7afd4d41390c None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:56.909527 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 655/1288] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:56.914748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73f953-7f81-436e-918b-37f90922fb58 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:56.915669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73f953-7f81-436e-918b-37f90922fb58 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:56.915918 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73f953-7f81-436e-918b-37f90922fb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:56.933204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2e73f953-7f81-436e-918b-37f90922fb58 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:56.934414 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2e73f953-7f81-436e-918b-37f90922fb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:56.963179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:57.000193 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 634/1289] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:56:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:56:57.022766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bacfe-315c-4d90-955b-7afd4d41390c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:57.122220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bacfe-315c-4d90-955b-7afd4d41390c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:57.132641 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:57.156547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40861946-7f6b-4182-8230-48788130f978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:57.157330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40861946-7f6b-4182-8230-48788130f978 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:57.157619 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40861946-7f6b-4182-8230-48788130f978 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:57.157901 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40861946-7f6b-4182-8230-48788130f978 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:57.158556 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40861946-7f6b-4182-8230-48788130f978 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:57.159955 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40861946-7f6b-4182-8230-48788130f978 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:57.171482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-40861946-7f6b-4182-8230-48788130f978 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 30 11:56:57.171482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:57.171482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:56:57.171482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:56:57.171482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:56:57.171482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:56:57.171482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:56:57.171482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:56:57.171482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 30 11:56:57.171482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:56:57.171482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:56:57.171482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:56:57.171482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:57.171482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:57.171482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:57.171482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:57.171482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:57.172738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:57.172738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:57.172738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:57.172738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:57.172738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:57.172738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:57.172738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:56:57.172738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:56:57.172738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:56:57.172738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:56:57.172738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:57.172738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:57.172738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:57.172738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:57.172738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:57.172738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:57.173774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:57.173774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:56:57.173774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:57.173774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:57.173774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:57.173774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:57.173774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:57.173774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:57.173774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:57.173774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:57.173774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:56:57.173774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:56:57.173774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 30 11:56:57.173774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:56:57.173774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 656/1290] 10.222.0.41 () {56 vars in 1117 bytes} [Mon May 30 11:56:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:57.178843 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73f953-7f81-436e-918b-37f90922fb58 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:57.274646 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73f953-7f81-436e-918b-37f90922fb58 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:57.307586 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28afd6-1fc5-4234-8548-015dc6b5c28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:57.308268 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28afd6-1fc5-4234-8548-015dc6b5c28a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:57.308555 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28afd6-1fc5-4234-8548-015dc6b5c28a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:57.308833 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28afd6-1fc5-4234-8548-015dc6b5c28a None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:57.309541 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28afd6-1fc5-4234-8548-015dc6b5c28a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:57.309852 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28afd6-1fc5-4234-8548-015dc6b5c28a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:57.311216 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28afd6-1fc5-4234-8548-015dc6b5c28a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:57.318888 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 635/1291] 10.222.0.41 () {56 vars in 1116 bytes} [Mon May 30 11:56:57 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:57.325440 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40861946-7f6b-4182-8230-48788130f978 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:57.421996 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40861946-7f6b-4182-8230-48788130f978 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:57.455044 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d83c5-4e35-40c4-867f-558e06c85eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:57.455697 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d83c5-4e35-40c4-867f-558e06c85eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:57.456007 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d83c5-4e35-40c4-867f-558e06c85eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:57.456288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d83c5-4e35-40c4-867f-558e06c85eb4 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:57.456992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d83c5-4e35-40c4-867f-558e06c85eb4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:57.457300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d83c5-4e35-40c4-867f-558e06c85eb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:57.458654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d83c5-4e35-40c4-867f-558e06c85eb4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:57.463104 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 657/1292] 10.222.0.41 () {56 vars in 1116 bytes} [Mon May 30 11:56:57 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:59.687557 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bda90-e09c-490a-b3bb-abf340dd9e97 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:59.688115 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bda90-e09c-490a-b3bb-abf340dd9e97 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:59.688115 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bda90-e09c-490a-b3bb-abf340dd9e97 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:59.689505 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 636/1293] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:59.694698 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab12f4-8f68-41a7-92c6-35d48d980791 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:59.695124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab12f4-8f68-41a7-92c6-35d48d980791 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:59.695249 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab12f4-8f68-41a7-92c6-35d48d980791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:59.711759 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-74ab12f4-8f68-41a7-92c6-35d48d980791 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:59.713558 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-74ab12f4-8f68-41a7-92c6-35d48d980791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:59.743073 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:59.781612 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 658/1294] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:56:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:56:59.804388 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bda90-e09c-490a-b3bb-abf340dd9e97 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:59.835516 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:59.906908 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bda90-e09c-490a-b3bb-abf340dd9e97 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:59.938959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6b9db-9404-46a3-adf1-21c5b15647de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:59.939555 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6b9db-9404-46a3-adf1-21c5b15647de None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:59.939861 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6b9db-9404-46a3-adf1-21c5b15647de None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:59.940140 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6b9db-9404-46a3-adf1-21c5b15647de None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:59.940856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6b9db-9404-46a3-adf1-21c5b15647de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:59.942235 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6b9db-9404-46a3-adf1-21c5b15647de None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:59.955462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 637/1295] 10.222.0.41 () {60 vars in 1141 bytes} [Mon May 30 11:56:59 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:57:02.187771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e850d1-164a-497f-8cc1-bad0ef808da6 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.188363 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e850d1-164a-497f-8cc1-bad0ef808da6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.188363 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e850d1-164a-497f-8cc1-bad0ef808da6 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.189720 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 659/1296] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:02.195103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36eba0-b6ff-4b15-a3cf-4b6f077c0ff0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.195515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36eba0-b6ff-4b15-a3cf-4b6f077c0ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.195659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36eba0-b6ff-4b15-a3cf-4b6f077c0ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.212202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-df36eba0-b6ff-4b15-a3cf-4b6f077c0ff0 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:02.213464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-df36eba0-b6ff-4b15-a3cf-4b6f077c0ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:02.284282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 638/1297] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:57:02 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:02.308220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e850d1-164a-497f-8cc1-bad0ef808da6 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:02.406469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e850d1-164a-497f-8cc1-bad0ef808da6 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:02.439142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ca4dd-aa2d-48b8-92cb-acd4bbb8ac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:02.439893 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ca4dd-aa2d-48b8-92cb-acd4bbb8ac60 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.440182 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ca4dd-aa2d-48b8-92cb-acd4bbb8ac60 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.440461 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ca4dd-aa2d-48b8-92cb-acd4bbb8ac60 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.441114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ca4dd-aa2d-48b8-92cb-acd4bbb8ac60 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:02.442482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ca4dd-aa2d-48b8-92cb-acd4bbb8ac60 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:02.454168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ec3ca4dd-aa2d-48b8-92cb-acd4bbb8ac60 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 30 11:57:02.454168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:02.454168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:02.454168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:02.454168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:02.454168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:02.454168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:02.454168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:02.454168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 30 11:57:02.454168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:57:02.454168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:02.454168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:57:02.454168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:02.454168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:02.454168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:02.454168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:02.454168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:02.455411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:02.455411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:02.455411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:02.455411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:02.455411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:02.455411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:02.455411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:02.455411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:02.455411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:02.455411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:02.455411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:02.455411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:02.455411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:02.455411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:02.455411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:02.455411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:02.456571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:02.456571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:57:02.456571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:02.456571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:02.456571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:02.456571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:02.456571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:02.456571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:02.456571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:02.456571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:02.456571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:02.456571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:02.456571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 30 11:57:02.456571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:57:02.456571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 660/1298] 10.222.0.41 () {56 vars in 1117 bytes} [Mon May 30 11:57:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:02.461256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36eba0-b6ff-4b15-a3cf-4b6f077c0ff0 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:02.480858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:02.560974 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36eba0-b6ff-4b15-a3cf-4b6f077c0ff0 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:02.593962 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01991664-10a0-4767-be13-ffd229245173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:02.594620 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01991664-10a0-4767-be13-ffd229245173 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.594909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01991664-10a0-4767-be13-ffd229245173 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.595191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01991664-10a0-4767-be13-ffd229245173 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.595924 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01991664-10a0-4767-be13-ffd229245173 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:02.596238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01991664-10a0-4767-be13-ffd229245173 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:02.597610 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01991664-10a0-4767-be13-ffd229245173 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:02.603311 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 639/1299] 10.222.0.41 () {56 vars in 1116 bytes} [Mon May 30 11:57:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:02.609171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ca4dd-aa2d-48b8-92cb-acd4bbb8ac60 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:02.640574 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:02.707010 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ca4dd-aa2d-48b8-92cb-acd4bbb8ac60 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:02.739222 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e9336-f67d-4cd7-9f1f-c003f3b1342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:02.739972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e9336-f67d-4cd7-9f1f-c003f3b1342f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.740261 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e9336-f67d-4cd7-9f1f-c003f3b1342f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.740540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e9336-f67d-4cd7-9f1f-c003f3b1342f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.741332 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e9336-f67d-4cd7-9f1f-c003f3b1342f None admin] RBAC: Adding query filter params (interface=public, service_id=632c9c4583564386bee21157fd263eab, region_id=RegionOne) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:02.741649 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e9336-f67d-4cd7-9f1f-c003f3b1342f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:02.743868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e9336-f67d-4cd7-9f1f-c003f3b1342f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:02.748841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 661/1300] 10.222.0.41 () {56 vars in 1251 bytes} [Mon May 30 11:57:02 2022] GET /identity/v3/endpoints?service_id=632c9c4583564386bee21157fd263eab&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:02.754479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01991664-10a0-4767-be13-ffd229245173 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:02.836456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:02.854859 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01991664-10a0-4767-be13-ffd229245173 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:02.888699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec52dc0-1f4d-4902-9921-cfc68c9054ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:02.889358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec52dc0-1f4d-4902-9921-cfc68c9054ab None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.889646 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec52dc0-1f4d-4902-9921-cfc68c9054ab None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.889928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec52dc0-1f4d-4902-9921-cfc68c9054ab None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.890612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec52dc0-1f4d-4902-9921-cfc68c9054ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:02.892009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec52dc0-1f4d-4902-9921-cfc68c9054ab None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:02.898651 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 640/1301] 10.222.0.41 () {56 vars in 1087 bytes} [Mon May 30 11:57:02 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 11:57:05.139420 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aad30b-35b0-4ddc-879c-b07230df396b None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:05.139975 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aad30b-35b0-4ddc-879c-b07230df396b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:05.139975 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aad30b-35b0-4ddc-879c-b07230df396b None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:05.141320 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 662/1302] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:05.146452 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad091b3-7732-4a8b-b998-833eb07edfac None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:05.146869 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad091b3-7732-4a8b-b998-833eb07edfac None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:05.147004 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad091b3-7732-4a8b-b998-833eb07edfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:05.163940 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2ad091b3-7732-4a8b-b998-833eb07edfac None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:05.165888 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2ad091b3-7732-4a8b-b998-833eb07edfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:05.231203 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 641/1303] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:57:05 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:05.254518 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aad30b-35b0-4ddc-879c-b07230df396b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:05.346878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:05.354454 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aad30b-35b0-4ddc-879c-b07230df396b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:05.388364 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241ce23-cdc1-43ed-9131-e2e0d0c482ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:05.389149 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241ce23-cdc1-43ed-9131-e2e0d0c482ac None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:05.389476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241ce23-cdc1-43ed-9131-e2e0d0c482ac None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:05.389699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241ce23-cdc1-43ed-9131-e2e0d0c482ac None admin] PATH_INFO: `/v3/services/placement` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:05.390346 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241ce23-cdc1-43ed-9131-e2e0d0c482ac None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:05.391695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241ce23-cdc1-43ed-9131-e2e0d0c482ac None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:05.404330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-1241ce23-cdc1-43ed-9131-e2e0d0c482ac None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 30 11:57:05.404330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:05.404330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:05.404330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:05.404330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:05.404330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:05.404330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:05.404330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:05.404330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 30 11:57:05.404330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:57:05.404330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:05.404330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:57:05.404330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:05.404330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:05.404330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:05.404330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:05.404330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:05.405484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:05.405484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:05.405484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:05.405484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:05.405484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:05.405484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:05.405484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:05.405484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:05.405484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:05.405484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:05.405484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:05.405484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:05.405484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:05.405484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:05.405484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:05.405484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:05.406525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:05.406525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 30 11:57:05.406525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:05.406525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:05.406525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:05.406525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:05.406525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:05.406525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:05.406525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:05.406525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:05.406525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:05.406525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:05.406525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 30 11:57:05.406525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 30 11:57:05.406525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 663/1304] 10.222.0.41 () {56 vars in 1117 bytes} [Mon May 30 11:57:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:05.411671 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad091b3-7732-4a8b-b998-833eb07edfac None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:05.487350 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:05.510664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad091b3-7732-4a8b-b998-833eb07edfac None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:05.545652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f1821-167a-4a42-874e-d4d6304768cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:05.546314 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f1821-167a-4a42-874e-d4d6304768cf None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:05.546601 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f1821-167a-4a42-874e-d4d6304768cf None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:05.546881 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f1821-167a-4a42-874e-d4d6304768cf None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:05.547586 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f1821-167a-4a42-874e-d4d6304768cf None admin] RBAC: Adding query filter params (name=placement) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:05.547926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f1821-167a-4a42-874e-d4d6304768cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:05.549322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f1821-167a-4a42-874e-d4d6304768cf None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:05.554422 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 642/1305] 10.222.0.41 () {56 vars in 1116 bytes} [Mon May 30 11:57:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:05.560361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241ce23-cdc1-43ed-9131-e2e0d0c482ac None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:05.658462 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241ce23-cdc1-43ed-9131-e2e0d0c482ac None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:05.691069 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e3987-2f0f-457d-a0a6-0da782e2c6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:05.691702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e3987-2f0f-457d-a0a6-0da782e2c6fc None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:05.692010 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e3987-2f0f-457d-a0a6-0da782e2c6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:05.692287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e3987-2f0f-457d-a0a6-0da782e2c6fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:05.693034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e3987-2f0f-457d-a0a6-0da782e2c6fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:05.694380 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e3987-2f0f-457d-a0a6-0da782e2c6fc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:05.713347 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 664/1306] 10.222.0.41 () {60 vars in 1144 bytes} [Mon May 30 11:57:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:57:15.551464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=30 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:15.708421 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:09.780038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c64d1-d418-4ac7-8b74-38995c4a7467 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:09.781101 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c64d1-d418-4ac7-8b74-38995c4a7467 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:09.781605 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c64d1-d418-4ac7-8b74-38995c4a7467 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:09.783644 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 643/1307] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:58:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:09.788792 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f52e5-a642-4841-91c4-ffee80ef5e14 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:09.789265 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f52e5-a642-4841-91c4-ffee80ef5e14 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:09.789386 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f52e5-a642-4841-91c4-ffee80ef5e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:09.961418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-791f52e5-a642-4841-91c4-ffee80ef5e14 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:09.962655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-791f52e5-a642-4841-91c4-ffee80ef5e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:10.195654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 665/1308] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:58:10.251448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051edca8-b5de-4e21-ad1d-ba7c81e65cd4 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:10.251745 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051edca8-b5de-4e21-ad1d-ba7c81e65cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:10.252058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051edca8-b5de-4e21-ad1d-ba7c81e65cd4 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:10.253844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 644/1309] 10.222.0.41 () {54 vars in 964 bytes} [Mon May 30 11:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:10.261450 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d76595-0950-4d01-9e20-e85bf724347c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:10.261687 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d76595-0950-4d01-9e20-e85bf724347c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:10.261979 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d76595-0950-4d01-9e20-e85bf724347c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:10.384124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e8d76595-0950-4d01-9e20-e85bf724347c None None] MFA Rules not processed for user `ae7bc0d4fd924bfb89f874d1c6fc3d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:10.385654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e8d76595-0950-4d01-9e20-e85bf724347c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:10.416921 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:10.483878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 666/1310] 10.222.0.41 () {58 vars in 1061 bytes} [Mon May 30 11:58:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 11:58:10.494489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051edca8-b5de-4e21-ad1d-ba7c81e65cd4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:10.496735 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-051edca8-b5de-4e21-ad1d-ba7c81e65cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:10.617676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051edca8-b5de-4e21-ad1d-ba7c81e65cd4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:10.700216 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d275a9-7862-4695-8ffe-b13a4cbb9dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:10.701145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d275a9-7862-4695-8ffe-b13a4cbb9dad service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:10.701664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d275a9-7862-4695-8ffe-b13a4cbb9dad service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:10.702058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d275a9-7862-4695-8ffe-b13a4cbb9dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:10.703891 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-03d275a9-7862-4695-8ffe-b13a4cbb9dad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:10.763968 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:10.824144 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d275a9-7862-4695-8ffe-b13a4cbb9dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:10.825759 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d275a9-7862-4695-8ffe-b13a4cbb9dad service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:10.846242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 645/1311] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:58:13.462718 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb8752-edd5-46ce-8174-e980cc433bc9 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:13.463171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb8752-edd5-46ce-8174-e980cc433bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:13.463295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb8752-edd5-46ce-8174-e980cc433bc9 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:13.464730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 667/1312] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:13.470237 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfa14a-ce83-4a14-9fc8-0890ee5a2b66 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:13.470689 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfa14a-ce83-4a14-9fc8-0890ee5a2b66 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:13.470812 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfa14a-ce83-4a14-9fc8-0890ee5a2b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:13.543491 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-dfdfa14a-ce83-4a14-9fc8-0890ee5a2b66 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:13.544737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-dfdfa14a-ce83-4a14-9fc8-0890ee5a2b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:13.643793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 646/1313] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:58:13.682266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb8752-edd5-46ce-8174-e980cc433bc9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:13.683972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-04bb8752-edd5-46ce-8174-e980cc433bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:13.796816 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb8752-edd5-46ce-8174-e980cc433bc9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:13.869680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:13.872257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30844629-673a-4e36-9b5a-e8ce280b52a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:13.872912 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30844629-673a-4e36-9b5a-e8ce280b52a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:13.873271 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30844629-673a-4e36-9b5a-e8ce280b52a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:13.873593 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30844629-673a-4e36-9b5a-e8ce280b52a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:13.875933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-30844629-673a-4e36-9b5a-e8ce280b52a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:13.987249 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30844629-673a-4e36-9b5a-e8ce280b52a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:13.988634 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30844629-673a-4e36-9b5a-e8ce280b52a8 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:14.007907 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 668/1314] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:58:16.593011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38117ee-f91f-49e1-b894-cef54276fa89 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:16.593543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38117ee-f91f-49e1-b894-cef54276fa89 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:16.593663 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38117ee-f91f-49e1-b894-cef54276fa89 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:16.594959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 647/1315] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:16.601279 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228d6e0-c466-4190-9464-84e533cb41c7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:16.601689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228d6e0-c466-4190-9464-84e533cb41c7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:16.601841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228d6e0-c466-4190-9464-84e533cb41c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:16.667396 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1228d6e0-c466-4190-9464-84e533cb41c7 None None] MFA Rules not processed for user `025f07f81f754e028089307575d89269`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:16.668607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1228d6e0-c466-4190-9464-84e533cb41c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:16.719096 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:16.764699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 669/1316] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:58:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:58:16.803787 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38117ee-f91f-49e1-b894-cef54276fa89 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:16.805369 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b38117ee-f91f-49e1-b894-cef54276fa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:16.815109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:17.039732 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38117ee-f91f-49e1-b894-cef54276fa89 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:17.112071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967a552-4ceb-4c81-a312-1f192f339f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:17.112712 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967a552-4ceb-4c81-a312-1f192f339f32 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:17.112992 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967a552-4ceb-4c81-a312-1f192f339f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:17.113265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967a552-4ceb-4c81-a312-1f192f339f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:17.114886 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c967a552-4ceb-4c81-a312-1f192f339f32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:17.175780 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:17.223953 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967a552-4ceb-4c81-a312-1f192f339f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:17.225899 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967a552-4ceb-4c81-a312-1f192f339f32 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:17.243925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 648/1317] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:58:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:58:20.061117 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa178ec6-1063-449d-a4ef-c3a06562ca82 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:20.061723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa178ec6-1063-449d-a4ef-c3a06562ca82 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:20.061723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa178ec6-1063-449d-a4ef-c3a06562ca82 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:20.063260 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 670/1318] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:20.069939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5a644-05e8-4097-be17-5635ca585021 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:20.070887 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5a644-05e8-4097-be17-5635ca585021 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:20.071133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5a644-05e8-4097-be17-5635ca585021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:20.134371 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-38e5a644-05e8-4097-be17-5635ca585021 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:20.135561 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-38e5a644-05e8-4097-be17-5635ca585021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:20.229381 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 649/1319] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:58:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 11:58:20.268514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa178ec6-1063-449d-a4ef-c3a06562ca82 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:20.270024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-aa178ec6-1063-449d-a4ef-c3a06562ca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:20.373273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa178ec6-1063-449d-a4ef-c3a06562ca82 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:20.445150 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d426ad-1a54-4738-8860-603ab708fd3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:20.445791 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d426ad-1a54-4738-8860-603ab708fd3f service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:20.446078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d426ad-1a54-4738-8860-603ab708fd3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:20.446358 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d426ad-1a54-4738-8860-603ab708fd3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:20.448030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-01d426ad-1a54-4738-8860-603ab708fd3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:20.455303 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:20.560668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d426ad-1a54-4738-8860-603ab708fd3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:20.562119 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d426ad-1a54-4738-8860-603ab708fd3f service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:20.580466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 671/1320] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:58:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:58:23.508897 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa67c9-005a-410e-bf20-d1f2d5a8cb7d None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:23.509459 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa67c9-005a-410e-bf20-d1f2d5a8cb7d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:23.509459 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa67c9-005a-410e-bf20-d1f2d5a8cb7d None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:23.510813 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 650/1321] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:23.516186 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6f3b1-d470-4f9c-a73b-58a170e8dc84 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:23.516586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6f3b1-d470-4f9c-a73b-58a170e8dc84 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:23.516877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6f3b1-d470-4f9c-a73b-58a170e8dc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:23.583511 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-98b6f3b1-d470-4f9c-a73b-58a170e8dc84 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:23.585625 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-98b6f3b1-d470-4f9c-a73b-58a170e8dc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:23.643165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:23.682833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 672/1322] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:58:23.718517 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa67c9-005a-410e-bf20-d1f2d5a8cb7d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:23.720065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-39fa67c9-005a-410e-bf20-d1f2d5a8cb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:23.741438 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:23.834134 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa67c9-005a-410e-bf20-d1f2d5a8cb7d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:23.922289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bd73a-25e8-4e73-bdcf-048861e016cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:23.922949 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bd73a-25e8-4e73-bdcf-048861e016cd service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:23.923234 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bd73a-25e8-4e73-bdcf-048861e016cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:23.923514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bd73a-25e8-4e73-bdcf-048861e016cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:23.925213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f59bd73a-25e8-4e73-bdcf-048861e016cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:24.003141 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:24.042400 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bd73a-25e8-4e73-bdcf-048861e016cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:24.043771 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bd73a-25e8-4e73-bdcf-048861e016cd service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:24.063374 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 651/1323] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:58:26.391801 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145e246-33e0-4ada-b895-6e80e09f79b4 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:26.392379 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145e246-33e0-4ada-b895-6e80e09f79b4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:26.392379 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145e246-33e0-4ada-b895-6e80e09f79b4 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:26.393704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 673/1324] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:26.399629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645567d-ab0b-44b0-9763-e08a3542a334 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:26.400126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645567d-ab0b-44b0-9763-e08a3542a334 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:26.400209 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645567d-ab0b-44b0-9763-e08a3542a334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:26.467258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3645567d-ab0b-44b0-9763-e08a3542a334 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:26.468484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3645567d-ab0b-44b0-9763-e08a3542a334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:26.569421 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 652/1325] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:58:26.604879 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145e246-33e0-4ada-b895-6e80e09f79b4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:26.606669 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8145e246-33e0-4ada-b895-6e80e09f79b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:26.712299 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145e246-33e0-4ada-b895-6e80e09f79b4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:26.788580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6d9cf-db96-4a0a-bed1-41f2100b089e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:26.789238 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6d9cf-db96-4a0a-bed1-41f2100b089e service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:26.789518 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6d9cf-db96-4a0a-bed1-41f2100b089e service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:26.789795 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6d9cf-db96-4a0a-bed1-41f2100b089e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:26.791427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f8b6d9cf-db96-4a0a-bed1-41f2100b089e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:26.808401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:26.900864 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6d9cf-db96-4a0a-bed1-41f2100b089e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:26.902294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6d9cf-db96-4a0a-bed1-41f2100b089e service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:26.920248 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 674/1326] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:58:29.253326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c278ab-cd91-47ef-9c84-a980202bda77 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:29.253856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c278ab-cd91-47ef-9c84-a980202bda77 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:29.253950 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c278ab-cd91-47ef-9c84-a980202bda77 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:29.255258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 653/1327] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:29.261353 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91350a40-d45a-4614-89f7-bf7916534b20 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:29.261783 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91350a40-d45a-4614-89f7-bf7916534b20 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:29.261968 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91350a40-d45a-4614-89f7-bf7916534b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:29.327568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-91350a40-d45a-4614-89f7-bf7916534b20 None None] MFA Rules not processed for user `025f07f81f754e028089307575d89269`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:29.328828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-91350a40-d45a-4614-89f7-bf7916534b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:29.396924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:29.430182 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 675/1328] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:58:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:58:29.468477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c278ab-cd91-47ef-9c84-a980202bda77 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:29.470024 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-31c278ab-cd91-47ef-9c84-a980202bda77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:29.502916 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:29.576374 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c278ab-cd91-47ef-9c84-a980202bda77 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:29.649865 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959733a2-83c2-43bd-ae92-1ac9f9391c3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:29.650519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959733a2-83c2-43bd-ae92-1ac9f9391c3c service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:29.650801 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959733a2-83c2-43bd-ae92-1ac9f9391c3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:29.651070 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959733a2-83c2-43bd-ae92-1ac9f9391c3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:29.652731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-959733a2-83c2-43bd-ae92-1ac9f9391c3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:29.733455 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:29.767129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959733a2-83c2-43bd-ae92-1ac9f9391c3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:29.768860 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959733a2-83c2-43bd-ae92-1ac9f9391c3c service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:29.788627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 654/1329] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:58:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:58:32.326939 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf89bfb-10ca-42da-b984-7b30327e89ed None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:32.327385 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf89bfb-10ca-42da-b984-7b30327e89ed None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:32.327507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf89bfb-10ca-42da-b984-7b30327e89ed None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:32.330878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 676/1330] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:58:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:32.335494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d245a3-e5f6-4df6-8605-701ae7c27f9e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:32.336021 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d245a3-e5f6-4df6-8605-701ae7c27f9e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:32.336124 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d245a3-e5f6-4df6-8605-701ae7c27f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:32.405325 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-19d245a3-e5f6-4df6-8605-701ae7c27f9e None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:32.406559 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-19d245a3-e5f6-4df6-8605-701ae7c27f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:32.505013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 655/1331] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:58:32.542842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf89bfb-10ca-42da-b984-7b30327e89ed None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:32.544430 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2bf89bfb-10ca-42da-b984-7b30327e89ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:32.649215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf89bfb-10ca-42da-b984-7b30327e89ed None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:32.723474 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39957ba4-1a4d-4cbe-b9cc-8836d2855cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:32.724176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39957ba4-1a4d-4cbe-b9cc-8836d2855cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:32.725032 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39957ba4-1a4d-4cbe-b9cc-8836d2855cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:32.725399 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39957ba4-1a4d-4cbe-b9cc-8836d2855cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:32.727043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-39957ba4-1a4d-4cbe-b9cc-8836d2855cb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:32.753436 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:32.837822 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39957ba4-1a4d-4cbe-b9cc-8836d2855cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:32.839264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39957ba4-1a4d-4cbe-b9cc-8836d2855cb6 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:32.857393 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 677/1332] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:58:35.186043 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498de5c-31e2-41fc-a5ac-8a91039b47af None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:35.186538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498de5c-31e2-41fc-a5ac-8a91039b47af None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:35.186869 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498de5c-31e2-41fc-a5ac-8a91039b47af None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:35.188309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 656/1333] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:35.194053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437de60d-3f30-410c-a5b4-f45f569bbf14 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:35.194461 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437de60d-3f30-410c-a5b4-f45f569bbf14 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:35.194614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437de60d-3f30-410c-a5b4-f45f569bbf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:35.260032 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-437de60d-3f30-410c-a5b4-f45f569bbf14 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:35.261230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-437de60d-3f30-410c-a5b4-f45f569bbf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:35.334800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:35.358190 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 678/1334] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:58:35.399411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498de5c-31e2-41fc-a5ac-8a91039b47af None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:35.401027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9498de5c-31e2-41fc-a5ac-8a91039b47af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:35.441017 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:35.506046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498de5c-31e2-41fc-a5ac-8a91039b47af None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:35.577648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ffe7e-2ac9-4a25-b19f-5f74701228ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:35.578295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ffe7e-2ac9-4a25-b19f-5f74701228ae service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:35.578586 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ffe7e-2ac9-4a25-b19f-5f74701228ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:35.578865 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ffe7e-2ac9-4a25-b19f-5f74701228ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:35.580540 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ac9ffe7e-2ac9-4a25-b19f-5f74701228ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:35.665260 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:35.690858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ffe7e-2ac9-4a25-b19f-5f74701228ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:35.692385 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ffe7e-2ac9-4a25-b19f-5f74701228ae service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:35.710614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 657/1335] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:58:38.325681 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7750d94-e649-44b3-a4c4-1106306fb6a6 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:38.326257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7750d94-e649-44b3-a4c4-1106306fb6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:38.326257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7750d94-e649-44b3-a4c4-1106306fb6a6 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:38.327589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 679/1336] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:38.332813 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78c012-e440-485b-abf7-74f3e4c53b6f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:38.333192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78c012-e440-485b-abf7-74f3e4c53b6f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:38.333378 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78c012-e440-485b-abf7-74f3e4c53b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:38.398228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5e78c012-e440-485b-abf7-74f3e4c53b6f None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:38.399445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5e78c012-e440-485b-abf7-74f3e4c53b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:38.496691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 658/1337] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:58:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:58:38.532632 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7750d94-e649-44b3-a4c4-1106306fb6a6 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:38.534199 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f7750d94-e649-44b3-a4c4-1106306fb6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:38.766090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7750d94-e649-44b3-a4c4-1106306fb6a6 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:38.839441 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42050fff-02ce-42e6-84a6-2ef4413f9999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:38.840123 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42050fff-02ce-42e6-84a6-2ef4413f9999 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:38.840412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42050fff-02ce-42e6-84a6-2ef4413f9999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:38.840692 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42050fff-02ce-42e6-84a6-2ef4413f9999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:38.842339 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-42050fff-02ce-42e6-84a6-2ef4413f9999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:38.879639 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:38.952944 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42050fff-02ce-42e6-84a6-2ef4413f9999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:38.954386 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42050fff-02ce-42e6-84a6-2ef4413f9999 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:38.972402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 680/1338] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:58:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:58:43.220653 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c033efb-2e72-4c68-a35f-502f694bb89c None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:43.221215 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c033efb-2e72-4c68-a35f-502f694bb89c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:43.221215 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c033efb-2e72-4c68-a35f-502f694bb89c None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:43.222597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 659/1339] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:43.228762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55855773-c838-4dbd-a8b8-b27d5ee01b2c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:43.229169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55855773-c838-4dbd-a8b8-b27d5ee01b2c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:43.229327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55855773-c838-4dbd-a8b8-b27d5ee01b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:43.299547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-55855773-c838-4dbd-a8b8-b27d5ee01b2c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:43.300835 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-55855773-c838-4dbd-a8b8-b27d5ee01b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:43.397311 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:43.410988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 681/1340] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:58:43.451607 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c033efb-2e72-4c68-a35f-502f694bb89c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:43.453805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8c033efb-2e72-4c68-a35f-502f694bb89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:43.507670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:43.556148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c033efb-2e72-4c68-a35f-502f694bb89c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:43.559684 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346589c-3d57-41a0-8dc1-bb1314a042c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:43.560365 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346589c-3d57-41a0-8dc1-bb1314a042c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:43.560650 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346589c-3d57-41a0-8dc1-bb1314a042c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:43.560930 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346589c-3d57-41a0-8dc1-bb1314a042c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:43.570707 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346589c-3d57-41a0-8dc1-bb1314a042c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:43.572208 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346589c-3d57-41a0-8dc1-bb1314a042c8 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:43.582116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 660/1341] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:58:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:58:46.495391 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44eb466-7e6f-412e-9077-7940a0c30b16 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:46.495946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44eb466-7e6f-412e-9077-7940a0c30b16 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:46.496063 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44eb466-7e6f-412e-9077-7940a0c30b16 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:46.497614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 682/1342] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:58:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:46.503304 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec71706-3a56-465d-bc0b-61672ebb4110 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:46.503774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec71706-3a56-465d-bc0b-61672ebb4110 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:46.503774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec71706-3a56-465d-bc0b-61672ebb4110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:46.537742 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2ec71706-3a56-465d-bc0b-61672ebb4110 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:46.538980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2ec71706-3a56-465d-bc0b-61672ebb4110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:46.618011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 661/1343] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:58:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:58:46.655067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44eb466-7e6f-412e-9077-7940a0c30b16 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:46.667110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44eb466-7e6f-412e-9077-7940a0c30b16 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:46.670697 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ecc5f-392d-440a-949d-824bfe6727b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:46.671339 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ecc5f-392d-440a-949d-824bfe6727b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:46.671626 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ecc5f-392d-440a-949d-824bfe6727b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:46.671935 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ecc5f-392d-440a-949d-824bfe6727b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:46.681152 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ecc5f-392d-440a-949d-824bfe6727b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:46.682588 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ecc5f-392d-440a-949d-824bfe6727b8 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:46.692121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 683/1344] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:58:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:58:50.900795 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8817227-e3c9-460a-9a2c-408e4295c290 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:50.901340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8817227-e3c9-460a-9a2c-408e4295c290 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:50.901340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8817227-e3c9-460a-9a2c-408e4295c290 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:50.902888 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 662/1345] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:50.907989 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977f347-d23e-444d-ba55-06f63e137e73 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:50.908422 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977f347-d23e-444d-ba55-06f63e137e73 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:50.908555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977f347-d23e-444d-ba55-06f63e137e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:50.930740 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d977f347-d23e-444d-ba55-06f63e137e73 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:50.931987 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d977f347-d23e-444d-ba55-06f63e137e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:50.942529 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 684/1346] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:58:50.991231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8817227-e3c9-460a-9a2c-408e4295c290 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:51.001983 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8817227-e3c9-460a-9a2c-408e4295c290 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:51.005550 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf98fa-6fb6-46bf-92d7-6120be622710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:51.006198 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf98fa-6fb6-46bf-92d7-6120be622710 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:51.006482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf98fa-6fb6-46bf-92d7-6120be622710 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:51.006758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf98fa-6fb6-46bf-92d7-6120be622710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:51.016399 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf98fa-6fb6-46bf-92d7-6120be622710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:51.017845 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf98fa-6fb6-46bf-92d7-6120be622710 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:51.028440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 663/1347] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:58:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:58:56.866077 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674f979-28a8-42a8-860b-c7fa2e4bd533 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:56.867086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674f979-28a8-42a8-860b-c7fa2e4bd533 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:56.867544 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674f979-28a8-42a8-860b-c7fa2e4bd533 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:56.869401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 685/1348] 10.222.0.41 () {54 vars in 921 bytes} [Mon May 30 11:58:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:56.874106 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae425022-de79-4558-92ed-d33332c4212b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:56.874862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae425022-de79-4558-92ed-d33332c4212b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:56.875359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae425022-de79-4558-92ed-d33332c4212b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:56.989015 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ae425022-de79-4558-92ed-d33332c4212b None None] MFA Rules not processed for user `48b43eb1a0ac4db5adee3512453459aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:56.991451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ae425022-de79-4558-92ed-d33332c4212b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:57.039587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:57.112870 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 664/1349] 10.222.0.41 () {58 vars in 1018 bytes} [Mon May 30 11:58:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:00.924016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=13 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:01.391698 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c9fb7-f37e-4e0e-b66e-955d11ebd16d None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:01.392143 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c9fb7-f37e-4e0e-b66e-955d11ebd16d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:01.392241 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c9fb7-f37e-4e0e-b66e-955d11ebd16d None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:01.393563 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 686/1350] 10.222.0.41 () {54 vars in 921 bytes} [Mon May 30 11:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:59:01.402913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d910dd0-700a-4895-b1b0-dd2a7a4b8bb5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:01.403454 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d910dd0-700a-4895-b1b0-dd2a7a4b8bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:01.403537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d910dd0-700a-4895-b1b0-dd2a7a4b8bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:01.425806 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5d910dd0-700a-4895-b1b0-dd2a7a4b8bb5 None None] MFA Rules not processed for user `48b43eb1a0ac4db5adee3512453459aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:01.427179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5d910dd0-700a-4895-b1b0-dd2a7a4b8bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:01.436773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 665/1351] 10.222.0.41 () {58 vars in 1018 bytes} [Mon May 30 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:03.163561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51a621-8683-41ad-b378-a537de436672 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:03.164111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51a621-8683-41ad-b378-a537de436672 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:03.164375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51a621-8683-41ad-b378-a537de436672 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:03.165745 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 687/1352] 10.222.0.41 () {54 vars in 921 bytes} [Mon May 30 11:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:03.170834 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28440f57-b752-4f6a-8e44-636b55cd3e50 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:03.171284 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28440f57-b752-4f6a-8e44-636b55cd3e50 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:03.171525 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28440f57-b752-4f6a-8e44-636b55cd3e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:03.190182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-28440f57-b752-4f6a-8e44-636b55cd3e50 None None] MFA Rules not processed for user `48b43eb1a0ac4db5adee3512453459aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:03.191462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-28440f57-b752-4f6a-8e44-636b55cd3e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:03.200778 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 666/1353] 10.222.0.41 () {58 vars in 1018 bytes} [Mon May 30 11:59:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:06.846231 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a6758-044b-4d3c-bdf1-1d4129c181ed None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:06.847130 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a6758-044b-4d3c-bdf1-1d4129c181ed None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:06.847405 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a6758-044b-4d3c-bdf1-1d4129c181ed None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:06.853406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 688/1354] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:06.855141 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab28561-225c-4b1f-9775-15704dada648 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:06.855600 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab28561-225c-4b1f-9775-15704dada648 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:06.855683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab28561-225c-4b1f-9775-15704dada648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:06.875516 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2ab28561-225c-4b1f-9775-15704dada648 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:06.876737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2ab28561-225c-4b1f-9775-15704dada648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:06.885085 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 667/1355] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:06.941475 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252610d1-cdc6-4106-bd49-5db379626acc None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:06.941976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252610d1-cdc6-4106-bd49-5db379626acc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:06.942529 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252610d1-cdc6-4106-bd49-5db379626acc None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:06.944644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 689/1356] 10.222.0.41 () {54 vars in 961 bytes} [Mon May 30 11:59:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:06.953371 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699ad02-e20c-4317-a190-80b99021b602 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:06.954253 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699ad02-e20c-4317-a190-80b99021b602 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:06.954742 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699ad02-e20c-4317-a190-80b99021b602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:07.024158 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f699ad02-e20c-4317-a190-80b99021b602 None None] MFA Rules not processed for user `bb3820a613744c15b840681fe6b6e808`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:07.025303 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f699ad02-e20c-4317-a190-80b99021b602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:07.108888 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 668/1357] 10.222.0.41 () {58 vars in 1058 bytes} [Mon May 30 11:59:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 11:59:07.116925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252610d1-cdc6-4106-bd49-5db379626acc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:07.131609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252610d1-cdc6-4106-bd49-5db379626acc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:07.136953 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3a5f1-b35f-4107-b0b8-ba5883da51b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:07.137587 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3a5f1-b35f-4107-b0b8-ba5883da51b5 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:07.137870 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3a5f1-b35f-4107-b0b8-ba5883da51b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:07.138147 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3a5f1-b35f-4107-b0b8-ba5883da51b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:07.147784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3a5f1-b35f-4107-b0b8-ba5883da51b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:07.149699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3a5f1-b35f-4107-b0b8-ba5883da51b5 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:07.161135 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 690/1358] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:59:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:59:09.663482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d012485-9669-4fd4-a8b7-ea257355b83d None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:09.664107 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d012485-9669-4fd4-a8b7-ea257355b83d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:09.664107 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d012485-9669-4fd4-a8b7-ea257355b83d None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:09.665603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 669/1359] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:09.671051 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415ae68-766d-4857-a0c8-e744c144cbc1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:09.671500 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415ae68-766d-4857-a0c8-e744c144cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:09.671607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415ae68-766d-4857-a0c8-e744c144cbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:09.689384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2415ae68-766d-4857-a0c8-e744c144cbc1 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:09.690581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2415ae68-766d-4857-a0c8-e744c144cbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:09.699297 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 691/1360] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:09.745285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d012485-9669-4fd4-a8b7-ea257355b83d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:09.761574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d012485-9669-4fd4-a8b7-ea257355b83d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:09.767309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9fa80-623b-4918-adae-ce4c047e373f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:09.768006 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9fa80-623b-4918-adae-ce4c047e373f service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:09.768296 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9fa80-623b-4918-adae-ce4c047e373f service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:09.768579 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9fa80-623b-4918-adae-ce4c047e373f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:09.778655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9fa80-623b-4918-adae-ce4c047e373f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:09.780298 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9fa80-623b-4918-adae-ce4c047e373f service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:09.790723 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 670/1361] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:59:12.387020 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10da0b-deb8-4dce-9e25-4f8584582452 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:12.387521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10da0b-deb8-4dce-9e25-4f8584582452 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:12.387635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10da0b-deb8-4dce-9e25-4f8584582452 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:12.388967 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 692/1362] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:12.394361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69078db2-7c1b-4c4c-9c6f-0a105f2f1345 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:12.394721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69078db2-7c1b-4c4c-9c6f-0a105f2f1345 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:12.394933 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69078db2-7c1b-4c4c-9c6f-0a105f2f1345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:12.413061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-69078db2-7c1b-4c4c-9c6f-0a105f2f1345 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:12.414267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-69078db2-7c1b-4c4c-9c6f-0a105f2f1345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:12.422464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 671/1363] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:12.471668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a93be0-3218-45ab-9891-4cbfdb84a82d None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:12.472220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a93be0-3218-45ab-9891-4cbfdb84a82d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:12.472650 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a93be0-3218-45ab-9891-4cbfdb84a82d None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:12.474269 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 693/1364] 10.222.0.41 () {54 vars in 961 bytes} [Mon May 30 11:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:12.482504 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef84d35-84a3-4253-af22-56ab3e8f2f35 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:12.482760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef84d35-84a3-4253-af22-56ab3e8f2f35 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:12.483275 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef84d35-84a3-4253-af22-56ab3e8f2f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:12.506915 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5ef84d35-84a3-4253-af22-56ab3e8f2f35 None None] MFA Rules not processed for user `bb3820a613744c15b840681fe6b6e808`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:12.508189 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5ef84d35-84a3-4253-af22-56ab3e8f2f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:12.517871 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 672/1365] 10.222.0.41 () {58 vars in 1058 bytes} [Mon May 30 11:59:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:12.525817 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a93be0-3218-45ab-9891-4cbfdb84a82d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:12.541386 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a93be0-3218-45ab-9891-4cbfdb84a82d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:12.546946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f36403-c645-40c6-9494-f4494ecf31da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:12.547578 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f36403-c645-40c6-9494-f4494ecf31da service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:12.547884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f36403-c645-40c6-9494-f4494ecf31da service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:12.548157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f36403-c645-40c6-9494-f4494ecf31da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:12.557469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f36403-c645-40c6-9494-f4494ecf31da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:12.559034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f36403-c645-40c6-9494-f4494ecf31da service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:12.569007 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 694/1366] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:59:14.906804 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b55dd-042f-40df-80dc-5370f5395d6f None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:14.907387 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b55dd-042f-40df-80dc-5370f5395d6f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:14.907387 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b55dd-042f-40df-80dc-5370f5395d6f None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:14.908998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 673/1367] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:14.915102 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13661730-8917-44ec-abf2-7b2112aa1823 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:14.915591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13661730-8917-44ec-abf2-7b2112aa1823 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:14.915682 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13661730-8917-44ec-abf2-7b2112aa1823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:14.934976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-13661730-8917-44ec-abf2-7b2112aa1823 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:14.939110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-13661730-8917-44ec-abf2-7b2112aa1823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:14.951883 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 695/1368] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:14.996067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b55dd-042f-40df-80dc-5370f5395d6f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:15.011721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b55dd-042f-40df-80dc-5370f5395d6f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:15.017325 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133c112-fdb3-43d8-80da-301cdd2bbb61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:15.018071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133c112-fdb3-43d8-80da-301cdd2bbb61 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:15.018436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133c112-fdb3-43d8-80da-301cdd2bbb61 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:15.018791 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133c112-fdb3-43d8-80da-301cdd2bbb61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:15.028627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133c112-fdb3-43d8-80da-301cdd2bbb61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:15.030980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133c112-fdb3-43d8-80da-301cdd2bbb61 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:15.042436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 674/1369] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:59:15.276248 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23520c36-bd48-4360-b501-f921437b9c55 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:15.276910 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23520c36-bd48-4360-b501-f921437b9c55 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:15.277192 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23520c36-bd48-4360-b501-f921437b9c55 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:15.278614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 696/1370] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:59:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:15.284495 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01e687-f84d-4640-af38-b54694a40426 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:15.284757 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01e687-f84d-4640-af38-b54694a40426 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:15.285030 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01e687-f84d-4640-af38-b54694a40426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:15.304251 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5f01e687-f84d-4640-af38-b54694a40426 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:15.305489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5f01e687-f84d-4640-af38-b54694a40426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:15.313840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 675/1371] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:15.590820 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160e22c-5498-42be-9736-7c44455b7ca0 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:15.591181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160e22c-5498-42be-9736-7c44455b7ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:15.591650 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160e22c-5498-42be-9736-7c44455b7ca0 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:15.593239 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 697/1372] 10.222.0.41 () {54 vars in 963 bytes} [Mon May 30 11:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:15.598205 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b1f3d-aa41-42ad-ac64-83d7a53c2f31 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:15.598719 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b1f3d-aa41-42ad-ac64-83d7a53c2f31 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:15.599175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b1f3d-aa41-42ad-ac64-83d7a53c2f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:15.607546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:15.660253 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f64b1f3d-aa41-42ad-ac64-83d7a53c2f31 None None] MFA Rules not processed for user `ca1110aeeded4ab0b6fa2aedfa8740c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:15.661953 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f64b1f3d-aa41-42ad-ac64-83d7a53c2f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:15.726046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 676/1373] 10.222.0.41 () {58 vars in 1060 bytes} [Mon May 30 11:59:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:15.734218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160e22c-5498-42be-9736-7c44455b7ca0 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:15.745787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160e22c-5498-42be-9736-7c44455b7ca0 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:15.749321 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d068f4-93c0-41db-ae51-968b0c8b6b0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:15.750046 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d068f4-93c0-41db-ae51-968b0c8b6b0b service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:15.750398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d068f4-93c0-41db-ae51-968b0c8b6b0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:15.750741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d068f4-93c0-41db-ae51-968b0c8b6b0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:15.762085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d068f4-93c0-41db-ae51-968b0c8b6b0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:15.763594 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d068f4-93c0-41db-ae51-968b0c8b6b0b service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:15.792090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 698/1374] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:59:17.371954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6c68e-77f2-477e-8c82-83520a757876 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:17.372521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6c68e-77f2-477e-8c82-83520a757876 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:17.372521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6c68e-77f2-477e-8c82-83520a757876 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:17.373901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 677/1375] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:17.379174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a5fb-d982-44ac-a454-1b505ef8c5f8 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:17.379599 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a5fb-d982-44ac-a454-1b505ef8c5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:17.380530 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a5fb-d982-44ac-a454-1b505ef8c5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:17.398075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-88e9a5fb-d982-44ac-a454-1b505ef8c5f8 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:17.399268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-88e9a5fb-d982-44ac-a454-1b505ef8c5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:17.407058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 699/1376] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:17.451269 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6c68e-77f2-477e-8c82-83520a757876 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:17.466279 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6c68e-77f2-477e-8c82-83520a757876 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:17.471531 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d516fa-6e51-41a7-85d8-24cc0f535dd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:17.472202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d516fa-6e51-41a7-85d8-24cc0f535dd4 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:17.472483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d516fa-6e51-41a7-85d8-24cc0f535dd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:17.472755 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d516fa-6e51-41a7-85d8-24cc0f535dd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:17.481511 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d516fa-6e51-41a7-85d8-24cc0f535dd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:17.483091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d516fa-6e51-41a7-85d8-24cc0f535dd4 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:17.493380 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 678/1377] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:59:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:59:19.848004 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15726d1c-d883-4724-97e1-a7fba6d6bcaa None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:19.849181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15726d1c-d883-4724-97e1-a7fba6d6bcaa None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:19.849565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15726d1c-d883-4724-97e1-a7fba6d6bcaa None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:19.851049 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 700/1378] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:19.856675 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c4e36-a99f-41ab-960a-fe22326dd319 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:19.857142 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c4e36-a99f-41ab-960a-fe22326dd319 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:19.857237 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c4e36-a99f-41ab-960a-fe22326dd319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:19.879332 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a01c4e36-a99f-41ab-960a-fe22326dd319 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:19.881115 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a01c4e36-a99f-41ab-960a-fe22326dd319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:19.889783 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 679/1379] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:19.935065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15726d1c-d883-4724-97e1-a7fba6d6bcaa None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:19.950333 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15726d1c-d883-4724-97e1-a7fba6d6bcaa None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:19.955727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d60d6-e670-4fc5-b092-2112c500e018 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:19.956415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d60d6-e670-4fc5-b092-2112c500e018 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:19.956702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d60d6-e670-4fc5-b092-2112c500e018 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:19.957100 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d60d6-e670-4fc5-b092-2112c500e018 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:19.966181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d60d6-e670-4fc5-b092-2112c500e018 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:19.967918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d60d6-e670-4fc5-b092-2112c500e018 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:19.978353 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 701/1380] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:59:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:59:22.281816 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668f08b-a4f2-4440-977f-692cb9da110a None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:22.282386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668f08b-a4f2-4440-977f-692cb9da110a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:22.282386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668f08b-a4f2-4440-977f-692cb9da110a None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:22.283734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 680/1381] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:22.289579 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580be6d-46b7-4a8a-99a6-c9738bcb33f6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:22.289983 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580be6d-46b7-4a8a-99a6-c9738bcb33f6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:22.290184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580be6d-46b7-4a8a-99a6-c9738bcb33f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:22.308716 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9580be6d-46b7-4a8a-99a6-c9738bcb33f6 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:22.309999 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9580be6d-46b7-4a8a-99a6-c9738bcb33f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:22.318083 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 702/1382] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:22.362580 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668f08b-a4f2-4440-977f-692cb9da110a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:22.381074 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668f08b-a4f2-4440-977f-692cb9da110a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:22.387132 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853442d-b4d6-4856-a226-3a2b36611ee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:22.388196 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853442d-b4d6-4856-a226-3a2b36611ee2 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:22.388584 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853442d-b4d6-4856-a226-3a2b36611ee2 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:22.389178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853442d-b4d6-4856-a226-3a2b36611ee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:22.399879 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853442d-b4d6-4856-a226-3a2b36611ee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:22.401723 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853442d-b4d6-4856-a226-3a2b36611ee2 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:22.414190 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 681/1383] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:59:24.692731 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99380071-b919-41a5-ae8a-1837d44640fc None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:24.693410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99380071-b919-41a5-ae8a-1837d44640fc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:24.693410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99380071-b919-41a5-ae8a-1837d44640fc None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:24.694627 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 703/1384] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:24.699871 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c5465-98da-4253-9171-d0cc502332d0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:24.700327 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c5465-98da-4253-9171-d0cc502332d0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:24.700436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c5465-98da-4253-9171-d0cc502332d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:24.718170 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d28c5465-98da-4253-9171-d0cc502332d0 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:24.719369 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d28c5465-98da-4253-9171-d0cc502332d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:24.728010 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 682/1385] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:24.776369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99380071-b919-41a5-ae8a-1837d44640fc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:24.791468 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99380071-b919-41a5-ae8a-1837d44640fc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:24.797199 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86016c64-4109-44d6-9214-b0132d6faaa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:24.797839 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86016c64-4109-44d6-9214-b0132d6faaa6 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:24.798128 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86016c64-4109-44d6-9214-b0132d6faaa6 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:24.798411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86016c64-4109-44d6-9214-b0132d6faaa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:24.807578 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86016c64-4109-44d6-9214-b0132d6faaa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:24.809203 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86016c64-4109-44d6-9214-b0132d6faaa6 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:24.818788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 704/1386] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:59:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:59:27.223369 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c35e34-d704-4e44-9636-c7219f666109 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:27.224039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c35e34-d704-4e44-9636-c7219f666109 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:27.224455 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c35e34-d704-4e44-9636-c7219f666109 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:27.226602 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 683/1387] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:59:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:27.231832 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e6a84-d8f6-499a-9730-3c693fab644a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:27.232267 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e6a84-d8f6-499a-9730-3c693fab644a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:27.232461 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e6a84-d8f6-499a-9730-3c693fab644a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:27.251101 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8a3e6a84-d8f6-499a-9730-3c693fab644a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:27.252332 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8a3e6a84-d8f6-499a-9730-3c693fab644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:27.260949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 705/1388] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 11:59:27.308205 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c35e34-d704-4e44-9636-c7219f666109 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:27.323422 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c35e34-d704-4e44-9636-c7219f666109 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:27.329432 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d168d4d-b820-4352-91e8-39f6e3156818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:27.330106 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d168d4d-b820-4352-91e8-39f6e3156818 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:27.330402 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d168d4d-b820-4352-91e8-39f6e3156818 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:27.330716 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d168d4d-b820-4352-91e8-39f6e3156818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:27.340506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d168d4d-b820-4352-91e8-39f6e3156818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:27.342012 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d168d4d-b820-4352-91e8-39f6e3156818 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:27.352603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 684/1389] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:59:29.715572 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd467be-3e06-4e50-9677-5cb1e3e38bce None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:29.716246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd467be-3e06-4e50-9677-5cb1e3e38bce None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:29.716246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd467be-3e06-4e50-9677-5cb1e3e38bce None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:29.717668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 706/1390] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:29.722729 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaa723-1383-4802-b385-4eadbbd4d647 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:29.723141 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaa723-1383-4802-b385-4eadbbd4d647 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:29.723904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaa723-1383-4802-b385-4eadbbd4d647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:29.741777 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-adeaa723-1383-4802-b385-4eadbbd4d647 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:29.742967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-adeaa723-1383-4802-b385-4eadbbd4d647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:29.750748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 685/1391] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 11:59:29.795645 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd467be-3e06-4e50-9677-5cb1e3e38bce None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:29.809773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd467be-3e06-4e50-9677-5cb1e3e38bce None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:29.815409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7b81b-b10c-42bb-8e16-3dc62802e93a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:29.816071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7b81b-b10c-42bb-8e16-3dc62802e93a service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:29.816356 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7b81b-b10c-42bb-8e16-3dc62802e93a service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:29.816633 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7b81b-b10c-42bb-8e16-3dc62802e93a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:29.825647 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7b81b-b10c-42bb-8e16-3dc62802e93a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:29.827224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7b81b-b10c-42bb-8e16-3dc62802e93a service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:29.837890 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 707/1392] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:59:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:59:31.747358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e9ada-ed8f-4120-946c-dd477403a4ae None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:31.747972 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e9ada-ed8f-4120-946c-dd477403a4ae None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:31.747972 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e9ada-ed8f-4120-946c-dd477403a4ae None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:31.749370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 686/1393] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:31.754660 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d97d5-bebc-46bb-9c64-166eeec6103a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:31.755112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d97d5-bebc-46bb-9c64-166eeec6103a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:31.755576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d97d5-bebc-46bb-9c64-166eeec6103a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:31.761636 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=52 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:31.776630 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f82d97d5-bebc-46bb-9c64-166eeec6103a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:31.777830 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f82d97d5-bebc-46bb-9c64-166eeec6103a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:31.786371 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 708/1394] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:31.844622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b921ae-f30f-438f-897b-8d164c518219 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:31.844914 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b921ae-f30f-438f-897b-8d164c518219 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:31.845192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b921ae-f30f-438f-897b-8d164c518219 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:31.846552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 687/1395] 10.222.0.41 () {54 vars in 962 bytes} [Mon May 30 11:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:31.852647 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f9884-208c-45af-8055-3297bd6876a8 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:31.852968 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f9884-208c-45af-8055-3297bd6876a8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:31.853306 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f9884-208c-45af-8055-3297bd6876a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:31.902268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-844f9884-208c-45af-8055-3297bd6876a8 None None] MFA Rules not processed for user `2ffa6d38c01f4820a705c06991654bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:31.903500 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-844f9884-208c-45af-8055-3297bd6876a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:31.962347 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 709/1396] 10.222.0.41 () {58 vars in 1059 bytes} [Mon May 30 11:59:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:31.969901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b921ae-f30f-438f-897b-8d164c518219 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:31.981090 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b921ae-f30f-438f-897b-8d164c518219 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:31.984581 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e8088-07ef-46fd-a43b-6ade04267098 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ffa6d38c01f4820a705c06991654bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:31.985213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e8088-07ef-46fd-a43b-6ade04267098 service glance] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:31.985503 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e8088-07ef-46fd-a43b-6ade04267098 service glance] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:31.985779 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e8088-07ef-46fd-a43b-6ade04267098 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:31.995148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e8088-07ef-46fd-a43b-6ade04267098 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:31.996612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e8088-07ef-46fd-a43b-6ade04267098 service glance] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:32.006445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 688/1397] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:59:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:59:32.142320 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eef4b-210c-4ff1-ba6d-a1352a80a557 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:32.142620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eef4b-210c-4ff1-ba6d-a1352a80a557 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:32.142910 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eef4b-210c-4ff1-ba6d-a1352a80a557 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:32.144351 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 710/1398] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:32.150970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73792b7b-ba64-4a7f-a50e-6dae1daccada None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:32.151259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73792b7b-ba64-4a7f-a50e-6dae1daccada None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:32.151538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73792b7b-ba64-4a7f-a50e-6dae1daccada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:32.168804 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-73792b7b-ba64-4a7f-a50e-6dae1daccada None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:32.170130 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-73792b7b-ba64-4a7f-a50e-6dae1daccada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:32.177951 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 689/1399] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:32.224670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eef4b-210c-4ff1-ba6d-a1352a80a557 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:32.239807 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eef4b-210c-4ff1-ba6d-a1352a80a557 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:32.245773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02b14a-ea59-4ce2-8ce0-b7df174af8a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:32.246421 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02b14a-ea59-4ce2-8ce0-b7df174af8a3 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:32.246711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02b14a-ea59-4ce2-8ce0-b7df174af8a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:32.246999 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02b14a-ea59-4ce2-8ce0-b7df174af8a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:32.256827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02b14a-ea59-4ce2-8ce0-b7df174af8a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:32.258373 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02b14a-ea59-4ce2-8ce0-b7df174af8a3 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:32.270800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 711/1400] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:59:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:59:32.564174 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb086c9-c794-4775-b341-cab276ce81bb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:32.564464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb086c9-c794-4775-b341-cab276ce81bb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:32.564742 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb086c9-c794-4775-b341-cab276ce81bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:32.616071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8eb086c9-c794-4775-b341-cab276ce81bb None None] MFA Rules not processed for user `a63dd78421064bbe838b1ed0261c13bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:32.617273 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8eb086c9-c794-4775-b341-cab276ce81bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:32.654853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:32.688338 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 690/1401] 10.222.0.41 () {58 vars in 1009 bytes} [Mon May 30 11:59:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:32.731594 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f2338-5c92-4e5c-b849-dc767a1c3474 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:32.732130 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f2338-5c92-4e5c-b849-dc767a1c3474 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:32.732492 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f2338-5c92-4e5c-b849-dc767a1c3474 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:32.734036 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 712/1402] 10.222.0.41 () {54 vars in 942 bytes} [Mon May 30 11:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:32.740974 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d70772-0833-4eb5-977d-24008811f4e2 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:32.741271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d70772-0833-4eb5-977d-24008811f4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:32.741597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d70772-0833-4eb5-977d-24008811f4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:32.797099 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b1d70772-0833-4eb5-977d-24008811f4e2 None None] MFA Rules not processed for user `83e5f980cdb74227bb31c7e7e5eab74b`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:32.798316 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b1d70772-0833-4eb5-977d-24008811f4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:32.872826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 691/1403] 10.222.0.41 () {58 vars in 1039 bytes} [Mon May 30 11:59:32 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:32.882867 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f2338-5c92-4e5c-b849-dc767a1c3474 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:32.897299 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f2338-5c92-4e5c-b849-dc767a1c3474 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:32.902184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d47bc-f15c-4261-805a-04236eb7fc6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e5f980cdb74227bb31c7e7e5eab74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:32.902840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d47bc-f15c-4261-805a-04236eb7fc6a service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:32.903132 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d47bc-f15c-4261-805a-04236eb7fc6a service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:32.903434 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d47bc-f15c-4261-805a-04236eb7fc6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:32.911868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d47bc-f15c-4261-805a-04236eb7fc6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:32.913548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d47bc-f15c-4261-805a-04236eb7fc6a service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:32.922151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 713/1404] 10.222.0.41 () {60 vars in 1384 bytes} [Mon May 30 11:59:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 11:59:34.594509 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8bccf-ef40-4c8c-a6a7-83b5223800d7 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:34.598789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8bccf-ef40-4c8c-a6a7-83b5223800d7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:34.599154 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8bccf-ef40-4c8c-a6a7-83b5223800d7 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:34.605874 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 692/1405] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 11:59:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:34.609339 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586ff0f-6682-4249-bc03-606cf6fd3d90 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:34.609952 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586ff0f-6682-4249-bc03-606cf6fd3d90 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:34.610286 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586ff0f-6682-4249-bc03-606cf6fd3d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:34.642652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8586ff0f-6682-4249-bc03-606cf6fd3d90 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:34.644165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8586ff0f-6682-4249-bc03-606cf6fd3d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:34.691995 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 714/1406] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 11:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:34.727758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8bccf-ef40-4c8c-a6a7-83b5223800d7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:34.752824 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8bccf-ef40-4c8c-a6a7-83b5223800d7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:34.763579 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d41ba-3d0a-4dbf-ae01-a0251b2a9b5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:34.767855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d41ba-3d0a-4dbf-ae01-a0251b2a9b5d service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:34.767855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d41ba-3d0a-4dbf-ae01-a0251b2a9b5d service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:34.767855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d41ba-3d0a-4dbf-ae01-a0251b2a9b5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:34.779946 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d41ba-3d0a-4dbf-ae01-a0251b2a9b5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:34.781552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d41ba-3d0a-4dbf-ae01-a0251b2a9b5d service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:34.791771 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 693/1407] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 11:59:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 11:59:44.634436 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=55 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:44.786858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=62 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:57.193492 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be5433-6900-4ef0-8d56-e86de8e5ff1f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:57.194129 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be5433-6900-4ef0-8d56-e86de8e5ff1f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:57.194129 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be5433-6900-4ef0-8d56-e86de8e5ff1f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:57.195456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 715/1408] 10.222.0.41 () {54 vars in 918 bytes} [Mon May 30 11:59:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:57.200794 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa56f59-05aa-4b41-ad51-c0c73b8a2025 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:57.201257 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa56f59-05aa-4b41-ad51-c0c73b8a2025 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:57.201393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa56f59-05aa-4b41-ad51-c0c73b8a2025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:57.220446 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-cfa56f59-05aa-4b41-ad51-c0c73b8a2025 None None] MFA Rules not processed for user `48b43eb1a0ac4db5adee3512453459aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:57.221717 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cfa56f59-05aa-4b41-ad51-c0c73b8a2025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:57.230508 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 694/1409] 10.222.0.41 () {58 vars in 1015 bytes} [Mon May 30 11:59:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 11:59:57.245972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738e720-247e-474e-a8cf-be4a4916033f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:57.246263 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738e720-247e-474e-a8cf-be4a4916033f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:57.246543 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738e720-247e-474e-a8cf-be4a4916033f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:57.247882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 716/1410] 10.222.0.41 () {54 vars in 918 bytes} [Mon May 30 11:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:57.252342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d144d-69e8-46b4-ae60-3f8564727d0c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:57.252633 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d144d-69e8-46b4-ae60-3f8564727d0c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:57.252912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d144d-69e8-46b4-ae60-3f8564727d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:57.271128 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-501d144d-69e8-46b4-ae60-3f8564727d0c None None] MFA Rules not processed for user `bb3820a613744c15b840681fe6b6e808`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:57.272354 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-501d144d-69e8-46b4-ae60-3f8564727d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:57.281559 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 695/1411] 10.222.0.41 () {58 vars in 1015 bytes} [Mon May 30 11:59:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:00.002679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d999e-9f18-4dfe-ac1d-6598ed9050ba None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:00.003237 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d999e-9f18-4dfe-ac1d-6598ed9050ba None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:00.003237 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d999e-9f18-4dfe-ac1d-6598ed9050ba None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:00.005419 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 717/1412] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:00:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:00.010993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3328c28-0390-4cfb-b008-6ad64dc67e23 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:00.011404 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3328c28-0390-4cfb-b008-6ad64dc67e23 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:00.011565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3328c28-0390-4cfb-b008-6ad64dc67e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:00.030514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a3328c28-0390-4cfb-b008-6ad64dc67e23 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:00.031656 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a3328c28-0390-4cfb-b008-6ad64dc67e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:00.040188 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 696/1413] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:00.084995 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d999e-9f18-4dfe-ac1d-6598ed9050ba None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:00.100066 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d999e-9f18-4dfe-ac1d-6598ed9050ba None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:00.105372 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e95a2e-f8f3-46de-8e18-5047da35dbb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:00.105994 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e95a2e-f8f3-46de-8e18-5047da35dbb5 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:00.106273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e95a2e-f8f3-46de-8e18-5047da35dbb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:00.106545 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e95a2e-f8f3-46de-8e18-5047da35dbb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:00.115299 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e95a2e-f8f3-46de-8e18-5047da35dbb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:00.116879 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e95a2e-f8f3-46de-8e18-5047da35dbb5 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:00.125985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 718/1414] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:00:01.116839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b260d-ede2-486a-8af4-5d2527f89347 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:01.117375 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b260d-ede2-486a-8af4-5d2527f89347 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:01.117375 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b260d-ede2-486a-8af4-5d2527f89347 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:01.118690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 697/1415] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:01.123678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074568cd-c22f-4059-b645-b084a193e523 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:01.124169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074568cd-c22f-4059-b645-b084a193e523 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:01.124276 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074568cd-c22f-4059-b645-b084a193e523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:01.142870 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-074568cd-c22f-4059-b645-b084a193e523 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:01.144091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-074568cd-c22f-4059-b645-b084a193e523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:01.152223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 719/1416] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:01.358753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b260d-ede2-486a-8af4-5d2527f89347 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:01.373822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b260d-ede2-486a-8af4-5d2527f89347 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:01.379164 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c12c19-1404-4ee8-8eea-f0ab9ed49551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:01.379798 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c12c19-1404-4ee8-8eea-f0ab9ed49551 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:01.380108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c12c19-1404-4ee8-8eea-f0ab9ed49551 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:01.380389 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c12c19-1404-4ee8-8eea-f0ab9ed49551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:01.389289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c12c19-1404-4ee8-8eea-f0ab9ed49551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:01.390882 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c12c19-1404-4ee8-8eea-f0ab9ed49551 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:01.400566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 698/1417] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:00:02.341447 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947f9be-062c-4252-bdbb-4284435e4aee None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:02.342011 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947f9be-062c-4252-bdbb-4284435e4aee None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:02.342011 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947f9be-062c-4252-bdbb-4284435e4aee None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:02.343392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 720/1418] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:02.348484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb98fc-6ea3-47f2-bb60-fc5768cb0fa9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:02.348904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb98fc-6ea3-47f2-bb60-fc5768cb0fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:02.349014 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb98fc-6ea3-47f2-bb60-fc5768cb0fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:02.367315 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3beb98fc-6ea3-47f2-bb60-fc5768cb0fa9 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:02.368543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3beb98fc-6ea3-47f2-bb60-fc5768cb0fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:02.376214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 699/1419] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:02.526240 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947f9be-062c-4252-bdbb-4284435e4aee None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:02.542702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947f9be-062c-4252-bdbb-4284435e4aee None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:02.548998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeffc4-f774-441a-bb34-da6530561c3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:02.549749 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeffc4-f774-441a-bb34-da6530561c3c service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:02.550092 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeffc4-f774-441a-bb34-da6530561c3c service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:02.550432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeffc4-f774-441a-bb34-da6530561c3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:02.560659 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effeffc4-f774-441a-bb34-da6530561c3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:02.562568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effeffc4-f774-441a-bb34-da6530561c3c service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:02.574253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 721/1420] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:00:03.602763 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace6333-aa19-4fa3-abbf-cc0787429b64 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:03.603350 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace6333-aa19-4fa3-abbf-cc0787429b64 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:03.603350 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace6333-aa19-4fa3-abbf-cc0787429b64 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:03.604726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 700/1421] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:03.610140 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b63f8-6352-4dd1-bdff-6977dbc6f69b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:03.610540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b63f8-6352-4dd1-bdff-6977dbc6f69b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:03.610762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b63f8-6352-4dd1-bdff-6977dbc6f69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:03.632203 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-774b63f8-6352-4dd1-bdff-6977dbc6f69b None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:03.633672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-774b63f8-6352-4dd1-bdff-6977dbc6f69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:03.642739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 722/1422] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:03.820049 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace6333-aa19-4fa3-abbf-cc0787429b64 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:03.835182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace6333-aa19-4fa3-abbf-cc0787429b64 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:03.840594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fccbc1-10c6-4c75-882c-37bc36aaf62e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:03.841229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fccbc1-10c6-4c75-882c-37bc36aaf62e service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:03.841504 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fccbc1-10c6-4c75-882c-37bc36aaf62e service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:03.841777 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fccbc1-10c6-4c75-882c-37bc36aaf62e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:03.849931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fccbc1-10c6-4c75-882c-37bc36aaf62e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:03.851484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fccbc1-10c6-4c75-882c-37bc36aaf62e service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:03.860785 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 701/1423] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:00:04.787933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c9e78-4d65-44f3-b532-899cdaf45cec None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:04.788518 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c9e78-4d65-44f3-b532-899cdaf45cec None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:04.788518 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c9e78-4d65-44f3-b532-899cdaf45cec None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:04.789842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 723/1424] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:00:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:04.794865 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68601586-7ac0-4852-9f22-6c59dd88c467 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:04.795283 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68601586-7ac0-4852-9f22-6c59dd88c467 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:04.795424 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68601586-7ac0-4852-9f22-6c59dd88c467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:04.813117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-68601586-7ac0-4852-9f22-6c59dd88c467 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:04.814330 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-68601586-7ac0-4852-9f22-6c59dd88c467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:04.822671 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 702/1425] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:04.982120 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c9e78-4d65-44f3-b532-899cdaf45cec None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:04.997085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c9e78-4d65-44f3-b532-899cdaf45cec None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:05.002570 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab84fb9-c04b-42b9-bf72-729c76f45347 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:05.003196 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab84fb9-c04b-42b9-bf72-729c76f45347 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:05.003477 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab84fb9-c04b-42b9-bf72-729c76f45347 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:05.003750 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab84fb9-c04b-42b9-bf72-729c76f45347 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:05.012918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab84fb9-c04b-42b9-bf72-729c76f45347 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:05.014477 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab84fb9-c04b-42b9-bf72-729c76f45347 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:05.024785 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 724/1426] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:00:05.893051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab135c0b-13e0-4af2-8eaf-bfee22959526 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:05.893620 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab135c0b-13e0-4af2-8eaf-bfee22959526 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:05.893620 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab135c0b-13e0-4af2-8eaf-bfee22959526 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:05.895001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 703/1427] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:05.900453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b765d43-6453-4b07-8c2f-dc78626720de None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:05.900834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b765d43-6453-4b07-8c2f-dc78626720de None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:05.901033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b765d43-6453-4b07-8c2f-dc78626720de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:05.919903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-7b765d43-6453-4b07-8c2f-dc78626720de None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:05.921088 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7b765d43-6453-4b07-8c2f-dc78626720de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:05.930058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 725/1428] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:06.079492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab135c0b-13e0-4af2-8eaf-bfee22959526 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:06.093639 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab135c0b-13e0-4af2-8eaf-bfee22959526 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:06.099464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83474c5d-1128-4dbe-b85c-f123d438c91d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:06.100131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83474c5d-1128-4dbe-b85c-f123d438c91d service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:06.100418 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83474c5d-1128-4dbe-b85c-f123d438c91d service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:06.100698 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83474c5d-1128-4dbe-b85c-f123d438c91d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:06.108650 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83474c5d-1128-4dbe-b85c-f123d438c91d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:06.110225 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83474c5d-1128-4dbe-b85c-f123d438c91d service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:06.120553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 704/1429] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:00:06.966571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529d70e-6e84-45df-b102-da70617a5a55 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:06.967134 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529d70e-6e84-45df-b102-da70617a5a55 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:06.967134 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529d70e-6e84-45df-b102-da70617a5a55 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:06.968577 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 726/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:06.973814 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e6078-40e1-4d8f-83fc-92821db33b3b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:06.974235 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e6078-40e1-4d8f-83fc-92821db33b3b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:06.974467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e6078-40e1-4d8f-83fc-92821db33b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:06.996724 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-357e6078-40e1-4d8f-83fc-92821db33b3b None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:06.998119 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-357e6078-40e1-4d8f-83fc-92821db33b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:07.007947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 705/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:07.168536 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529d70e-6e84-45df-b102-da70617a5a55 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:07.184007 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529d70e-6e84-45df-b102-da70617a5a55 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:07.189266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e5a5c-7b0a-46e2-958b-d3544639f680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:07.189894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e5a5c-7b0a-46e2-958b-d3544639f680 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:07.190170 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e5a5c-7b0a-46e2-958b-d3544639f680 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:07.190442 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e5a5c-7b0a-46e2-958b-d3544639f680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:07.199655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e5a5c-7b0a-46e2-958b-d3544639f680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:07.201241 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e5a5c-7b0a-46e2-958b-d3544639f680 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:07.211005 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 727/1432] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:00:08.065554 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de38caa-07e7-4b7f-8708-d0d29b7eee46 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:08.066094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de38caa-07e7-4b7f-8708-d0d29b7eee46 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:08.066094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de38caa-07e7-4b7f-8708-d0d29b7eee46 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:08.068051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 706/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:08.072958 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7c62d-40ff-47cb-a097-6c7080e041b2 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:08.073381 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7c62d-40ff-47cb-a097-6c7080e041b2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:08.073523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7c62d-40ff-47cb-a097-6c7080e041b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:08.091672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8cc7c62d-40ff-47cb-a097-6c7080e041b2 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:08.092960 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8cc7c62d-40ff-47cb-a097-6c7080e041b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:08.102100 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 728/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:08.252813 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de38caa-07e7-4b7f-8708-d0d29b7eee46 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:08.267405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de38caa-07e7-4b7f-8708-d0d29b7eee46 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:08.273440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6db193-0085-48ec-9187-e8399eab6cce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:08.274076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6db193-0085-48ec-9187-e8399eab6cce service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:08.274353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6db193-0085-48ec-9187-e8399eab6cce service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:08.274632 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6db193-0085-48ec-9187-e8399eab6cce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:08.282548 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6db193-0085-48ec-9187-e8399eab6cce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:08.284154 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6db193-0085-48ec-9187-e8399eab6cce service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:08.293379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 707/1435] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:00:09.154026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6239f-ca42-48e5-bf99-ec9269eca085 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:09.154516 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6239f-ca42-48e5-bf99-ec9269eca085 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:09.154709 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6239f-ca42-48e5-bf99-ec9269eca085 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:09.156243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 729/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:09.162136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f97d6-5227-47ca-9c4a-a38eef26a23d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:09.162690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f97d6-5227-47ca-9c4a-a38eef26a23d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:09.162813 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f97d6-5227-47ca-9c4a-a38eef26a23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:09.182663 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2f6f97d6-5227-47ca-9c4a-a38eef26a23d None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:09.184071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2f6f97d6-5227-47ca-9c4a-a38eef26a23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:09.192962 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 708/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:09.365676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6239f-ca42-48e5-bf99-ec9269eca085 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:09.383326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6239f-ca42-48e5-bf99-ec9269eca085 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:09.389468 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab158fa-204c-4641-83d4-91130823b585 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:09.390231 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab158fa-204c-4641-83d4-91130823b585 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:09.390536 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab158fa-204c-4641-83d4-91130823b585 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:09.390832 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab158fa-204c-4641-83d4-91130823b585 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:09.400790 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab158fa-204c-4641-83d4-91130823b585 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:09.402520 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab158fa-204c-4641-83d4-91130823b585 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:09.413722 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 730/1438] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:00:11.563375 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d74dc6-267f-44b5-83c6-5334beeab7df None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:11.564054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d74dc6-267f-44b5-83c6-5334beeab7df None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:11.564054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d74dc6-267f-44b5-83c6-5334beeab7df None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:11.565346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 709/1439] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:11.571320 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99c9ba-1825-48af-a5d4-850a3c5dd55b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:11.571773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99c9ba-1825-48af-a5d4-850a3c5dd55b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:11.571919 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99c9ba-1825-48af-a5d4-850a3c5dd55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:11.589229 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0e99c9ba-1825-48af-a5d4-850a3c5dd55b None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:11.590421 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0e99c9ba-1825-48af-a5d4-850a3c5dd55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:11.598134 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 731/1440] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:11.651871 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee09684-0cf0-4009-bbce-5cf2de3cb3a1 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:11.652163 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee09684-0cf0-4009-bbce-5cf2de3cb3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:11.652444 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee09684-0cf0-4009-bbce-5cf2de3cb3a1 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:11.653813 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 710/1441] 10.222.0.41 () {54 vars in 964 bytes} [Mon May 30 12:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:11.659557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa3d5e-0b63-48ef-9408-3d96664061cf None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:11.659864 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa3d5e-0b63-48ef-9408-3d96664061cf None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:11.660147 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa3d5e-0b63-48ef-9408-3d96664061cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:11.697684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b4aa3d5e-0b63-48ef-9408-3d96664061cf None None] MFA Rules not processed for user `ae7bc0d4fd924bfb89f874d1c6fc3d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:11.698896 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b4aa3d5e-0b63-48ef-9408-3d96664061cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:11.705466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 732/1442] 10.222.0.41 () {58 vars in 1061 bytes} [Mon May 30 12:00:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:11.714622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee09684-0cf0-4009-bbce-5cf2de3cb3a1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:11.725111 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee09684-0cf0-4009-bbce-5cf2de3cb3a1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:11.728548 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282012d-3295-4ba1-911d-99046909741e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:11.729175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282012d-3295-4ba1-911d-99046909741e service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:11.729457 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282012d-3295-4ba1-911d-99046909741e service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:11.729734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282012d-3295-4ba1-911d-99046909741e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:11.738301 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282012d-3295-4ba1-911d-99046909741e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:11.740864 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282012d-3295-4ba1-911d-99046909741e service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:11.750001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 711/1443] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:00:14.618285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37837daa-bad2-4d1a-9729-5905d41f9743 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:14.618848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37837daa-bad2-4d1a-9729-5905d41f9743 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:14.618848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37837daa-bad2-4d1a-9729-5905d41f9743 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:14.620258 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:14.625609 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cf0eb-3925-4263-aaeb-2dd60d9995f9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:14.625991 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cf0eb-3925-4263-aaeb-2dd60d9995f9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:14.626169 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cf0eb-3925-4263-aaeb-2dd60d9995f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:14.644368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5b8cf0eb-3925-4263-aaeb-2dd60d9995f9 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:14.646191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5b8cf0eb-3925-4263-aaeb-2dd60d9995f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:14.653902 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:14.691203 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37837daa-bad2-4d1a-9729-5905d41f9743 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:14.702482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37837daa-bad2-4d1a-9729-5905d41f9743 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:14.706026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da698cc-c231-4ad1-bcc3-977ab9a0b0f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:14.706669 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da698cc-c231-4ad1-bcc3-977ab9a0b0f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:14.706949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da698cc-c231-4ad1-bcc3-977ab9a0b0f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:14.707910 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da698cc-c231-4ad1-bcc3-977ab9a0b0f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:14.717056 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da698cc-c231-4ad1-bcc3-977ab9a0b0f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:14.718478 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da698cc-c231-4ad1-bcc3-977ab9a0b0f8 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:14.728111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 734/1446] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:00:17.374528 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c174eb-ed3e-4133-af84-cdbbbbc59836 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:17.375135 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c174eb-ed3e-4133-af84-cdbbbbc59836 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:17.375135 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c174eb-ed3e-4133-af84-cdbbbbc59836 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:17.376486 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:17.382484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e729ad-55ef-4ee3-aca7-7de631a63f1f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:17.383191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e729ad-55ef-4ee3-aca7-7de631a63f1f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:17.383457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e729ad-55ef-4ee3-aca7-7de631a63f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:17.401938 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-87e729ad-55ef-4ee3-aca7-7de631a63f1f None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:17.403141 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-87e729ad-55ef-4ee3-aca7-7de631a63f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:17.411361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:17.450581 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c174eb-ed3e-4133-af84-cdbbbbc59836 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:17.461900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c174eb-ed3e-4133-af84-cdbbbbc59836 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:17.465458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c692408-26f0-4c45-b99f-81ed8df9f911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:17.466101 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c692408-26f0-4c45-b99f-81ed8df9f911 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:17.466386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c692408-26f0-4c45-b99f-81ed8df9f911 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:17.466662 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c692408-26f0-4c45-b99f-81ed8df9f911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:17.475843 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c692408-26f0-4c45-b99f-81ed8df9f911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:17.477301 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c692408-26f0-4c45-b99f-81ed8df9f911 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:17.486878 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 714/1449] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:00:19.851408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb1f55-fdaa-4ec6-a7c8-c53cfbf5e54e None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:19.851992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb1f55-fdaa-4ec6-a7c8-c53cfbf5e54e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:19.852095 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb1f55-fdaa-4ec6-a7c8-c53cfbf5e54e None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:19.853411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:19.858635 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ff22f-3612-4a9d-8ee4-1a9258430e1b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:19.859059 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ff22f-3612-4a9d-8ee4-1a9258430e1b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:19.859206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ff22f-3612-4a9d-8ee4-1a9258430e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:19.877248 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9f3ff22f-3612-4a9d-8ee4-1a9258430e1b None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:19.878440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9f3ff22f-3612-4a9d-8ee4-1a9258430e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:19.886859 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:19.925244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb1f55-fdaa-4ec6-a7c8-c53cfbf5e54e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:19.936612 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb1f55-fdaa-4ec6-a7c8-c53cfbf5e54e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:19.940091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bac2e-c948-46d6-ad18-509fed720f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:19.940728 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bac2e-c948-46d6-ad18-509fed720f49 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:19.941013 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bac2e-c948-46d6-ad18-509fed720f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:19.941290 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bac2e-c948-46d6-ad18-509fed720f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:19.950903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bac2e-c948-46d6-ad18-509fed720f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:19.952371 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bac2e-c948-46d6-ad18-509fed720f49 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:19.962068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 737/1452] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:00:22.288011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec59e3f-484d-4410-b4ea-94a8704c4242 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:22.288540 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec59e3f-484d-4410-b4ea-94a8704c4242 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:22.288651 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec59e3f-484d-4410-b4ea-94a8704c4242 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:22.289988 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:22.295662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9ea0f-10fa-4913-9239-ee4b63dcc9d8 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:22.296127 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9ea0f-10fa-4913-9239-ee4b63dcc9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:22.296266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9ea0f-10fa-4913-9239-ee4b63dcc9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:22.314627 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-31a9ea0f-10fa-4913-9239-ee4b63dcc9d8 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:22.315844 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-31a9ea0f-10fa-4913-9239-ee4b63dcc9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:22.324988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:00:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:22.363080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec59e3f-484d-4410-b4ea-94a8704c4242 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:22.374832 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec59e3f-484d-4410-b4ea-94a8704c4242 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:22.378269 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d8ec1-867c-4c1f-9355-12d5ffaab7e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:22.379686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d8ec1-867c-4c1f-9355-12d5ffaab7e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:22.380223 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d8ec1-867c-4c1f-9355-12d5ffaab7e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:22.380503 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d8ec1-867c-4c1f-9355-12d5ffaab7e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:22.389281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d8ec1-867c-4c1f-9355-12d5ffaab7e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:22.390699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d8ec1-867c-4c1f-9355-12d5ffaab7e6 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:22.400411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 717/1455] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:00:24.781159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ed3a0-14dd-49f0-a1bd-a32806480ec7 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:24.781647 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ed3a0-14dd-49f0-a1bd-a32806480ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:24.781752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ed3a0-14dd-49f0-a1bd-a32806480ec7 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:24.783085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:24.788456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a5011-2f14-4bb0-b89a-ce33880e5f34 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:24.788848 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a5011-2f14-4bb0-b89a-ce33880e5f34 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:24.789022 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a5011-2f14-4bb0-b89a-ce33880e5f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:24.795051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=70 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:24.808157 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-392a5011-2f14-4bb0-b89a-ce33880e5f34 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:24.809355 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-392a5011-2f14-4bb0-b89a-ce33880e5f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:24.817685 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:24.854868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ed3a0-14dd-49f0-a1bd-a32806480ec7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:24.860224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=73 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:24.867678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ed3a0-14dd-49f0-a1bd-a32806480ec7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:24.871141 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef455e25-6493-4bb7-8534-1ed6c2370fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:24.871774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef455e25-6493-4bb7-8534-1ed6c2370fcf service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:24.872089 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef455e25-6493-4bb7-8534-1ed6c2370fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:24.872365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef455e25-6493-4bb7-8534-1ed6c2370fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:24.882140 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef455e25-6493-4bb7-8534-1ed6c2370fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:24.883570 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef455e25-6493-4bb7-8534-1ed6c2370fcf service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:24.893033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 740/1458] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:00:27.211631 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234880ce-c371-43d2-9ccc-c04f97aa6f56 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:27.212203 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234880ce-c371-43d2-9ccc-c04f97aa6f56 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:27.212340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234880ce-c371-43d2-9ccc-c04f97aa6f56 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:27.213617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:27.218867 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26507401-15f4-468f-b3be-cf1c54420b31 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:27.219266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26507401-15f4-468f-b3be-cf1c54420b31 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:27.219419 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26507401-15f4-468f-b3be-cf1c54420b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:27.236686 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-26507401-15f4-468f-b3be-cf1c54420b31 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:27.237896 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-26507401-15f4-468f-b3be-cf1c54420b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:27.245809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:27.283422 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234880ce-c371-43d2-9ccc-c04f97aa6f56 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:27.294144 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234880ce-c371-43d2-9ccc-c04f97aa6f56 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:27.297628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5483a-aa2c-4d73-bdfd-5182fe6234ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:27.298260 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5483a-aa2c-4d73-bdfd-5182fe6234ed service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:27.298544 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5483a-aa2c-4d73-bdfd-5182fe6234ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:27.298827 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5483a-aa2c-4d73-bdfd-5182fe6234ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:27.307598 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5483a-aa2c-4d73-bdfd-5182fe6234ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:27.309108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5483a-aa2c-4d73-bdfd-5182fe6234ed service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:27.318871 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 720/1461] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:00:29.630577 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f0034-e5da-4cf5-807a-54be8cc7a25d None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:29.631140 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f0034-e5da-4cf5-807a-54be8cc7a25d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:29.631140 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f0034-e5da-4cf5-807a-54be8cc7a25d None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:29.632529 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:29.637912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88095ed-0069-4101-8db1-c56de78b9e29 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:29.638346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88095ed-0069-4101-8db1-c56de78b9e29 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:29.638469 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88095ed-0069-4101-8db1-c56de78b9e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:29.656198 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d88095ed-0069-4101-8db1-c56de78b9e29 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:29.657420 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d88095ed-0069-4101-8db1-c56de78b9e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:29.666178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:29.705064 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f0034-e5da-4cf5-807a-54be8cc7a25d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:29.715929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f0034-e5da-4cf5-807a-54be8cc7a25d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:29.719307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2cee8-d39f-407c-963e-87635deb0c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:29.719957 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2cee8-d39f-407c-963e-87635deb0c47 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:29.720239 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2cee8-d39f-407c-963e-87635deb0c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:29.720513 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2cee8-d39f-407c-963e-87635deb0c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:29.730213 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2cee8-d39f-407c-963e-87635deb0c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:29.731617 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2cee8-d39f-407c-963e-87635deb0c47 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:29.742162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 743/1464] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:00:32.010997 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62d2f3-5275-4122-88dc-87336e4127f4 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:32.011589 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62d2f3-5275-4122-88dc-87336e4127f4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:32.011589 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62d2f3-5275-4122-88dc-87336e4127f4 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:32.012950 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:32.018203 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354212d5-9543-42f3-8cd4-7d9cb8fb23c1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:32.018695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354212d5-9543-42f3-8cd4-7d9cb8fb23c1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:32.018803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354212d5-9543-42f3-8cd4-7d9cb8fb23c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:32.037098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-354212d5-9543-42f3-8cd4-7d9cb8fb23c1 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:32.038254 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-354212d5-9543-42f3-8cd4-7d9cb8fb23c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:32.045903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:32.083228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62d2f3-5275-4122-88dc-87336e4127f4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:32.093701 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62d2f3-5275-4122-88dc-87336e4127f4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:32.097177 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf381c27-47ef-4ab4-88f9-fe3bec225c2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:32.097921 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf381c27-47ef-4ab4-88f9-fe3bec225c2b service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:32.098374 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf381c27-47ef-4ab4-88f9-fe3bec225c2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:32.098657 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf381c27-47ef-4ab4-88f9-fe3bec225c2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:32.107368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf381c27-47ef-4ab4-88f9-fe3bec225c2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:32.108827 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf381c27-47ef-4ab4-88f9-fe3bec225c2b service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:32.118984 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 723/1467] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:00:34.440184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dce3f-85b8-49fa-89f3-aa8798bb6ca7 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:34.440734 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dce3f-85b8-49fa-89f3-aa8798bb6ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:34.440734 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dce3f-85b8-49fa-89f3-aa8798bb6ca7 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:34.442148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:34.447712 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be56dc-5da7-4ffd-a24f-fd0fbf52ff50 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:34.447712 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be56dc-5da7-4ffd-a24f-fd0fbf52ff50 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:34.448574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be56dc-5da7-4ffd-a24f-fd0fbf52ff50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:34.466169 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b9be56dc-5da7-4ffd-a24f-fd0fbf52ff50 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:34.467271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b9be56dc-5da7-4ffd-a24f-fd0fbf52ff50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:34.475680 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:00:34.511623 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dce3f-85b8-49fa-89f3-aa8798bb6ca7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:34.523272 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dce3f-85b8-49fa-89f3-aa8798bb6ca7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:34.526861 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057f096-b685-484b-8d7a-1c3911094e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:34.527493 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057f096-b685-484b-8d7a-1c3911094e8c service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:34.527779 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057f096-b685-484b-8d7a-1c3911094e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:34.528097 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057f096-b685-484b-8d7a-1c3911094e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:34.537718 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057f096-b685-484b-8d7a-1c3911094e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:34.539143 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057f096-b685-484b-8d7a-1c3911094e8c service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:34.548568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 746/1470] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:00:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:00:44.460995 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=20 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:44.544466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=23 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:01:06.623344 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1fb8a-c5d7-4254-9f9a-3a0b3aa02fab None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:06.623965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1fb8a-c5d7-4254-9f9a-3a0b3aa02fab None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:06.623965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1fb8a-c5d7-4254-9f9a-3a0b3aa02fab None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:06.625387 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 725/1471] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 12:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:01:06.631384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb07a6-0776-4419-83ce-69a6c4dbb699 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:06.631860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb07a6-0776-4419-83ce-69a6c4dbb699 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:06.631998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb07a6-0776-4419-83ce-69a6c4dbb699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:06.649316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d8bb07a6-0776-4419-83ce-69a6c4dbb699 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:01:06.650507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d8bb07a6-0776-4419-83ce-69a6c4dbb699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:01:06.658204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 747/1472] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 12:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:01:06.705501 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b2630-8290-4911-9210-88519444382c None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:06.705800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b2630-8290-4911-9210-88519444382c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:06.706088 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b2630-8290-4911-9210-88519444382c None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:06.707440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 726/1473] 10.222.0.41 () {54 vars in 962 bytes} [Mon May 30 12:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:01:06.712283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a51f2b-8dbd-4780-a9e0-a0319470d480 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:06.712578 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a51f2b-8dbd-4780-a9e0-a0319470d480 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:06.712864 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a51f2b-8dbd-4780-a9e0-a0319470d480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:06.730608 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-46a51f2b-8dbd-4780-a9e0-a0319470d480 None None] MFA Rules not processed for user `2ffa6d38c01f4820a705c06991654bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:01:06.731794 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-46a51f2b-8dbd-4780-a9e0-a0319470d480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:01:06.738119 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 748/1474] 10.222.0.41 () {58 vars in 1059 bytes} [Mon May 30 12:01:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:01:06.746028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b2630-8290-4911-9210-88519444382c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:01:06.757756 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b2630-8290-4911-9210-88519444382c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:01:06.761285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580abbeb-c214-4030-bc13-7175ad12ac92 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ffa6d38c01f4820a705c06991654bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:01:06.761904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580abbeb-c214-4030-bc13-7175ad12ac92 service glance] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:06.762188 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580abbeb-c214-4030-bc13-7175ad12ac92 service glance] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:06.762462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580abbeb-c214-4030-bc13-7175ad12ac92 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:06.772261 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580abbeb-c214-4030-bc13-7175ad12ac92 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:01:06.773694 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580abbeb-c214-4030-bc13-7175ad12ac92 service glance] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:01:06.783206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 727/1475] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:01:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:01:09.198932 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b82de6-e450-4100-bc53-49a13f32b578 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:09.199497 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b82de6-e450-4100-bc53-49a13f32b578 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:09.199497 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b82de6-e450-4100-bc53-49a13f32b578 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:09.200894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 749/1476] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 12:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:01:09.206228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a2b47-67f5-4642-9cdf-8166c687ad60 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:09.206623 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a2b47-67f5-4642-9cdf-8166c687ad60 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:09.206844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a2b47-67f5-4642-9cdf-8166c687ad60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:09.225002 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-782a2b47-67f5-4642-9cdf-8166c687ad60 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:01:09.226187 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-782a2b47-67f5-4642-9cdf-8166c687ad60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:01:09.233871 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 728/1477] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 12:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:01:09.258732 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b82de6-e450-4100-bc53-49a13f32b578 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:01:09.271670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b82de6-e450-4100-bc53-49a13f32b578 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:01:09.276141 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e9862-d8ed-4a68-8832-f6d85a19df7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:01:09.276805 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e9862-d8ed-4a68-8832-f6d85a19df7c admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:09.277072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e9862-d8ed-4a68-8832-f6d85a19df7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:09.277351 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e9862-d8ed-4a68-8832-f6d85a19df7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:09.278096 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e9862-d8ed-4a68-8832-f6d85a19df7c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:01:09.279840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-9c8e9862-d8ed-4a68-8832-f6d85a19df7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:01:09.279840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: warnings.warn(msg) May 30 12:01:09.279840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: May 30 12:01:09.280962 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e9862-d8ed-4a68-8832-f6d85a19df7c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:01:09.299563 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 750/1478] 10.222.0.41 () {56 vars in 1108 bytes} [Mon May 30 12:01:09 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:01:11.648779 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491c33e-73bc-41c0-bb03-eaf1de57cd05 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:11.649354 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491c33e-73bc-41c0-bb03-eaf1de57cd05 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:11.649354 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491c33e-73bc-41c0-bb03-eaf1de57cd05 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:11.650723 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 729/1479] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 12:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:01:11.656062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16e142-ce54-49af-8748-51d7edc9e7ec None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:11.656489 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16e142-ce54-49af-8748-51d7edc9e7ec None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:11.656636 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16e142-ce54-49af-8748-51d7edc9e7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:11.675001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-7e16e142-ce54-49af-8748-51d7edc9e7ec None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:01:11.676244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7e16e142-ce54-49af-8748-51d7edc9e7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:01:11.684068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 751/1480] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 12:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:01:11.727997 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491c33e-73bc-41c0-bb03-eaf1de57cd05 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:01:11.743041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491c33e-73bc-41c0-bb03-eaf1de57cd05 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:01:11.748434 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3150975-882f-42ca-9af5-aa93e10d4652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:01:11.749071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3150975-882f-42ca-9af5-aa93e10d4652 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:11.749359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3150975-882f-42ca-9af5-aa93e10d4652 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:11.749640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3150975-882f-42ca-9af5-aa93e10d4652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:11.758336 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3150975-882f-42ca-9af5-aa93e10d4652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:01:11.759945 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3150975-882f-42ca-9af5-aa93e10d4652 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:01:11.769898 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 730/1481] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:01:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:01:14.206277 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e077c8-9577-4ecd-a51e-3abffa721d64 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:14.206769 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e077c8-9577-4ecd-a51e-3abffa721d64 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:14.206873 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e077c8-9577-4ecd-a51e-3abffa721d64 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:14.208784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 752/1482] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 12:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:01:14.214230 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a6fbc-2429-4fdd-bfa4-a147efbbac2c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:14.214641 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a6fbc-2429-4fdd-bfa4-a147efbbac2c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:14.214790 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a6fbc-2429-4fdd-bfa4-a147efbbac2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:14.232855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-478a6fbc-2429-4fdd-bfa4-a147efbbac2c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:01:14.234048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-478a6fbc-2429-4fdd-bfa4-a147efbbac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:01:14.242234 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 731/1483] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 12:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:01:14.279265 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e077c8-9577-4ecd-a51e-3abffa721d64 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:01:14.290725 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e077c8-9577-4ecd-a51e-3abffa721d64 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:01:14.294238 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82938929-bed3-44db-a806-c4d2804b2dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:01:14.294867 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82938929-bed3-44db-a806-c4d2804b2dba service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:14.295160 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82938929-bed3-44db-a806-c4d2804b2dba service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:14.295537 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82938929-bed3-44db-a806-c4d2804b2dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:14.304759 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82938929-bed3-44db-a806-c4d2804b2dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:01:14.306202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82938929-bed3-44db-a806-c4d2804b2dba service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:01:14.315391 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 753/1484] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:01:16.626892 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a59f19-9e31-4b21-9664-5c503762f672 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:16.627399 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a59f19-9e31-4b21-9664-5c503762f672 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:16.627399 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a59f19-9e31-4b21-9664-5c503762f672 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:16.628803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 732/1485] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 12:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:01:16.634321 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a9bc5-84ce-4574-bd12-30116f61523d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:16.634755 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a9bc5-84ce-4574-bd12-30116f61523d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:16.634887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a9bc5-84ce-4574-bd12-30116f61523d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:16.653047 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f39a9bc5-84ce-4574-bd12-30116f61523d None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:01:16.654230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f39a9bc5-84ce-4574-bd12-30116f61523d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:01:16.662839 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 754/1486] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:01:16.701225 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a59f19-9e31-4b21-9664-5c503762f672 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:01:16.712254 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a59f19-9e31-4b21-9664-5c503762f672 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:01:16.715782 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ec6c3-2fbb-4363-902f-885e672ff1ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:01:16.716467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ec6c3-2fbb-4363-902f-885e672ff1ce service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:16.716753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ec6c3-2fbb-4363-902f-885e672ff1ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:16.717032 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ec6c3-2fbb-4363-902f-885e672ff1ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:16.726755 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ec6c3-2fbb-4363-902f-885e672ff1ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:01:16.728226 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ec6c3-2fbb-4363-902f-885e672ff1ce service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:01:16.737510 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 733/1487] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:01:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:01:19.124646 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708c9eb-f726-48d7-b8b8-550a9d6f61fc None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:19.125246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708c9eb-f726-48d7-b8b8-550a9d6f61fc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:19.125246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708c9eb-f726-48d7-b8b8-550a9d6f61fc None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:19.126596 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 755/1488] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 12:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:01:19.132981 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b9b31-1ce3-4a3f-ad96-b9f130246157 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:19.133391 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b9b31-1ce3-4a3f-ad96-b9f130246157 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:19.133536 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b9b31-1ce3-4a3f-ad96-b9f130246157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:19.152600 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5c6b9b31-1ce3-4a3f-ad96-b9f130246157 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:01:19.153802 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5c6b9b31-1ce3-4a3f-ad96-b9f130246157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:01:19.161660 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 734/1489] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 12:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:01:19.201949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708c9eb-f726-48d7-b8b8-550a9d6f61fc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:01:19.213652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708c9eb-f726-48d7-b8b8-550a9d6f61fc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:01:19.217132 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b3c57-72be-4957-8249-07b833469469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:01:19.217757 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b3c57-72be-4957-8249-07b833469469 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:19.218037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b3c57-72be-4957-8249-07b833469469 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:19.218311 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b3c57-72be-4957-8249-07b833469469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:19.227479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b3c57-72be-4957-8249-07b833469469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:01:19.228917 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b3c57-72be-4957-8249-07b833469469 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:01:19.237992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 756/1490] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:01:21.767231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76d540-46e3-4918-bb68-f0c2c65e0bac None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:21.767837 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76d540-46e3-4918-bb68-f0c2c65e0bac None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:21.767837 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76d540-46e3-4918-bb68-f0c2c65e0bac None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:21.769264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 735/1491] 10.222.0.41 () {54 vars in 926 bytes} [Mon May 30 12:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 12:01:21.775750 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce2162-14ca-4adf-8429-e63fb150a786 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:21.776187 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce2162-14ca-4adf-8429-e63fb150a786 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:21.776336 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce2162-14ca-4adf-8429-e63fb150a786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:21.794617 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-97ce2162-14ca-4adf-8429-e63fb150a786 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:01:21.795797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-97ce2162-14ca-4adf-8429-e63fb150a786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:01:21.804073 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 757/1492] 10.222.0.41 () {58 vars in 1023 bytes} [Mon May 30 12:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:01:21.842523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76d540-46e3-4918-bb68-f0c2c65e0bac None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:01:21.854120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76d540-46e3-4918-bb68-f0c2c65e0bac None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:01:21.857650 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f998da2-6658-4c8c-b5b7-7166dc1ebf5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:01:21.858290 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f998da2-6658-4c8c-b5b7-7166dc1ebf5f service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:01:21.858575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f998da2-6658-4c8c-b5b7-7166dc1ebf5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:01:21.858854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f998da2-6658-4c8c-b5b7-7166dc1ebf5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:01:21.868105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f998da2-6658-4c8c-b5b7-7166dc1ebf5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:01:21.869537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f998da2-6658-4c8c-b5b7-7166dc1ebf5f service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:01:21.878976 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 736/1493] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:01:31.789441 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=33 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:01:31.874745 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=33 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:02:48.200116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7ca4c-b137-49fe-87bb-8db4aed3ce48 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:02:48.200678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7ca4c-b137-49fe-87bb-8db4aed3ce48 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:02:48.200678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7ca4c-b137-49fe-87bb-8db4aed3ce48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:02:48.219038 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-cfc7ca4c-b137-49fe-87bb-8db4aed3ce48 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:02:48.220279 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cfc7ca4c-b137-49fe-87bb-8db4aed3ce48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:02:48.228591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 758/1494] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:02:48.236808 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5606ba4-5e2d-4d44-84bc-d72e205501bc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:02:48.237326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5606ba4-5e2d-4d44-84bc-d72e205501bc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:02:48.237435 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5606ba4-5e2d-4d44-84bc-d72e205501bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:02:48.255749 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e5606ba4-5e2d-4d44-84bc-d72e205501bc None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:02:48.256974 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e5606ba4-5e2d-4d44-84bc-d72e205501bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:02:48.264712 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 737/1495] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:02:48.269703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7ca4c-b137-49fe-87bb-8db4aed3ce48 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:02:48.279351 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7ca4c-b137-49fe-87bb-8db4aed3ce48 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:02:48.284011 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893d186-6389-4259-86f3-3ae2c77520e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:02:48.284668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893d186-6389-4259-86f3-3ae2c77520e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:02:48.284955 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893d186-6389-4259-86f3-3ae2c77520e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:02:48.285236 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893d186-6389-4259-86f3-3ae2c77520e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:02:48.285966 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893d186-6389-4259-86f3-3ae2c77520e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:02:48.286277 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893d186-6389-4259-86f3-3ae2c77520e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:02:48.287285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-8893d186-6389-4259-86f3-3ae2c77520e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 12:02:48.287285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: warnings.warn(msg) May 30 12:02:48.287285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: May 30 12:02:48.288201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893d186-6389-4259-86f3-3ae2c77520e1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:02:48.299489 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 759/1496] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:02:48.307379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5606ba4-5e2d-4d44-84bc-d72e205501bc None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:02:48.316923 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5606ba4-5e2d-4d44-84bc-d72e205501bc None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:02:48.321493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0393e-fae7-497b-b770-aaeae0aebc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:02:48.322144 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0393e-fae7-497b-b770-aaeae0aebc0b admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:02:48.322430 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0393e-fae7-497b-b770-aaeae0aebc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:02:48.322713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0393e-fae7-497b-b770-aaeae0aebc0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:02:48.323413 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0393e-fae7-497b-b770-aaeae0aebc0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:02:48.325223 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: WARNING py.warnings [None req-6ed0393e-fae7-497b-b770-aaeae0aebc0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:02:48.325223 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: warnings.warn(msg) May 30 12:02:48.325223 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: May 30 12:02:48.326406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0393e-fae7-497b-b770-aaeae0aebc0b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:02:48.362299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 738/1497] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:02:48 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:02:48.366680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893d186-6389-4259-86f3-3ae2c77520e1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:02:48.376636 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893d186-6389-4259-86f3-3ae2c77520e1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:02:48.432423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68fd32-c336-4ed7-a08f-2a5438606188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:02:48.433093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68fd32-c336-4ed7-a08f-2a5438606188 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:02:48.433382 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68fd32-c336-4ed7-a08f-2a5438606188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:02:48.433665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68fd32-c336-4ed7-a08f-2a5438606188 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:02:48.434393 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68fd32-c336-4ed7-a08f-2a5438606188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:02:48.435406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-2a68fd32-c336-4ed7-a08f-2a5438606188 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:02:48.435406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: warnings.warn(msg) May 30 12:02:48.435406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: May 30 12:02:48.436644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68fd32-c336-4ed7-a08f-2a5438606188 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:02:48.457486 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 760/1498] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:02:48 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:02:48.461649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0393e-fae7-497b-b770-aaeae0aebc0b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:02:48.471940 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0393e-fae7-497b-b770-aaeae0aebc0b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:02:48.476457 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c483211-4930-4bb5-852c-383fc231a78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:02:48.477113 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c483211-4930-4bb5-852c-383fc231a78f admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:02:48.477400 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c483211-4930-4bb5-852c-383fc231a78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:02:48.477677 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c483211-4930-4bb5-852c-383fc231a78f admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:02:48.478412 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c483211-4930-4bb5-852c-383fc231a78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:02:48.479426 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: WARNING py.warnings [None req-2c483211-4930-4bb5-852c-383fc231a78f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 12:02:48.479426 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: warnings.warn(msg) May 30 12:02:48.479426 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: May 30 12:02:48.480347 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c483211-4930-4bb5-852c-383fc231a78f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:02:48.493693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 739/1499] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:02:48.497581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68fd32-c336-4ed7-a08f-2a5438606188 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:02:48.508011 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68fd32-c336-4ed7-a08f-2a5438606188 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:02:48.512722 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa903f7f-f278-47ca-a5df-7a1ab14cd600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:02:48.513416 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa903f7f-f278-47ca-a5df-7a1ab14cd600 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:02:48.513764 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa903f7f-f278-47ca-a5df-7a1ab14cd600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:02:48.514067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa903f7f-f278-47ca-a5df-7a1ab14cd600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:02:48.515098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa903f7f-f278-47ca-a5df-7a1ab14cd600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:02:48.516506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-aa903f7f-f278-47ca-a5df-7a1ab14cd600 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 12:02:48.516506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: warnings.warn(msg) May 30 12:02:48.516506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: May 30 12:02:48.517389 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa903f7f-f278-47ca-a5df-7a1ab14cd600 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:02:48.530608 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 761/1500] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:02:48.534749 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c483211-4930-4bb5-852c-383fc231a78f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:02:48.544531 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c483211-4930-4bb5-852c-383fc231a78f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:02:48.549875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446699a5-c965-4c00-887d-5e78427b2139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:02:48.550740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446699a5-c965-4c00-887d-5e78427b2139 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:02:48.551028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446699a5-c965-4c00-887d-5e78427b2139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:02:48.551302 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446699a5-c965-4c00-887d-5e78427b2139 admin admin] PATH_INFO: `/v3/projects/a4c04d7a201949a296b61bc8c5ecae28/users/4f8c5de1d3904056919fcdf2ee1230c2/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:02:48.565957 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446699a5-c965-4c00-887d-5e78427b2139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c04d7a201949a296b61bc8c5ecae28, user_id=4f8c5de1d3904056919fcdf2ee1230c2, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:02:48.566986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: WARNING py.warnings [None req-446699a5-c965-4c00-887d-5e78427b2139 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:02:48.566986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: warnings.warn(msg) May 30 12:02:48.566986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: May 30 12:02:48.568950 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446699a5-c965-4c00-887d-5e78427b2139 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:02:48.582166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 740/1501] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:02:48 2022] PUT /identity/v3/projects/a4c04d7a201949a296b61bc8c5ecae28/users/4f8c5de1d3904056919fcdf2ee1230c2/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:02:48.594245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3d688-be8d-486a-a4dc-841b429165df None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:02:48.594540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3d688-be8d-486a-a4dc-841b429165df None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:02:48.594821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3d688-be8d-486a-a4dc-841b429165df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:02:48.622510 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9aa3d688-be8d-486a-a4dc-841b429165df None None] MFA Rules not processed for user `4f8c5de1d3904056919fcdf2ee1230c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:02:48.623718 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9aa3d688-be8d-486a-a4dc-841b429165df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:02:48.686875 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 762/1502] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:02:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:02:48.700127 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d972e-aba0-48aa-bf08-9d8530cc0761 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:02:48.700428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d972e-aba0-48aa-bf08-9d8530cc0761 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:02:48.700738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d972e-aba0-48aa-bf08-9d8530cc0761 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:02:48.702158 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 741/1503] 10.222.0.41 () {54 vars in 963 bytes} [Mon May 30 12:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:02:48.707623 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45681832-9ff2-44ae-98ad-c061c924a574 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:02:48.707852 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45681832-9ff2-44ae-98ad-c061c924a574 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:02:48.708138 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45681832-9ff2-44ae-98ad-c061c924a574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:02:48.726370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-45681832-9ff2-44ae-98ad-c061c924a574 None None] MFA Rules not processed for user `ca1110aeeded4ab0b6fa2aedfa8740c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:02:48.727574 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-45681832-9ff2-44ae-98ad-c061c924a574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:02:48.770915 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:02:48.778952 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 763/1504] 10.222.0.41 () {58 vars in 1060 bytes} [Mon May 30 12:02:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:02:48.787392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d972e-aba0-48aa-bf08-9d8530cc0761 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:02:48.798106 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d972e-aba0-48aa-bf08-9d8530cc0761 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:02:48.801676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08be37-3565-4111-b226-86357882f905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:02:48.802309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08be37-3565-4111-b226-86357882f905 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:02:48.802594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08be37-3565-4111-b226-86357882f905 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:02:48.802871 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08be37-3565-4111-b226-86357882f905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:02:48.811048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08be37-3565-4111-b226-86357882f905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:02:48.812586 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08be37-3565-4111-b226-86357882f905 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:02:48.821611 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 742/1505] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:02:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:02:48.864159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e4978-f3b3-4756-8bd5-7d1ab2ad4be5 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:02:48.864454 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e4978-f3b3-4756-8bd5-7d1ab2ad4be5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:02:48.864738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e4978-f3b3-4756-8bd5-7d1ab2ad4be5 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:02:48.866040 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 764/1506] 10.222.0.41 () {52 vars in 829 bytes} [Mon May 30 12:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:02:48.869656 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08be37-3565-4111-b226-86357882f905 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:02:48.930278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08be37-3565-4111-b226-86357882f905 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:02:48.934812 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48aa1d-61c9-4a7e-9b2a-760eb21e49f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:02:48.935675 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48aa1d-61c9-4a7e-9b2a-760eb21e49f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:02:48.935992 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48aa1d-61c9-4a7e-9b2a-760eb21e49f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:02:48.936272 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48aa1d-61c9-4a7e-9b2a-760eb21e49f6 admin admin] PATH_INFO: `/v3/users/4f8c5de1d3904056919fcdf2ee1230c2` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:02:48.937462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48aa1d-61c9-4a7e-9b2a-760eb21e49f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f8c5de1d3904056919fcdf2ee1230c2)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:02:48.938489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: WARNING py.warnings [None req-3f48aa1d-61c9-4a7e-9b2a-760eb21e49f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:02:48.938489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: warnings.warn(msg) May 30 12:02:48.938489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: May 30 12:02:48.940226 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48aa1d-61c9-4a7e-9b2a-760eb21e49f6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:02:49.004780 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3f48aa1d-61c9-4a7e-9b2a-760eb21e49f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f8c5de1d3904056919fcdf2ee1230c2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:02:49.015663 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3f48aa1d-61c9-4a7e-9b2a-760eb21e49f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f8c5de1d3904056919fcdf2ee1230c2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:02:49.034970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3f48aa1d-61c9-4a7e-9b2a-760eb21e49f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f8c5de1d3904056919fcdf2ee1230c2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:02:49.035638 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3f48aa1d-61c9-4a7e-9b2a-760eb21e49f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f8c5de1d3904056919fcdf2ee1230c2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:02:49.036371 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3f48aa1d-61c9-4a7e-9b2a-760eb21e49f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f8c5de1d3904056919fcdf2ee1230c2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:02:49.044417 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:02:49.056614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 743/1507] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:02:48 2022] DELETE /identity/v3/users/4f8c5de1d3904056919fcdf2ee1230c2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:02:49.060993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d08b29-4176-44be-9cc7-2f39e16e9149 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:02:49.061285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d08b29-4176-44be-9cc7-2f39e16e9149 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:02:49.061566 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d08b29-4176-44be-9cc7-2f39e16e9149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:02:49.079070 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-78d08b29-4176-44be-9cc7-2f39e16e9149 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:02:49.080966 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-78d08b29-4176-44be-9cc7-2f39e16e9149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:02:49.137203 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 765/1508] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:02:49.147195 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48aa1d-61c9-4a7e-9b2a-760eb21e49f6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:02:49.148621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3f48aa1d-61c9-4a7e-9b2a-760eb21e49f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:02:49.204836 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48aa1d-61c9-4a7e-9b2a-760eb21e49f6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:02:49.209345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acbc9c-e32f-4c28-a4e0-32b23baae432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:02:49.209997 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acbc9c-e32f-4c28-a4e0-32b23baae432 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:02:49.210286 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acbc9c-e32f-4c28-a4e0-32b23baae432 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:02:49.210565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acbc9c-e32f-4c28-a4e0-32b23baae432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:02:49.219577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acbc9c-e32f-4c28-a4e0-32b23baae432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:02:49.221102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acbc9c-e32f-4c28-a4e0-32b23baae432 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:02:49.230465 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 744/1509] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:02:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:02:49.586769 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d08b29-4176-44be-9cc7-2f39e16e9149 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:02:49.588552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-78d08b29-4176-44be-9cc7-2f39e16e9149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:02:49.601522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d08b29-4176-44be-9cc7-2f39e16e9149 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:02:49.606150 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b1461-6b14-49b2-9d10-8529a3e7d4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:02:49.607211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b1461-6b14-49b2-9d10-8529a3e7d4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:02:49.607504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b1461-6b14-49b2-9d10-8529a3e7d4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:02:49.607789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b1461-6b14-49b2-9d10-8529a3e7d4a8 admin admin] PATH_INFO: `/v3/projects/a4c04d7a201949a296b61bc8c5ecae28` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:02:49.609027 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b1461-6b14-49b2-9d10-8529a3e7d4a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4c04d7a201949a296b61bc8c5ecae28)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:02:49.610051 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-f59b1461-6b14-49b2-9d10-8529a3e7d4a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:02:49.610051 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: warnings.warn(msg) May 30 12:02:49.610051 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: May 30 12:02:49.611296 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b1461-6b14-49b2-9d10-8529a3e7d4a8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:02:49.677048 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f59b1461-6b14-49b2-9d10-8529a3e7d4a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4c04d7a201949a296b61bc8c5ecae28', 'request_id': 'req-f59b1461-6b14-49b2-9d10-8529a3e7d4a8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:02:49.690215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f59b1461-6b14-49b2-9d10-8529a3e7d4a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4c04d7a201949a296b61bc8c5ecae28', 'request_id': 'req-f59b1461-6b14-49b2-9d10-8529a3e7d4a8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:02:49.700269 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f59b1461-6b14-49b2-9d10-8529a3e7d4a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4c04d7a201949a296b61bc8c5ecae28', 'request_id': 'req-f59b1461-6b14-49b2-9d10-8529a3e7d4a8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:02:49.711674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f59b1461-6b14-49b2-9d10-8529a3e7d4a8 admin admin] The token cache is being invalidate because project a4c04d7a201949a296b61bc8c5ecae28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:02:49.712010 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f59b1461-6b14-49b2-9d10-8529a3e7d4a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:02:49.712744 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f59b1461-6b14-49b2-9d10-8529a3e7d4a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:02:49.714333 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 766/1510] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:02:49 2022] DELETE /identity/v3/projects/a4c04d7a201949a296b61bc8c5ecae28 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:02:59.226310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=29 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:02:59.708556 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:32.226398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cbd57-ba1c-4d5d-aae4-eda95ab9ab67 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:32.226989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cbd57-ba1c-4d5d-aae4-eda95ab9ab67 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:32.226989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cbd57-ba1c-4d5d-aae4-eda95ab9ab67 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:32.228390 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:04:32.233301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8006535-a29a-43f4-81c6-b810edef4296 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:32.234254 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8006535-a29a-43f4-81c6-b810edef4296 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:32.234491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8006535-a29a-43f4-81c6-b810edef4296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:32.253276 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c8006535-a29a-43f4-81c6-b810edef4296 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:04:32.254483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c8006535-a29a-43f4-81c6-b810edef4296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:04:32.312903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:04:32.481573 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cbd57-ba1c-4d5d-aae4-eda95ab9ab67 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:04:32.483246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-843cbd57-ba1c-4d5d-aae4-eda95ab9ab67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:04:32.558484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cbd57-ba1c-4d5d-aae4-eda95ab9ab67 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:04:32.564358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa0d20-89eb-4e01-bc65-8cff9fcda27c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:04:32.565009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa0d20-89eb-4e01-bc65-8cff9fcda27c service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:32.565295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa0d20-89eb-4e01-bc65-8cff9fcda27c service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:32.565584 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa0d20-89eb-4e01-bc65-8cff9fcda27c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:32.573707 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa0d20-89eb-4e01-bc65-8cff9fcda27c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:04:32.575300 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa0d20-89eb-4e01-bc65-8cff9fcda27c service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:04:32.585341 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 746/1513] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:04:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:04:33.471569 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146454f0-89b5-462c-b60f-d7772a2cffa1 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:33.472186 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146454f0-89b5-462c-b60f-d7772a2cffa1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:33.472186 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146454f0-89b5-462c-b60f-d7772a2cffa1 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:33.473598 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 768/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:04:33.478455 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85978f-5265-43b6-b8a6-b77d525bc4fd None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:33.478872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85978f-5265-43b6-b8a6-b77d525bc4fd None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:33.479027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85978f-5265-43b6-b8a6-b77d525bc4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:33.497891 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1a85978f-5265-43b6-b8a6-b77d525bc4fd None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:04:33.499799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1a85978f-5265-43b6-b8a6-b77d525bc4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:04:33.507548 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 747/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:04:33.657359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146454f0-89b5-462c-b60f-d7772a2cffa1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:04:33.672474 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146454f0-89b5-462c-b60f-d7772a2cffa1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:04:33.677910 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde9457-94a7-4a9f-840a-5f2e37dd22aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:04:33.678543 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde9457-94a7-4a9f-840a-5f2e37dd22aa service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:33.678833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde9457-94a7-4a9f-840a-5f2e37dd22aa service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:33.679113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde9457-94a7-4a9f-840a-5f2e37dd22aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:33.687843 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde9457-94a7-4a9f-840a-5f2e37dd22aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:04:33.689436 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde9457-94a7-4a9f-840a-5f2e37dd22aa service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:04:33.698845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 769/1516] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:04:35.160471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ea33-645f-42f4-9426-81fd48605174 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:35.161005 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ea33-645f-42f4-9426-81fd48605174 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:35.161110 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ea33-645f-42f4-9426-81fd48605174 None None] PATH_INFO: `/v3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:35.162347 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 748/1517] 10.222.0.66 () {54 vars in 925 bytes} [Mon May 30 12:04:35 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:04:35.171715 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d340e-54fc-43c9-8f3f-6ba22bc0b1a3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:35.172207 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d340e-54fc-43c9-8f3f-6ba22bc0b1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:35.172304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d340e-54fc-43c9-8f3f-6ba22bc0b1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:35.190883 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c27d340e-54fc-43c9-8f3f-6ba22bc0b1a3 None None] MFA Rules not processed for user `48b43eb1a0ac4db5adee3512453459aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:04:35.192131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c27d340e-54fc-43c9-8f3f-6ba22bc0b1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:04:35.253751 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 770/1518] 10.222.0.66 () {58 vars in 1015 bytes} [Mon May 30 12:04:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:04:43.492480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=37 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:45.023694 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d847b1f-956f-4d87-847b-6da0c49e4960 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:45.024342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d847b1f-956f-4d87-847b-6da0c49e4960 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:45.024342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d847b1f-956f-4d87-847b-6da0c49e4960 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:45.025639 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 749/1519] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:04:45.030673 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fd555-b964-42f1-9528-ddc875eebc16 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:45.031103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fd555-b964-42f1-9528-ddc875eebc16 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:45.031368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fd555-b964-42f1-9528-ddc875eebc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:45.051362 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d95fd555-b964-42f1-9528-ddc875eebc16 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:04:45.052582 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d95fd555-b964-42f1-9528-ddc875eebc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:04:45.060385 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 771/1520] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:04:45.217055 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d847b1f-956f-4d87-847b-6da0c49e4960 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:04:45.232361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d847b1f-956f-4d87-847b-6da0c49e4960 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:04:45.238667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea8f47-330f-416c-9cf8-49ab56773280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:04:45.239303 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea8f47-330f-416c-9cf8-49ab56773280 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:45.239589 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea8f47-330f-416c-9cf8-49ab56773280 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:45.239904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea8f47-330f-416c-9cf8-49ab56773280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:45.248177 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea8f47-330f-416c-9cf8-49ab56773280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:04:45.249772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea8f47-330f-416c-9cf8-49ab56773280 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:04:45.259354 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 750/1521] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:04:45.452528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81831197-f14b-49e5-8fa9-1ec63029542a None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:45.452901 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81831197-f14b-49e5-8fa9-1ec63029542a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:45.453192 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81831197-f14b-49e5-8fa9-1ec63029542a None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:45.454597 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 772/1522] 10.222.0.41 () {54 vars in 960 bytes} [Mon May 30 12:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:04:45.460638 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca63f19-227d-4172-982b-3d51dc0de5d0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:45.460938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca63f19-227d-4172-982b-3d51dc0de5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:45.461219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca63f19-227d-4172-982b-3d51dc0de5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:45.479851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1ca63f19-227d-4172-982b-3d51dc0de5d0 None None] MFA Rules not processed for user `48b43eb1a0ac4db5adee3512453459aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:04:45.481067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1ca63f19-227d-4172-982b-3d51dc0de5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:04:45.489870 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 751/1523] 10.222.0.41 () {58 vars in 1057 bytes} [Mon May 30 12:04:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:04:45.497408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81831197-f14b-49e5-8fa9-1ec63029542a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:04:45.511076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81831197-f14b-49e5-8fa9-1ec63029542a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:04:45.516143 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d66e0d-eed5-462f-9145-56dae0cf2eef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b43eb1a0ac4db5adee3512453459aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:04:45.516820 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d66e0d-eed5-462f-9145-56dae0cf2eef service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:45.517107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d66e0d-eed5-462f-9145-56dae0cf2eef service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:45.517931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d66e0d-eed5-462f-9145-56dae0cf2eef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:45.527432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d66e0d-eed5-462f-9145-56dae0cf2eef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:04:45.529318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d66e0d-eed5-462f-9145-56dae0cf2eef service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:04:45.541521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 773/1524] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:04:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:04:46.159752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeaa13f-c36a-4028-96c8-668d045bd15c None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:46.160334 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeaa13f-c36a-4028-96c8-668d045bd15c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:46.160334 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeaa13f-c36a-4028-96c8-668d045bd15c None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:46.161735 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 12:04:46.166427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a3498-8cf4-44c7-a173-ff555f0a9458 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:46.166865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a3498-8cf4-44c7-a173-ff555f0a9458 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:46.166978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a3498-8cf4-44c7-a173-ff555f0a9458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:46.185311 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-440a3498-8cf4-44c7-a173-ff555f0a9458 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:04:46.186505 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-440a3498-8cf4-44c7-a173-ff555f0a9458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:04:46.194819 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:04:46.346977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeaa13f-c36a-4028-96c8-668d045bd15c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:04:46.362165 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeaa13f-c36a-4028-96c8-668d045bd15c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:04:46.367666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4b35e-cc9c-41a1-9d69-c44f0d09012e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:04:46.368344 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4b35e-cc9c-41a1-9d69-c44f0d09012e service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:46.368632 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4b35e-cc9c-41a1-9d69-c44f0d09012e service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:46.368913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4b35e-cc9c-41a1-9d69-c44f0d09012e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:46.377082 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4b35e-cc9c-41a1-9d69-c44f0d09012e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:04:46.378669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4b35e-cc9c-41a1-9d69-c44f0d09012e service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:04:46.388197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 753/1527] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:04:50.528584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5cc83-a5fc-46dd-ae85-cbd03d71d3f1 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:50.529148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5cc83-a5fc-46dd-ae85-cbd03d71d3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:50.529148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5cc83-a5fc-46dd-ae85-cbd03d71d3f1 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:50.530522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:04:50.535989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea2206-18e5-464a-9f04-7e5e9a9b7182 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:50.536390 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea2206-18e5-464a-9f04-7e5e9a9b7182 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:50.536544 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea2206-18e5-464a-9f04-7e5e9a9b7182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:50.554267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f9ea2206-18e5-464a-9f04-7e5e9a9b7182 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:04:50.555413 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f9ea2206-18e5-464a-9f04-7e5e9a9b7182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:04:50.563034 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:04:50.600015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5cc83-a5fc-46dd-ae85-cbd03d71d3f1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:04:50.601716 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-54c5cc83-a5fc-46dd-ae85-cbd03d71d3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:04:50.659485 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5cc83-a5fc-46dd-ae85-cbd03d71d3f1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:04:50.663027 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63487db1-7189-4d56-9a60-cd21b449e4c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:04:50.663667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63487db1-7189-4d56-9a60-cd21b449e4c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:50.663988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63487db1-7189-4d56-9a60-cd21b449e4c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:50.664270 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63487db1-7189-4d56-9a60-cd21b449e4c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:50.673314 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63487db1-7189-4d56-9a60-cd21b449e4c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:04:50.675220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63487db1-7189-4d56-9a60-cd21b449e4c9 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:04:50.680112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:50.685108 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 776/1530] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:04:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:04:52.926539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcdbf2-e551-400d-b89f-f3dfc0f7408f None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:52.927102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcdbf2-e551-400d-b89f-f3dfc0f7408f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:52.927102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcdbf2-e551-400d-b89f-f3dfc0f7408f None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:52.928574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:04:52.933733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72359997-4f96-4edd-90ef-638d35ee0e28 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:52.934165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72359997-4f96-4edd-90ef-638d35ee0e28 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:52.934297 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72359997-4f96-4edd-90ef-638d35ee0e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:52.952157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-72359997-4f96-4edd-90ef-638d35ee0e28 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:04:52.953351 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-72359997-4f96-4edd-90ef-638d35ee0e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:04:52.961524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:04:52.998170 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcdbf2-e551-400d-b89f-f3dfc0f7408f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:04:52.999881 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-52dcdbf2-e551-400d-b89f-f3dfc0f7408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:04:53.013358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcdbf2-e551-400d-b89f-f3dfc0f7408f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:04:53.016899 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62643fff-6132-41a1-b3e5-b5c01fab5455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:04:53.018027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62643fff-6132-41a1-b3e5-b5c01fab5455 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:53.018316 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62643fff-6132-41a1-b3e5-b5c01fab5455 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:53.018594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62643fff-6132-41a1-b3e5-b5c01fab5455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:53.027565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62643fff-6132-41a1-b3e5-b5c01fab5455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:04:53.029053 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62643fff-6132-41a1-b3e5-b5c01fab5455 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:04:53.039448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 756/1533] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:04:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:04:56.901185 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025e0d1-bb82-4688-9406-d7815d8d2023 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:56.901721 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025e0d1-bb82-4688-9406-d7815d8d2023 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:56.901721 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025e0d1-bb82-4688-9406-d7815d8d2023 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:56.903279 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:04:56.908680 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27a38b-5448-43e4-9fc6-d331cfde0145 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:56.909119 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27a38b-5448-43e4-9fc6-d331cfde0145 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:56.909238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27a38b-5448-43e4-9fc6-d331cfde0145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:56.929197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-dc27a38b-5448-43e4-9fc6-d331cfde0145 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:04:56.930406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-dc27a38b-5448-43e4-9fc6-d331cfde0145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:04:56.944023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:04:57.227455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025e0d1-bb82-4688-9406-d7815d8d2023 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:04:57.229184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c025e0d1-bb82-4688-9406-d7815d8d2023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:04:57.289299 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025e0d1-bb82-4688-9406-d7815d8d2023 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:04:57.293046 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2be88-5006-4c14-a9be-f12a9d9cc5a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:04:57.293703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2be88-5006-4c14-a9be-f12a9d9cc5a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:57.293992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2be88-5006-4c14-a9be-f12a9d9cc5a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:57.294282 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2be88-5006-4c14-a9be-f12a9d9cc5a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:57.304263 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2be88-5006-4c14-a9be-f12a9d9cc5a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:04:57.305716 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2be88-5006-4c14-a9be-f12a9d9cc5a9 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:04:57.315869 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 779/1536] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:04:59.614252 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ed9b2-0486-4309-aae7-7b36f97424e5 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:59.614851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ed9b2-0486-4309-aae7-7b36f97424e5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:59.614851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ed9b2-0486-4309-aae7-7b36f97424e5 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:59.616241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:04:59.621501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cb6b2-f244-4b5f-9c51-488b732dcfdc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:59.621951 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cb6b2-f244-4b5f-9c51-488b732dcfdc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:59.622097 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cb6b2-f244-4b5f-9c51-488b732dcfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:59.640374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ce8cb6b2-f244-4b5f-9c51-488b732dcfdc None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:04:59.641577 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ce8cb6b2-f244-4b5f-9c51-488b732dcfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:04:59.650058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:04:59.926421 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ed9b2-0486-4309-aae7-7b36f97424e5 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:04:59.928126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c03ed9b2-0486-4309-aae7-7b36f97424e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:04:59.941928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ed9b2-0486-4309-aae7-7b36f97424e5 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:04:59.945456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba45833-65ff-45ef-8577-522025cce7ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:04:59.946092 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba45833-65ff-45ef-8577-522025cce7ae service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:04:59.946374 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba45833-65ff-45ef-8577-522025cce7ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:04:59.946646 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba45833-65ff-45ef-8577-522025cce7ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:04:59.956070 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba45833-65ff-45ef-8577-522025cce7ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:04:59.957489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba45833-65ff-45ef-8577-522025cce7ae service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:04:59.966858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 759/1539] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:05:09.635281 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=32 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:05:09.962907 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=33 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:29.438125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92f265-eca9-4b8b-b59a-d8cda3881725 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:29.438767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92f265-eca9-4b8b-b59a-d8cda3881725 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:29.438767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92f265-eca9-4b8b-b59a-d8cda3881725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:29.473257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8e92f265-eca9-4b8b-b59a-d8cda3881725 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:29.474711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8e92f265-eca9-4b8b-b59a-d8cda3881725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:29.489866 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 781/1540] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:29.499420 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61961eb6-8281-49c8-8e2b-1f0a1565469f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:29.500036 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61961eb6-8281-49c8-8e2b-1f0a1565469f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:29.500036 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61961eb6-8281-49c8-8e2b-1f0a1565469f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:29.530602 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-61961eb6-8281-49c8-8e2b-1f0a1565469f None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:29.532229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-61961eb6-8281-49c8-8e2b-1f0a1565469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:29.544335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 760/1541] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:29.549999 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92f265-eca9-4b8b-b59a-d8cda3881725 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:29.565498 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92f265-eca9-4b8b-b59a-d8cda3881725 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:29.576084 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1d831-aeb3-4e21-a01a-f68c9e4cdf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:29.577065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1d831-aeb3-4e21-a01a-f68c9e4cdf55 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:29.577360 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1d831-aeb3-4e21-a01a-f68c9e4cdf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:29.577646 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1d831-aeb3-4e21-a01a-f68c9e4cdf55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:29.578403 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1d831-aeb3-4e21-a01a-f68c9e4cdf55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:06:29.578718 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1d831-aeb3-4e21-a01a-f68c9e4cdf55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:29.580414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1d831-aeb3-4e21-a01a-f68c9e4cdf55 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:29.599160 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 782/1542] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:06:29.608331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61961eb6-8281-49c8-8e2b-1f0a1565469f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:29.620580 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61961eb6-8281-49c8-8e2b-1f0a1565469f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:29.632889 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258e191-6ddb-421f-b4e7-0dd3fc567911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:29.634033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258e191-6ddb-421f-b4e7-0dd3fc567911 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:29.634547 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258e191-6ddb-421f-b4e7-0dd3fc567911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:29.635052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258e191-6ddb-421f-b4e7-0dd3fc567911 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:29.636058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258e191-6ddb-421f-b4e7-0dd3fc567911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:29.638290 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258e191-6ddb-421f-b4e7-0dd3fc567911 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:29.691131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 761/1543] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:06:29 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:29.696621 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1d831-aeb3-4e21-a01a-f68c9e4cdf55 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:29.707169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1d831-aeb3-4e21-a01a-f68c9e4cdf55 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:29.802776 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac894641-63e8-464f-bf67-b1c6072fefc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:29.803473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac894641-63e8-464f-bf67-b1c6072fefc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:29.803764 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac894641-63e8-464f-bf67-b1c6072fefc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:29.804076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac894641-63e8-464f-bf67-b1c6072fefc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:29.804808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac894641-63e8-464f-bf67-b1c6072fefc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:29.806889 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac894641-63e8-464f-bf67-b1c6072fefc1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:29.854732 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 783/1544] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:06:29 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:06:29.859482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258e191-6ddb-421f-b4e7-0dd3fc567911 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:29.872024 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258e191-6ddb-421f-b4e7-0dd3fc567911 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:29.884121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac079f1-b967-4883-bc02-0698c982b02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:29.884336 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eac58-30a6-4a7f-a0eb-778363475205 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:29.884574 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eac58-30a6-4a7f-a0eb-778363475205 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:29.884803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eac58-30a6-4a7f-a0eb-778363475205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:29.885721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac079f1-b967-4883-bc02-0698c982b02c admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:29.886233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac079f1-b967-4883-bc02-0698c982b02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:29.886723 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac079f1-b967-4883-bc02-0698c982b02c admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:29.887844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac079f1-b967-4883-bc02-0698c982b02c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:29.889730 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac079f1-b967-4883-bc02-0698c982b02c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:29.902874 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 762/1545] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:29.904638 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582bac9-ec3d-4457-8738-8beb35d263ba None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:29.905153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582bac9-ec3d-4457-8738-8beb35d263ba None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:29.905645 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582bac9-ec3d-4457-8738-8beb35d263ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:29.912366 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-972eac58-30a6-4a7f-a0eb-778363475205 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:29.913725 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-972eac58-30a6-4a7f-a0eb-778363475205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:29.925840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 784/1546] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:06:29.931648 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb8acc-aa32-4bf3-ac07-5b9f8d850702 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:29.931976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb8acc-aa32-4bf3-ac07-5b9f8d850702 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:29.932268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb8acc-aa32-4bf3-ac07-5b9f8d850702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:29.952961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0582bac9-ec3d-4457-8738-8beb35d263ba None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:29.954104 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0582bac9-ec3d-4457-8738-8beb35d263ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:29.955574 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-bcdb8acc-aa32-4bf3-ac07-5b9f8d850702 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:29.956795 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bcdb8acc-aa32-4bf3-ac07-5b9f8d850702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:29.969345 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 785/1547] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:29.972665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 763/1548] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:29.973582 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb8acc-aa32-4bf3-ac07-5b9f8d850702 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:29.975628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73351da9-2aad-4785-ae93-ca5242845a87 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:29.975931 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73351da9-2aad-4785-ae93-ca5242845a87 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:29.976314 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73351da9-2aad-4785-ae93-ca5242845a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:29.993770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb8acc-aa32-4bf3-ac07-5b9f8d850702 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.004886 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734c2d1-f7ee-46f6-b7be-9578b18d2a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.005579 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734c2d1-f7ee-46f6-b7be-9578b18d2a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.005871 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734c2d1-f7ee-46f6-b7be-9578b18d2a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.006156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734c2d1-f7ee-46f6-b7be-9578b18d2a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.006906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734c2d1-f7ee-46f6-b7be-9578b18d2a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.008562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734c2d1-f7ee-46f6-b7be-9578b18d2a74 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.015372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-73351da9-2aad-4785-ae93-ca5242845a87 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:30.017547 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-73351da9-2aad-4785-ae93-ca5242845a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:30.038968 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 786/1549] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:30.040427 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 764/1550] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:30.042553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe103860-d188-45a5-a00f-b5242c40a617 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.042850 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe103860-d188-45a5-a00f-b5242c40a617 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.043150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe103860-d188-45a5-a00f-b5242c40a617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.043267 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4758dd4-5e08-498d-bdf7-4bd2294d91e7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.043439 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4758dd4-5e08-498d-bdf7-4bd2294d91e7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.043718 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4758dd4-5e08-498d-bdf7-4bd2294d91e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.066442 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d4758dd4-5e08-498d-bdf7-4bd2294d91e7 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:30.068217 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d4758dd4-5e08-498d-bdf7-4bd2294d91e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:30.077117 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 787/1551] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:30.078373 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f14479-1828-4187-8ca5-1a27bfcf0725 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.082051 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f14479-1828-4187-8ca5-1a27bfcf0725 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.082051 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f14479-1828-4187-8ca5-1a27bfcf0725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.084840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-fe103860-d188-45a5-a00f-b5242c40a617 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:30.087469 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fe103860-d188-45a5-a00f-b5242c40a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:30.103093 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 765/1552] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:30.103289 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-37f14479-1828-4187-8ca5-1a27bfcf0725 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:30.104667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-37f14479-1828-4187-8ca5-1a27bfcf0725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:30.105939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f7efa-67d9-4b86-9838-8f2d9e40a62e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.106618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f7efa-67d9-4b86-9838-8f2d9e40a62e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.107296 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f7efa-67d9-4b86-9838-8f2d9e40a62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.113321 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 788/1553] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:30.114117 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f14479-1828-4187-8ca5-1a27bfcf0725 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.123775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f14479-1828-4187-8ca5-1a27bfcf0725 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.128390 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed2c23-26d6-4a5f-b362-e9be57481fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.129825 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed2c23-26d6-4a5f-b362-e9be57481fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.130107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed2c23-26d6-4a5f-b362-e9be57481fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.130386 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed2c23-26d6-4a5f-b362-e9be57481fe1 admin admin] PATH_INFO: `/v3/projects/74054e993c3a4c8794bb96540281f87d/users/e12d075bc9144a5e8de3fe53004e9052/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.139572 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d26f7efa-67d9-4b86-9838-8f2d9e40a62e None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:30.141142 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d26f7efa-67d9-4b86-9838-8f2d9e40a62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:30.149537 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed2c23-26d6-4a5f-b362-e9be57481fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74054e993c3a4c8794bb96540281f87d, user_id=e12d075bc9144a5e8de3fe53004e9052, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.150583 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 766/1554] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:30.150742 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-3fed2c23-26d6-4a5f-b362-e9be57481fe1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:06:30.150742 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: warnings.warn(msg) May 30 12:06:30.150742 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: May 30 12:06:30.151517 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f7efa-67d9-4b86-9838-8f2d9e40a62e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.152566 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed2c23-26d6-4a5f-b362-e9be57481fe1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.163119 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f7efa-67d9-4b86-9838-8f2d9e40a62e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.166976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 789/1555] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:30 2022] PUT /identity/v3/projects/74054e993c3a4c8794bb96540281f87d/users/e12d075bc9144a5e8de3fe53004e9052/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:30.168431 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2cf05-ce8f-43a1-916c-ad9fe20b29ce None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.168722 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2cf05-ce8f-43a1-916c-ad9fe20b29ce None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.169021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2cf05-ce8f-43a1-916c-ad9fe20b29ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.186755 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-7ec2cf05-ce8f-43a1-916c-ad9fe20b29ce None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:30.187993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7ec2cf05-ce8f-43a1-916c-ad9fe20b29ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:30.224833 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594cb90-ab77-4bf9-8352-000fbd1bed11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.225425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594cb90-ab77-4bf9-8352-000fbd1bed11 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.225714 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594cb90-ab77-4bf9-8352-000fbd1bed11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.225996 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594cb90-ab77-4bf9-8352-000fbd1bed11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.226725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594cb90-ab77-4bf9-8352-000fbd1bed11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:06:30.227039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594cb90-ab77-4bf9-8352-000fbd1bed11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.228104 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: WARNING py.warnings [None req-2594cb90-ab77-4bf9-8352-000fbd1bed11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 12:06:30.228104 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: warnings.warn(msg) May 30 12:06:30.228104 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: May 30 12:06:30.228994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594cb90-ab77-4bf9-8352-000fbd1bed11 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.241726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 767/1556] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:06:30.243232 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d088dc-4068-4d8a-afe0-eeacf4673476 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.243668 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d088dc-4068-4d8a-afe0-eeacf4673476 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.244189 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d088dc-4068-4d8a-afe0-eeacf4673476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.253438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 790/1557] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:30.254695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2cf05-ce8f-43a1-916c-ad9fe20b29ce None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.264358 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2cf05-ce8f-43a1-916c-ad9fe20b29ce None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.264524 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a2d088dc-4068-4d8a-afe0-eeacf4673476 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:30.265707 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a2d088dc-4068-4d8a-afe0-eeacf4673476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:30.269019 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef021574-57c6-4f1d-a034-c44055dbc318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.270228 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef021574-57c6-4f1d-a034-c44055dbc318 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.270528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef021574-57c6-4f1d-a034-c44055dbc318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.270808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef021574-57c6-4f1d-a034-c44055dbc318 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.271538 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef021574-57c6-4f1d-a034-c44055dbc318 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:06:30.271878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef021574-57c6-4f1d-a034-c44055dbc318 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.273471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef021574-57c6-4f1d-a034-c44055dbc318 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.274376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 768/1558] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:30.275021 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d088dc-4068-4d8a-afe0-eeacf4673476 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.280546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:30.284865 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d088dc-4068-4d8a-afe0-eeacf4673476 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.293129 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 791/1559] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:06:30.293129 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2522322-7bbe-4053-a28a-135d4cf64d02 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.293129 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2522322-7bbe-4053-a28a-135d4cf64d02 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.293129 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2522322-7bbe-4053-a28a-135d4cf64d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.293537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798d9b3-4e73-4b3e-8b42-e1355831b340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.293537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798d9b3-4e73-4b3e-8b42-e1355831b340 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.293537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798d9b3-4e73-4b3e-8b42-e1355831b340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.293537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798d9b3-4e73-4b3e-8b42-e1355831b340 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.293890 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798d9b3-4e73-4b3e-8b42-e1355831b340 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:06:30.293890 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798d9b3-4e73-4b3e-8b42-e1355831b340 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.295490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798d9b3-4e73-4b3e-8b42-e1355831b340 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.307705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b2522322-7bbe-4053-a28a-135d4cf64d02 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:30.308073 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 769/1560] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:06:30.308957 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b2522322-7bbe-4053-a28a-135d4cf64d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:30.309311 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88090c03-488e-4c6a-8b38-1fe3280f5332 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.309599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88090c03-488e-4c6a-8b38-1fe3280f5332 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.309876 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88090c03-488e-4c6a-8b38-1fe3280f5332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.317155 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 792/1561] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:30.318374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087ed08-72b8-43bb-b481-0cb9c86b346a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.318667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087ed08-72b8-43bb-b481-0cb9c86b346a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.318946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087ed08-72b8-43bb-b481-0cb9c86b346a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.332124 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-88090c03-488e-4c6a-8b38-1fe3280f5332 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:30.333972 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-88090c03-488e-4c6a-8b38-1fe3280f5332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:30.337540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a087ed08-72b8-43bb-b481-0cb9c86b346a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:30.338685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a087ed08-72b8-43bb-b481-0cb9c86b346a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:30.342340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 770/1562] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:30.343215 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88090c03-488e-4c6a-8b38-1fe3280f5332 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.346630 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 793/1563] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:30.348565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0778c-66f1-41b7-bc55-865b86dc5e84 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.348853 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0778c-66f1-41b7-bc55-865b86dc5e84 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.349139 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0778c-66f1-41b7-bc55-865b86dc5e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.357812 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88090c03-488e-4c6a-8b38-1fe3280f5332 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.363157 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0c949-9f24-42d4-96d9-07d39bee6b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.363958 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0c949-9f24-42d4-96d9-07d39bee6b7a admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.364405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0c949-9f24-42d4-96d9-07d39bee6b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.364683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0c949-9f24-42d4-96d9-07d39bee6b7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.365382 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0c949-9f24-42d4-96d9-07d39bee6b7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.367336 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0c949-9f24-42d4-96d9-07d39bee6b7a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.368508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-57e0778c-66f1-41b7-bc55-865b86dc5e84 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:30.369706 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-57e0778c-66f1-41b7-bc55-865b86dc5e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:30.377586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 794/1564] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:30.378476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0778c-66f1-41b7-bc55-865b86dc5e84 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.388652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0778c-66f1-41b7-bc55-865b86dc5e84 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.393262 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3098a11-2d3e-48b3-a5d4-267fa4ef7697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.393914 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3098a11-2d3e-48b3-a5d4-267fa4ef7697 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.394199 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3098a11-2d3e-48b3-a5d4-267fa4ef7697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.394481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3098a11-2d3e-48b3-a5d4-267fa4ef7697 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.394583 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 771/1565] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:30.398516 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3098a11-2d3e-48b3-a5d4-267fa4ef7697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:06:30.398626 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0c949-9f24-42d4-96d9-07d39bee6b7a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.398714 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3098a11-2d3e-48b3-a5d4-267fa4ef7697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.398714 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3098a11-2d3e-48b3-a5d4-267fa4ef7697 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.411171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 795/1566] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:06:30.412026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3098a11-2d3e-48b3-a5d4-267fa4ef7697 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.422063 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3098a11-2d3e-48b3-a5d4-267fa4ef7697 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.439378 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:30.461127 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0c949-9f24-42d4-96d9-07d39bee6b7a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.465718 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bfd36-3ed0-4ca2-9eb9-1005d860f009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.466378 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bfd36-3ed0-4ca2-9eb9-1005d860f009 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.466662 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bfd36-3ed0-4ca2-9eb9-1005d860f009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.466942 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bfd36-3ed0-4ca2-9eb9-1005d860f009 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.467634 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061bfd36-3ed0-4ca2-9eb9-1005d860f009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.469617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061bfd36-3ed0-4ca2-9eb9-1005d860f009 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.481341 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49806577-8028-4040-812a-40583f597fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.481933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49806577-8028-4040-812a-40583f597fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.482217 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49806577-8028-4040-812a-40583f597fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.482496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49806577-8028-4040-812a-40583f597fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.483193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49806577-8028-4040-812a-40583f597fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.484332 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-49806577-8028-4040-812a-40583f597fb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:06:30.484332 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: warnings.warn(msg) May 30 12:06:30.484332 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: May 30 12:06:30.485933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49806577-8028-4040-812a-40583f597fb2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.498376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 772/1567] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:30.500150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946567e-35ca-4733-ad2c-740ca0667830 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.500735 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946567e-35ca-4733-ad2c-740ca0667830 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.500735 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946567e-35ca-4733-ad2c-740ca0667830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.517166 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 796/1568] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:30.517166 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49806577-8028-4040-812a-40583f597fb2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.518983 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6946567e-35ca-4733-ad2c-740ca0667830 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:30.520563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6946567e-35ca-4733-ad2c-740ca0667830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:30.580970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 773/1569] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:30.581620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49806577-8028-4040-812a-40583f597fb2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.581811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946567e-35ca-4733-ad2c-740ca0667830 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.586496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc057f-e3d3-413b-b165-ee4cac37200d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.587279 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc057f-e3d3-413b-b165-ee4cac37200d admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.587571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc057f-e3d3-413b-b165-ee4cac37200d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.587877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc057f-e3d3-413b-b165-ee4cac37200d admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.588615 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc057f-e3d3-413b-b165-ee4cac37200d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:06:30.588929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc057f-e3d3-413b-b165-ee4cac37200d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.590527 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc057f-e3d3-413b-b165-ee4cac37200d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.602514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 797/1570] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:06:30.603339 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc057f-e3d3-413b-b165-ee4cac37200d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.613315 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc057f-e3d3-413b-b165-ee4cac37200d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.618627 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e32171-03db-4619-a5f2-d760a64153d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.619272 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e32171-03db-4619-a5f2-d760a64153d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.619692 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e32171-03db-4619-a5f2-d760a64153d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.620004 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e32171-03db-4619-a5f2-d760a64153d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.620737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e32171-03db-4619-a5f2-d760a64153d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:06:30.621082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e32171-03db-4619-a5f2-d760a64153d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.622671 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e32171-03db-4619-a5f2-d760a64153d5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.635445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 798/1571] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:06:30.636261 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e32171-03db-4619-a5f2-d760a64153d5 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.645875 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e32171-03db-4619-a5f2-d760a64153d5 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.650646 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d25870-3dbd-4cc9-b5e2-ff10bba2ec6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.651305 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d25870-3dbd-4cc9-b5e2-ff10bba2ec6c admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.651596 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d25870-3dbd-4cc9-b5e2-ff10bba2ec6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.651913 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d25870-3dbd-4cc9-b5e2-ff10bba2ec6c admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.652609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d25870-3dbd-4cc9-b5e2-ff10bba2ec6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.652729 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946567e-35ca-4733-ad2c-740ca0667830 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.654522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d25870-3dbd-4cc9-b5e2-ff10bba2ec6c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.656236 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9f94c-46c5-4508-a190-7d769dcd800b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.656885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9f94c-46c5-4508-a190-7d769dcd800b service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.657168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9f94c-46c5-4508-a190-7d769dcd800b service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.657445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9f94c-46c5-4508-a190-7d769dcd800b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.668830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9f94c-46c5-4508-a190-7d769dcd800b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.670624 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9f94c-46c5-4508-a190-7d769dcd800b service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.680566 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 799/1572] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:30.680566 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d25870-3dbd-4cc9-b5e2-ff10bba2ec6c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.684522 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 774/1573] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:30.685385 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9f94c-46c5-4508-a190-7d769dcd800b service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.688257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d25870-3dbd-4cc9-b5e2-ff10bba2ec6c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.694671 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b4a8a-fc66-4150-b73a-a529dcd31b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.695441 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b4a8a-fc66-4150-b73a-a529dcd31b3a admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.695638 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b4a8a-fc66-4150-b73a-a529dcd31b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.695935 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b4a8a-fc66-4150-b73a-a529dcd31b3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.696039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9f94c-46c5-4508-a190-7d769dcd800b service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.696707 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b4a8a-fc66-4150-b73a-a529dcd31b3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.698553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b4a8a-fc66-4150-b73a-a529dcd31b3a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.700895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396fb51-be32-46d0-8b54-e6279c5224ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.701687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396fb51-be32-46d0-8b54-e6279c5224ad admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.702082 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396fb51-be32-46d0-8b54-e6279c5224ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.702732 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396fb51-be32-46d0-8b54-e6279c5224ad admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.703937 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396fb51-be32-46d0-8b54-e6279c5224ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.705057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: WARNING py.warnings [None req-b396fb51-be32-46d0-8b54-e6279c5224ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:06:30.705057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: warnings.warn(msg) May 30 12:06:30.705057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: May 30 12:06:30.706898 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396fb51-be32-46d0-8b54-e6279c5224ad admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.708620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:30.730174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 800/1574] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:30.731100 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 775/1575] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:30.733965 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b4a8a-fc66-4150-b73a-a529dcd31b3a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.736561 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396fb51-be32-46d0-8b54-e6279c5224ad admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.746750 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396fb51-be32-46d0-8b54-e6279c5224ad admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.802804 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:30.810315 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b4a8a-fc66-4150-b73a-a529dcd31b3a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.815472 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed160a-4791-46b4-a669-803c2ce45168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.815648 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe379d-11a8-41fe-94fb-6b335fc9f379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.816398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe379d-11a8-41fe-94fb-6b335fc9f379 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.817183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed160a-4791-46b4-a669-803c2ce45168 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.817285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe379d-11a8-41fe-94fb-6b335fc9f379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.817688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed160a-4791-46b4-a669-803c2ce45168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.817852 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe379d-11a8-41fe-94fb-6b335fc9f379 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.818125 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed160a-4791-46b4-a669-803c2ce45168 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.818589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe379d-11a8-41fe-94fb-6b335fc9f379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.819036 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed160a-4791-46b4-a669-803c2ce45168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:06:30.819356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed160a-4791-46b4-a669-803c2ce45168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.820815 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe379d-11a8-41fe-94fb-6b335fc9f379 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.821034 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed160a-4791-46b4-a669-803c2ce45168 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.837790 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 776/1576] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:06:30.838627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed160a-4791-46b4-a669-803c2ce45168 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.855810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed160a-4791-46b4-a669-803c2ce45168 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.856245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 801/1577] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:30.857066 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe379d-11a8-41fe-94fb-6b335fc9f379 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.864643 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfdc37-dcb3-491c-ab68-32ed0c8aeb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.865629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfdc37-dcb3-491c-ab68-32ed0c8aeb10 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.866086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfdc37-dcb3-491c-ab68-32ed0c8aeb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.866381 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfdc37-dcb3-491c-ab68-32ed0c8aeb10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.867067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfdc37-dcb3-491c-ab68-32ed0c8aeb10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.868774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe379d-11a8-41fe-94fb-6b335fc9f379 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.869289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfdc37-dcb3-491c-ab68-32ed0c8aeb10 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.874148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d5cee-41ce-4298-b0c3-2fee8844e33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.874820 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d5cee-41ce-4298-b0c3-2fee8844e33b admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.875103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d5cee-41ce-4298-b0c3-2fee8844e33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.875382 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d5cee-41ce-4298-b0c3-2fee8844e33b admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.876148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d5cee-41ce-4298-b0c3-2fee8844e33b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.878056 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d5cee-41ce-4298-b0c3-2fee8844e33b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.904012 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 777/1578] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:30.905300 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfdc37-dcb3-491c-ab68-32ed0c8aeb10 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.912190 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 802/1579] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/projects => generated 405 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:30.913144 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d5cee-41ce-4298-b0c3-2fee8844e33b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.982976 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfdc37-dcb3-491c-ab68-32ed0c8aeb10 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.989556 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01950c09-e25e-4596-bfd8-df4d06d84762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.990264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01950c09-e25e-4596-bfd8-df4d06d84762 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.990473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d5cee-41ce-4298-b0c3-2fee8844e33b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.990801 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01950c09-e25e-4596-bfd8-df4d06d84762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.991168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01950c09-e25e-4596-bfd8-df4d06d84762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.992054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01950c09-e25e-4596-bfd8-df4d06d84762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.993795 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01950c09-e25e-4596-bfd8-df4d06d84762 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.996091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279a78-14fd-4f77-9007-3c5757812097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.996781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279a78-14fd-4f77-9007-3c5757812097 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.997074 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279a78-14fd-4f77-9007-3c5757812097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.997358 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279a78-14fd-4f77-9007-3c5757812097 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.998064 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3279a78-14fd-4f77-9007-3c5757812097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.000412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3279a78-14fd-4f77-9007-3c5757812097 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.010749 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 778/1580] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:31.010749 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01950c09-e25e-4596-bfd8-df4d06d84762 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.022301 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01950c09-e25e-4596-bfd8-df4d06d84762 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.026106 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 803/1581] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:31.026801 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279a78-14fd-4f77-9007-3c5757812097 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.030994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfdb58-8cb1-479a-a1e3-853754713ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.031684 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfdb58-8cb1-479a-a1e3-853754713ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.032012 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfdb58-8cb1-479a-a1e3-853754713ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.032278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfdb58-8cb1-479a-a1e3-853754713ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.033013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfdb58-8cb1-479a-a1e3-853754713ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.034626 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfdb58-8cb1-479a-a1e3-853754713ee5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.036562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279a78-14fd-4f77-9007-3c5757812097 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.041263 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f439a0-4e18-4ad2-b72d-dbafa37a446c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.041922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f439a0-4e18-4ad2-b72d-dbafa37a446c admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.042210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f439a0-4e18-4ad2-b72d-dbafa37a446c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.042490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f439a0-4e18-4ad2-b72d-dbafa37a446c admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.043315 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f439a0-4e18-4ad2-b72d-dbafa37a446c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.045349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f439a0-4e18-4ad2-b72d-dbafa37a446c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.046565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 779/1582] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:31.046565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfdb58-8cb1-479a-a1e3-853754713ee5 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.061768 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfdb58-8cb1-479a-a1e3-853754713ee5 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.067321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5de861-0fb0-4d36-a08a-600de3a1b5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.068133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5de861-0fb0-4d36-a08a-600de3a1b5bf admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.068494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5de861-0fb0-4d36-a08a-600de3a1b5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.068842 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5de861-0fb0-4d36-a08a-600de3a1b5bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.069853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5de861-0fb0-4d36-a08a-600de3a1b5bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.071544 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5de861-0fb0-4d36-a08a-600de3a1b5bf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.087393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 780/1583] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:31.087393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5de861-0fb0-4d36-a08a-600de3a1b5bf admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.094033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 804/1584] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:06:31 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:31.094033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f439a0-4e18-4ad2-b72d-dbafa37a446c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.110513 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5de861-0fb0-4d36-a08a-600de3a1b5bf admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.133068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:31.185235 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f439a0-4e18-4ad2-b72d-dbafa37a446c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.188416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf193a1-86ad-4401-aab0-341f60004ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.189098 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf193a1-86ad-4401-aab0-341f60004ebf admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.189385 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf193a1-86ad-4401-aab0-341f60004ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.189663 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf193a1-86ad-4401-aab0-341f60004ebf admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.190357 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf193a1-86ad-4401-aab0-341f60004ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.191801 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512aa47-dc35-4082-a9c7-ec791597a24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.192428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf193a1-86ad-4401-aab0-341f60004ebf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.193265 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512aa47-dc35-4082-a9c7-ec791597a24b admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.193688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512aa47-dc35-4082-a9c7-ec791597a24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.193973 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512aa47-dc35-4082-a9c7-ec791597a24b admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.195287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512aa47-dc35-4082-a9c7-ec791597a24b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.197552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512aa47-dc35-4082-a9c7-ec791597a24b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.214167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 781/1585] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:06:31 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:31.217987 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf193a1-86ad-4401-aab0-341f60004ebf admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.222667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 805/1586] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:06:31 2022] POST /identity/v3/users => generated 303 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:31.222667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512aa47-dc35-4082-a9c7-ec791597a24b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.229712 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf193a1-86ad-4401-aab0-341f60004ebf admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.231809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512aa47-dc35-4082-a9c7-ec791597a24b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.234555 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d0f18-00d1-493f-9e97-e198c48a16fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.235603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d0f18-00d1-493f-9e97-e198c48a16fb admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.235933 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d0f18-00d1-493f-9e97-e198c48a16fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.236214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d0f18-00d1-493f-9e97-e198c48a16fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.236902 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71267e40-01bc-4485-b141-e3679118fb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.237041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d0f18-00d1-493f-9e97-e198c48a16fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.237837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71267e40-01bc-4485-b141-e3679118fb67 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.238292 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71267e40-01bc-4485-b141-e3679118fb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.239151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d0f18-00d1-493f-9e97-e198c48a16fb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.239423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71267e40-01bc-4485-b141-e3679118fb67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.240418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71267e40-01bc-4485-b141-e3679118fb67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.242444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71267e40-01bc-4485-b141-e3679118fb67 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.252174 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 782/1587] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:31.253021 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d0f18-00d1-493f-9e97-e198c48a16fb admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.253172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 806/1588] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:31.254138 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71267e40-01bc-4485-b141-e3679118fb67 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.266548 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d0f18-00d1-493f-9e97-e198c48a16fb admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.266895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71267e40-01bc-4485-b141-e3679118fb67 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.271910 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920f7c9-eebc-4d08-abcb-e4e86d4c8768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.272179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fdba7-154c-4786-a6c8-061894f8b67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.272630 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920f7c9-eebc-4d08-abcb-e4e86d4c8768 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.272752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fdba7-154c-4786-a6c8-061894f8b67b admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.272937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920f7c9-eebc-4d08-abcb-e4e86d4c8768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.273039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fdba7-154c-4786-a6c8-061894f8b67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.273202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920f7c9-eebc-4d08-abcb-e4e86d4c8768 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.273300 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fdba7-154c-4786-a6c8-061894f8b67b admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.273920 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920f7c9-eebc-4d08-abcb-e4e86d4c8768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.274040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fdba7-154c-4786-a6c8-061894f8b67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.275523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920f7c9-eebc-4d08-abcb-e4e86d4c8768 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.275644 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fdba7-154c-4786-a6c8-061894f8b67b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.286343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 783/1589] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:31.287206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fdba7-154c-4786-a6c8-061894f8b67b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.290985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 807/1590] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:31.294932 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920f7c9-eebc-4d08-abcb-e4e86d4c8768 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.295976 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:31.299418 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fdba7-154c-4786-a6c8-061894f8b67b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.307032 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183b077-b526-4467-b687-f59c90a8476d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.307713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183b077-b526-4467-b687-f59c90a8476d admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.308046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183b077-b526-4467-b687-f59c90a8476d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.308198 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920f7c9-eebc-4d08-abcb-e4e86d4c8768 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.308380 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183b077-b526-4467-b687-f59c90a8476d admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.309025 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183b077-b526-4467-b687-f59c90a8476d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.310953 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183b077-b526-4467-b687-f59c90a8476d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.313175 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fc80e-601b-4b78-affa-2a0ece654c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.313841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fc80e-601b-4b78-affa-2a0ece654c0c admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.314127 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fc80e-601b-4b78-affa-2a0ece654c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.314406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fc80e-601b-4b78-affa-2a0ece654c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.315136 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fc80e-601b-4b78-affa-2a0ece654c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.317459 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fc80e-601b-4b78-affa-2a0ece654c0c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.334449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 808/1591] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:31.334449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fc80e-601b-4b78-affa-2a0ece654c0c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.339869 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 784/1592] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:06:31 2022] POST /identity/v3/users => generated 292 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:31.339869 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183b077-b526-4467-b687-f59c90a8476d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.345710 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fc80e-601b-4b78-affa-2a0ece654c0c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.351943 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183b077-b526-4467-b687-f59c90a8476d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.352592 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcb63d-3f41-469e-9aaa-ad2adb14960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.353385 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcb63d-3f41-469e-9aaa-ad2adb14960a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.353866 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcb63d-3f41-469e-9aaa-ad2adb14960a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.354253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcb63d-3f41-469e-9aaa-ad2adb14960a admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.355050 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcb63d-3f41-469e-9aaa-ad2adb14960a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.356527 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3472a-dc98-45b5-87b0-8bea138cc831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.356988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcb63d-3f41-469e-9aaa-ad2adb14960a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.357422 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3472a-dc98-45b5-87b0-8bea138cc831 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.357710 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3472a-dc98-45b5-87b0-8bea138cc831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.357994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3472a-dc98-45b5-87b0-8bea138cc831 admin admin] PATH_INFO: `/v3/projects/185231fbe57e438a9ee70b39991235b2/users/9c9292fdef7f41af8fcb9375ce1764e2/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.378028 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 809/1593] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:31.378028 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcb63d-3f41-469e-9aaa-ad2adb14960a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.381409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3472a-dc98-45b5-87b0-8bea138cc831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=185231fbe57e438a9ee70b39991235b2, user_id=9c9292fdef7f41af8fcb9375ce1764e2, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.384159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3472a-dc98-45b5-87b0-8bea138cc831 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.388220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcb63d-3f41-469e-9aaa-ad2adb14960a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.393211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e78ea-9188-435b-a4e6-0839bb0a654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.393933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e78ea-9188-435b-a4e6-0839bb0a654a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.394221 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e78ea-9188-435b-a4e6-0839bb0a654a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.394622 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e78ea-9188-435b-a4e6-0839bb0a654a admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.395613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e78ea-9188-435b-a4e6-0839bb0a654a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.397124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e78ea-9188-435b-a4e6-0839bb0a654a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.399675 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 785/1594] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:31 2022] PUT /identity/v3/projects/185231fbe57e438a9ee70b39991235b2/users/9c9292fdef7f41af8fcb9375ce1764e2/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:31.400713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3472a-dc98-45b5-87b0-8bea138cc831 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.416017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 810/1595] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:31.417891 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e78ea-9188-435b-a4e6-0839bb0a654a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.435707 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e78ea-9188-435b-a4e6-0839bb0a654a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.505242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3472a-dc98-45b5-87b0-8bea138cc831 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.512100 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52336ca-ecd7-443d-a0cc-503f877b0cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.514104 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52336ca-ecd7-443d-a0cc-503f877b0cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.514570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52336ca-ecd7-443d-a0cc-503f877b0cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.515158 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52336ca-ecd7-443d-a0cc-503f877b0cc6 admin admin] PATH_INFO: `/v3/projects/63d6c4272b654ba18d854527b14b1a88/users/5ee1e385f10e4ed4849ef2febc22e497/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.524597 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab7320-0058-4a11-a9ce-7e83ac1fe0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.526008 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab7320-0058-4a11-a9ce-7e83ac1fe0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.526391 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab7320-0058-4a11-a9ce-7e83ac1fe0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.526954 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab7320-0058-4a11-a9ce-7e83ac1fe0fe admin admin] PATH_INFO: `/v3/projects/2288722145134e6b9b93fb4075f0a291/users/ec4a4f7736964e5ca31d0ac8f63ffd19/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.536579 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52336ca-ecd7-443d-a0cc-503f877b0cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d6c4272b654ba18d854527b14b1a88, user_id=5ee1e385f10e4ed4849ef2febc22e497, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.540893 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52336ca-ecd7-443d-a0cc-503f877b0cc6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.544812 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab7320-0058-4a11-a9ce-7e83ac1fe0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2288722145134e6b9b93fb4075f0a291, user_id=ec4a4f7736964e5ca31d0ac8f63ffd19, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.548253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab7320-0058-4a11-a9ce-7e83ac1fe0fe admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.565854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 786/1596] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:31 2022] PUT /identity/v3/projects/63d6c4272b654ba18d854527b14b1a88/users/5ee1e385f10e4ed4849ef2febc22e497/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:31.565854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52336ca-ecd7-443d-a0cc-503f877b0cc6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.574632 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 811/1597] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:31 2022] PUT /identity/v3/projects/2288722145134e6b9b93fb4075f0a291/users/ec4a4f7736964e5ca31d0ac8f63ffd19/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:31.574632 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab7320-0058-4a11-a9ce-7e83ac1fe0fe admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.638455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:31.653946 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52336ca-ecd7-443d-a0cc-503f877b0cc6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.661719 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aec675-4d88-426e-86bc-a136157b5575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.662711 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aec675-4d88-426e-86bc-a136157b5575 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.665216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab7320-0058-4a11-a9ce-7e83ac1fe0fe admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.665925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aec675-4d88-426e-86bc-a136157b5575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.666230 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aec675-4d88-426e-86bc-a136157b5575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.667001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aec675-4d88-426e-86bc-a136157b5575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.670098 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aec675-4d88-426e-86bc-a136157b5575 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.676855 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e624f-6a65-4d2b-b271-f9975bcd71fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.677685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e624f-6a65-4d2b-b271-f9975bcd71fe admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.677977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e624f-6a65-4d2b-b271-f9975bcd71fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.678266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e624f-6a65-4d2b-b271-f9975bcd71fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.679016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e624f-6a65-4d2b-b271-f9975bcd71fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.683748 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e624f-6a65-4d2b-b271-f9975bcd71fe admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.687744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 787/1598] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:31.688538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aec675-4d88-426e-86bc-a136157b5575 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.700329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aec675-4d88-426e-86bc-a136157b5575 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.701914 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 812/1599] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:31.703433 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da929633-3292-4aab-9ad0-a763ecf7d0b2 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.703937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da929633-3292-4aab-9ad0-a763ecf7d0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.704541 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da929633-3292-4aab-9ad0-a763ecf7d0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.714934 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4376e-230d-4b75-a385-4a2cf6e2f5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.715628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4376e-230d-4b75-a385-4a2cf6e2f5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.715947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4376e-230d-4b75-a385-4a2cf6e2f5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.716230 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4376e-230d-4b75-a385-4a2cf6e2f5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.716981 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4376e-230d-4b75-a385-4a2cf6e2f5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.718598 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4376e-230d-4b75-a385-4a2cf6e2f5d3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.725437 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-da929633-3292-4aab-9ad0-a763ecf7d0b2 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:31.726711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-da929633-3292-4aab-9ad0-a763ecf7d0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:31.733883 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 788/1600] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:31.734758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4376e-230d-4b75-a385-4a2cf6e2f5d3 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.736396 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 813/1601] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:31.743296 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ada9f-e0f8-463a-b8cb-297498383e59 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.743599 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ada9f-e0f8-463a-b8cb-297498383e59 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.745451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ada9f-e0f8-463a-b8cb-297498383e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.746040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4376e-230d-4b75-a385-4a2cf6e2f5d3 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.751007 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9b66c-e128-4b4a-84a2-89bd717dfa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.752009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9b66c-e128-4b4a-84a2-89bd717dfa71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.752365 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9b66c-e128-4b4a-84a2-89bd717dfa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.752717 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9b66c-e128-4b4a-84a2-89bd717dfa71 admin admin] PATH_INFO: `/v3/projects/067216e811b44e6d8d11874090c70b5a/users/4d9f4ab27d4745639b532b61c440d819/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.772804 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9b66c-e128-4b4a-84a2-89bd717dfa71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=067216e811b44e6d8d11874090c70b5a, user_id=4d9f4ab27d4745639b532b61c440d819, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.776320 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9b66c-e128-4b4a-84a2-89bd717dfa71 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.781533 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2d7ada9f-e0f8-463a-b8cb-297498383e59 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:31.783659 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2d7ada9f-e0f8-463a-b8cb-297498383e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:31.793942 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 814/1602] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:31.797370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a350f0-fe6b-436e-9091-9baa45970457 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.797370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a350f0-fe6b-436e-9091-9baa45970457 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.797370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a350f0-fe6b-436e-9091-9baa45970457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.797621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 789/1603] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:31 2022] PUT /identity/v3/projects/067216e811b44e6d8d11874090c70b5a/users/4d9f4ab27d4745639b532b61c440d819/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:31.800794 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9b66c-e128-4b4a-84a2-89bd717dfa71 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.822096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:31.824768 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a3a350f0-fe6b-436e-9091-9baa45970457 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:31.826294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a3a350f0-fe6b-436e-9091-9baa45970457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:31.897478 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9b66c-e128-4b4a-84a2-89bd717dfa71 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.906561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 815/1604] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:31.906561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a350f0-fe6b-436e-9091-9baa45970457 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.918221 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a350f0-fe6b-436e-9091-9baa45970457 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.920772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec04e47-10b7-4e46-98f0-2aecb800a015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.922585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec04e47-10b7-4e46-98f0-2aecb800a015 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.923214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec04e47-10b7-4e46-98f0-2aecb800a015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.923515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec04e47-10b7-4e46-98f0-2aecb800a015 admin admin] PATH_INFO: `/v3/projects/17d57d33452046db87681a6af1148849/users/bd69530dd4a64d04a17041b55ff69ba0/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.923636 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc0ca0-7488-41b2-a67e-159fc08aded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.924223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc0ca0-7488-41b2-a67e-159fc08aded3 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.924511 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc0ca0-7488-41b2-a67e-159fc08aded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.924793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc0ca0-7488-41b2-a67e-159fc08aded3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.925586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc0ca0-7488-41b2-a67e-159fc08aded3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.927332 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc0ca0-7488-41b2-a67e-159fc08aded3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.938631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 816/1605] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:31.939473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc0ca0-7488-41b2-a67e-159fc08aded3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:31.950667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec04e47-10b7-4e46-98f0-2aecb800a015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17d57d33452046db87681a6af1148849, user_id=bd69530dd4a64d04a17041b55ff69ba0, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.953601 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc0ca0-7488-41b2-a67e-159fc08aded3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:31.954630 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec04e47-10b7-4e46-98f0-2aecb800a015 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.960894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bab27-ff94-4365-b58b-3394e46495df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:31.962171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bab27-ff94-4365-b58b-3394e46495df admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:31.962431 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bab27-ff94-4365-b58b-3394e46495df admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:31.962947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bab27-ff94-4365-b58b-3394e46495df admin admin] PATH_INFO: `/v3/projects/3f84a8550b5a43c5b8083ed6426cf977/users/693d8a7a23304a4b8f5107c0c3302536/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:31.990220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bab27-ff94-4365-b58b-3394e46495df admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f84a8550b5a43c5b8083ed6426cf977, user_id=693d8a7a23304a4b8f5107c0c3302536, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:31.990220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bab27-ff94-4365-b58b-3394e46495df admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:31.991458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 790/1606] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:31 2022] PUT /identity/v3/projects/17d57d33452046db87681a6af1148849/users/bd69530dd4a64d04a17041b55ff69ba0/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:31.992832 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec04e47-10b7-4e46-98f0-2aecb800a015 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:32.003174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 817/1607] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:31 2022] PUT /identity/v3/projects/3f84a8550b5a43c5b8083ed6426cf977/users/693d8a7a23304a4b8f5107c0c3302536/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:32.015669 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bab27-ff94-4365-b58b-3394e46495df admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:32.071957 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec04e47-10b7-4e46-98f0-2aecb800a015 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:32.083953 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bab27-ff94-4365-b58b-3394e46495df admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:32.088545 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583c1e2-a572-407b-9c7d-8ea533323c18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:32.089422 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583c1e2-a572-407b-9c7d-8ea533323c18 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:32.090307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583c1e2-a572-407b-9c7d-8ea533323c18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:32.090669 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583c1e2-a572-407b-9c7d-8ea533323c18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:32.151244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab0b07-155b-4f01-8268-00a3e550aa2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:32.151954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab0b07-155b-4f01-8268-00a3e550aa2e service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:32.152248 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab0b07-155b-4f01-8268-00a3e550aa2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:32.152534 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab0b07-155b-4f01-8268-00a3e550aa2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:32.154799 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:32.180028 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583c1e2-a572-407b-9c7d-8ea533323c18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:32.181978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583c1e2-a572-407b-9c7d-8ea533323c18 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:32.199142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 818/1608] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:32.200864 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e6161-028e-44bb-81e1-c7b4713e5e8d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:32.201393 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e6161-028e-44bb-81e1-c7b4713e5e8d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:32.201905 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e6161-028e-44bb-81e1-c7b4713e5e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:32.239472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-971e6161-028e-44bb-81e1-c7b4713e5e8d None None] MFA Rules not processed for user `4d9f4ab27d4745639b532b61c440d819`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:32.242311 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-971e6161-028e-44bb-81e1-c7b4713e5e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:32.266860 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:32.272995 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab0b07-155b-4f01-8268-00a3e550aa2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:32.274490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab0b07-155b-4f01-8268-00a3e550aa2e service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:32.300852 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 791/1609] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:32.302456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab0b07-155b-4f01-8268-00a3e550aa2e service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:32.329486 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab0b07-155b-4f01-8268-00a3e550aa2e service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:32.338251 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671cb6c-d651-489d-9a8a-fae4f010003b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:32.339096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671cb6c-d651-489d-9a8a-fae4f010003b service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:32.339550 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671cb6c-d651-489d-9a8a-fae4f010003b service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:32.339963 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671cb6c-d651-489d-9a8a-fae4f010003b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:32.353008 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 819/1610] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:32.354189 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e6161-028e-44bb-81e1-c7b4713e5e8d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:32.384503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e6161-028e-44bb-81e1-c7b4713e5e8d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:32.386451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671cb6c-d651-489d-9a8a-fae4f010003b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:32.388070 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671cb6c-d651-489d-9a8a-fae4f010003b service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:32.391195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e5ec6-ef48-45ad-a9aa-31e0008d2a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:32.392829 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e5ec6-ef48-45ad-a9aa-31e0008d2a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:32.393336 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e5ec6-ef48-45ad-a9aa-31e0008d2a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:32.393896 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e5ec6-ef48-45ad-a9aa-31e0008d2a19 admin admin] PATH_INFO: `/v3/projects/c7e4c2961f55482491f6194da650b479/users/73143527412b430bb7cfbcd8399ed646/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:32.408921 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 792/1611] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:32.412165 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974e0bf-d597-4b24-af58-958cf98cf4ea None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:32.412575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974e0bf-d597-4b24-af58-958cf98cf4ea None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:32.412859 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974e0bf-d597-4b24-af58-958cf98cf4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:32.418072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e5ec6-ef48-45ad-a9aa-31e0008d2a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e4c2961f55482491f6194da650b479, user_id=73143527412b430bb7cfbcd8399ed646, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:32.422923 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e5ec6-ef48-45ad-a9aa-31e0008d2a19 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:32.443433 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 820/1612] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:32 2022] PUT /identity/v3/projects/c7e4c2961f55482491f6194da650b479/users/73143527412b430bb7cfbcd8399ed646/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:32.444913 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e91012-bb20-492d-b83a-f02957b6f65d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:32.447524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e91012-bb20-492d-b83a-f02957b6f65d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:32.447524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e91012-bb20-492d-b83a-f02957b6f65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:32.478642 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a974e0bf-d597-4b24-af58-958cf98cf4ea None None] MFA Rules not processed for user `bd69530dd4a64d04a17041b55ff69ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:32.480697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a974e0bf-d597-4b24-af58-958cf98cf4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:32.501249 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-60e91012-bb20-492d-b83a-f02957b6f65d None None] MFA Rules not processed for user `693d8a7a23304a4b8f5107c0c3302536`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:32.505673 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-60e91012-bb20-492d-b83a-f02957b6f65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:32.595601 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 793/1613] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:32.595601 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974e0bf-d597-4b24-af58-958cf98cf4ea None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:32.623714 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 821/1614] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:32.627049 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecee3c-3111-4a03-9b0f-4821550af6d6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:32.627586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecee3c-3111-4a03-9b0f-4821550af6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:32.628122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecee3c-3111-4a03-9b0f-4821550af6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:32.671354 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974e0bf-d597-4b24-af58-958cf98cf4ea None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:32.676870 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc6b9a-0edd-4b44-a12d-f1510e7b86f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:32.677655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc6b9a-0edd-4b44-a12d-f1510e7b86f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:32.678157 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc6b9a-0edd-4b44-a12d-f1510e7b86f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:32.678716 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc6b9a-0edd-4b44-a12d-f1510e7b86f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:32.721456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-81ecee3c-3111-4a03-9b0f-4821550af6d6 None None] MFA Rules not processed for user `73143527412b430bb7cfbcd8399ed646`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:32.726434 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-81ecee3c-3111-4a03-9b0f-4821550af6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:32.793116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc6b9a-0edd-4b44-a12d-f1510e7b86f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:32.794596 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc6b9a-0edd-4b44-a12d-f1510e7b86f4 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:32.807464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 794/1615] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:32.808461 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc6b9a-0edd-4b44-a12d-f1510e7b86f4 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:32.839687 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:32.889575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:32.940251 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 822/1616] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:32.945402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a74f3-72b0-4945-bd31-3d229a4a238f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:32.945402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a74f3-72b0-4945-bd31-3d229a4a238f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:32.945402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a74f3-72b0-4945-bd31-3d229a4a238f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:32.949383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 823/1617] 10.222.0.41 () {54 vars in 961 bytes} [Mon May 30 12:06:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:32.950668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d870469-2323-403d-8d8c-ad19cbb04469 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:32.950964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d870469-2323-403d-8d8c-ad19cbb04469 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:32.951249 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d870469-2323-403d-8d8c-ad19cbb04469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:32.987035 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3d870469-2323-403d-8d8c-ad19cbb04469 None None] MFA Rules not processed for user `bb3820a613744c15b840681fe6b6e808`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:32.988295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3d870469-2323-403d-8d8c-ad19cbb04469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:33.000092 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc6b9a-0edd-4b44-a12d-f1510e7b86f4 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:33.016380 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1271ad-12db-42c5-b98c-dc1815a401e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:33.017077 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1271ad-12db-42c5-b98c-dc1815a401e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:33.020525 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1271ad-12db-42c5-b98c-dc1815a401e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:33.020941 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1271ad-12db-42c5-b98c-dc1815a401e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:33.022805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1271ad-12db-42c5-b98c-dc1815a401e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:33.030848 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1271ad-12db-42c5-b98c-dc1815a401e0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:33.082316 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 795/1618] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:06:32 2022] POST /identity/v3/projects => generated 405 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:33.082316 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31574bec-1907-4bee-a8c3-0c62aed672aa None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:33.082316 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31574bec-1907-4bee-a8c3-0c62aed672aa None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:33.082316 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31574bec-1907-4bee-a8c3-0c62aed672aa None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:33.085367 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 796/1619] 10.222.0.41 () {54 vars in 961 bytes} [Mon May 30 12:06:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:33.092136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31574bec-1907-4bee-a8c3-0c62aed672aa None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:33.125855 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 824/1620] 10.222.0.41 () {58 vars in 1058 bytes} [Mon May 30 12:06:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:33.127208 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6757a7-0902-4cfb-a87f-d407b50d9c22 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:33.127503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6757a7-0902-4cfb-a87f-d407b50d9c22 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:33.127784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6757a7-0902-4cfb-a87f-d407b50d9c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:33.179550 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3d6757a7-0902-4cfb-a87f-d407b50d9c22 None None] MFA Rules not processed for user `bb3820a613744c15b840681fe6b6e808`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:33.180963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3d6757a7-0902-4cfb-a87f-d407b50d9c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:33.202909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31574bec-1907-4bee-a8c3-0c62aed672aa None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:33.214934 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59fb71-adf0-4e25-bd09-759fdbe1503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:33.215651 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59fb71-adf0-4e25-bd09-759fdbe1503a admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:33.217777 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59fb71-adf0-4e25-bd09-759fdbe1503a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:33.218085 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59fb71-adf0-4e25-bd09-759fdbe1503a admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:33.218905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59fb71-adf0-4e25-bd09-759fdbe1503a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:33.222116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59fb71-adf0-4e25-bd09-759fdbe1503a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:33.267245 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 797/1621] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:06:33 2022] POST /identity/v3/users => generated 309 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:33.268163 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59fb71-adf0-4e25-bd09-759fdbe1503a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:33.385701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 825/1622] 10.222.0.41 () {58 vars in 1058 bytes} [Mon May 30 12:06:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:33.386518 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6757a7-0902-4cfb-a87f-d407b50d9c22 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:33.412392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6757a7-0902-4cfb-a87f-d407b50d9c22 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:33.431111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb049e0-bbb1-422a-a30b-66bb3eeffe26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:33.438118 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb049e0-bbb1-422a-a30b-66bb3eeffe26 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:33.438118 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb049e0-bbb1-422a-a30b-66bb3eeffe26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:33.438441 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb049e0-bbb1-422a-a30b-66bb3eeffe26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:33.439332 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb049e0-bbb1-422a-a30b-66bb3eeffe26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:33.442997 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb049e0-bbb1-422a-a30b-66bb3eeffe26 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:33.446841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59fb71-adf0-4e25-bd09-759fdbe1503a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:33.456922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 826/1623] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:33.458517 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb049e0-bbb1-422a-a30b-66bb3eeffe26 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:33.466782 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127780b-9da5-4f2d-ac93-58400cffcc0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:33.467713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127780b-9da5-4f2d-ac93-58400cffcc0b service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:33.468197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127780b-9da5-4f2d-ac93-58400cffcc0b service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:33.468727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127780b-9da5-4f2d-ac93-58400cffcc0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:33.486924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb049e0-bbb1-422a-a30b-66bb3eeffe26 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:33.495116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776b4aa-3547-4c3c-9833-5dca15cc0e06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:33.496212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776b4aa-3547-4c3c-9833-5dca15cc0e06 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:33.496574 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776b4aa-3547-4c3c-9833-5dca15cc0e06 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:33.497050 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776b4aa-3547-4c3c-9833-5dca15cc0e06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:33.544934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:33.572558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:33.587252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776b4aa-3547-4c3c-9833-5dca15cc0e06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:33.590723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776b4aa-3547-4c3c-9833-5dca15cc0e06 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:33.602788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 827/1624] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:33.615289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127780b-9da5-4f2d-ac93-58400cffcc0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:33.616947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127780b-9da5-4f2d-ac93-58400cffcc0b service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:33.617064 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776b4aa-3547-4c3c-9833-5dca15cc0e06 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:33.637169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776b4aa-3547-4c3c-9833-5dca15cc0e06 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:33.641042 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 798/1625] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:33.655230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152824f9-09c2-4e97-bd47-a1dd0ca8149e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:33.655230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152824f9-09c2-4e97-bd47-a1dd0ca8149e admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:33.655230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152824f9-09c2-4e97-bd47-a1dd0ca8149e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:33.655230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152824f9-09c2-4e97-bd47-a1dd0ca8149e admin admin] PATH_INFO: `/v3/projects/49e9a444dd3d4ea5817a380ccf150f4f/users/4b2e9119c2a249fa9dd1f4cdfc234a6c/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:33.689747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152824f9-09c2-4e97-bd47-a1dd0ca8149e admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e9a444dd3d4ea5817a380ccf150f4f, user_id=4b2e9119c2a249fa9dd1f4cdfc234a6c, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:33.693281 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152824f9-09c2-4e97-bd47-a1dd0ca8149e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:33.724533 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 828/1626] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:33 2022] PUT /identity/v3/projects/49e9a444dd3d4ea5817a380ccf150f4f/users/4b2e9119c2a249fa9dd1f4cdfc234a6c/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:33.725551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127780b-9da5-4f2d-ac93-58400cffcc0b service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:33.747955 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127780b-9da5-4f2d-ac93-58400cffcc0b service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:33.945686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80646ed8-8d0c-4a22-84aa-20af5bfff6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:33.946383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80646ed8-8d0c-4a22-84aa-20af5bfff6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:33.946664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80646ed8-8d0c-4a22-84aa-20af5bfff6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:33.946944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80646ed8-8d0c-4a22-84aa-20af5bfff6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:33.947681 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80646ed8-8d0c-4a22-84aa-20af5bfff6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:33.962235 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80646ed8-8d0c-4a22-84aa-20af5bfff6f8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:34.002004 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 799/1627] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:06:34.003554 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152824f9-09c2-4e97-bd47-a1dd0ca8149e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:34.022655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152824f9-09c2-4e97-bd47-a1dd0ca8149e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:34.029991 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c98b8d-41b9-427e-9b33-d88b5fdd9b48 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:34.030321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c98b8d-41b9-427e-9b33-d88b5fdd9b48 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:34.030592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c98b8d-41b9-427e-9b33-d88b5fdd9b48 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:34.032129 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5332b-f3c9-4262-a411-df9884e16854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:34.032287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 800/1628] 10.222.0.41 () {54 vars in 912 bytes} [Mon May 30 12:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 12:06:34.033871 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5332b-f3c9-4262-a411-df9884e16854 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:34.034411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5332b-f3c9-4262-a411-df9884e16854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:34.034942 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5332b-f3c9-4262-a411-df9884e16854 admin admin] PATH_INFO: `/v3/projects/49e9a444dd3d4ea5817a380ccf150f4f/users/4b2e9119c2a249fa9dd1f4cdfc234a6c/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:34.037855 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5332b-f3c9-4262-a411-df9884e16854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e9a444dd3d4ea5817a380ccf150f4f, user_id=4b2e9119c2a249fa9dd1f4cdfc234a6c, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:34.039347 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b465f0-68dc-4a93-9e6c-5f3e4b01de08 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:34.039639 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b465f0-68dc-4a93-9e6c-5f3e4b01de08 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:34.039949 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b465f0-68dc-4a93-9e6c-5f3e4b01de08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:34.042405 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5332b-f3c9-4262-a411-df9884e16854 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:34.055431 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 829/1629] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:34 2022] PUT /identity/v3/projects/49e9a444dd3d4ea5817a380ccf150f4f/users/4b2e9119c2a249fa9dd1f4cdfc234a6c/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:34.064496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a7b465f0-68dc-4a93-9e6c-5f3e4b01de08 None None] MFA Rules not processed for user `bb3820a613744c15b840681fe6b6e808`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:34.064496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a7b465f0-68dc-4a93-9e6c-5f3e4b01de08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:34.068667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816022bb-3944-4afb-aa19-3d379f6bdf10 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:34.069268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816022bb-3944-4afb-aa19-3d379f6bdf10 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:34.069760 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816022bb-3944-4afb-aa19-3d379f6bdf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:34.102756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-816022bb-3944-4afb-aa19-3d379f6bdf10 None None] MFA Rules not processed for user `4b2e9119c2a249fa9dd1f4cdfc234a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:34.104336 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-816022bb-3944-4afb-aa19-3d379f6bdf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:34.144080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 801/1630] 10.222.0.41 () {58 vars in 1009 bytes} [Mon May 30 12:06:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:06:34.153513 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b465f0-68dc-4a93-9e6c-5f3e4b01de08 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:34.218217 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b465f0-68dc-4a93-9e6c-5f3e4b01de08 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:34.223121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefec5f5-64b3-477d-bb0d-ddb443d56c29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:34.223853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefec5f5-64b3-477d-bb0d-ddb443d56c29 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:34.224155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefec5f5-64b3-477d-bb0d-ddb443d56c29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:34.224421 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefec5f5-64b3-477d-bb0d-ddb443d56c29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:34.237041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefec5f5-64b3-477d-bb0d-ddb443d56c29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:34.241943 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefec5f5-64b3-477d-bb0d-ddb443d56c29 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:34.255961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 802/1631] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:34.259399 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 830/1632] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:34 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:34.269694 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefec5f5-64b3-477d-bb0d-ddb443d56c29 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:34.282502 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefec5f5-64b3-477d-bb0d-ddb443d56c29 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:34.297109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae93acf-898d-4287-b8ca-01eedaa5b79e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:34.297109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae93acf-898d-4287-b8ca-01eedaa5b79e service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:34.297109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae93acf-898d-4287-b8ca-01eedaa5b79e service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:34.297109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae93acf-898d-4287-b8ca-01eedaa5b79e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:34.314500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:34.320335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae93acf-898d-4287-b8ca-01eedaa5b79e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:34.329276 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae93acf-898d-4287-b8ca-01eedaa5b79e service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:34.361406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 803/1633] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:34 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:34.525321 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce7cf9-9312-4248-a7a7-1eda341921b9 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:34.526063 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce7cf9-9312-4248-a7a7-1eda341921b9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:34.526606 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce7cf9-9312-4248-a7a7-1eda341921b9 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:34.528894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 831/1634] 10.222.0.41 () {54 vars in 912 bytes} [Mon May 30 12:06:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:34.538319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b9171-ad37-469c-bcef-6d64a0b4a226 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:34.538609 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b9171-ad37-469c-bcef-6d64a0b4a226 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:34.539186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b9171-ad37-469c-bcef-6d64a0b4a226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:34.582552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-149b9171-ad37-469c-bcef-6d64a0b4a226 None None] MFA Rules not processed for user `bb3820a613744c15b840681fe6b6e808`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:34.583798 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-149b9171-ad37-469c-bcef-6d64a0b4a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:34.625512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 804/1635] 10.222.0.41 () {58 vars in 1009 bytes} [Mon May 30 12:06:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:06:34.671545 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce7cf9-9312-4248-a7a7-1eda341921b9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:34.689755 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b9171-ad37-469c-bcef-6d64a0b4a226 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:34.704505 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b9171-ad37-469c-bcef-6d64a0b4a226 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:34.712784 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6c160-c619-4123-8e9e-316ecfb81b0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:34.714838 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6c160-c619-4123-8e9e-316ecfb81b0e service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:34.715126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6c160-c619-4123-8e9e-316ecfb81b0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:34.715539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6c160-c619-4123-8e9e-316ecfb81b0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:34.729075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6c160-c619-4123-8e9e-316ecfb81b0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:34.745150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6c160-c619-4123-8e9e-316ecfb81b0e service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:34.789082 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 805/1636] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:06:34.846227 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce7cf9-9312-4248-a7a7-1eda341921b9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:34.861474 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca367a-9509-4008-a878-50f5b7491ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:34.866368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca367a-9509-4008-a878-50f5b7491ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:34.866700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca367a-9509-4008-a878-50f5b7491ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:34.867004 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca367a-9509-4008-a878-50f5b7491ebd admin admin] PATH_INFO: `/v3/users/693d8a7a23304a4b8f5107c0c3302536` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:34.873076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca367a-9509-4008-a878-50f5b7491ebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=693d8a7a23304a4b8f5107c0c3302536)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:34.876159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-a6ca367a-9509-4008-a878-50f5b7491ebd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:06:34.876159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: warnings.warn(msg) May 30 12:06:34.876159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: May 30 12:06:34.880411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca367a-9509-4008-a878-50f5b7491ebd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:34.995189 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:35.055508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a6ca367a-9509-4008-a878-50f5b7491ebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693d8a7a23304a4b8f5107c0c3302536'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:35.086767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a6ca367a-9509-4008-a878-50f5b7491ebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693d8a7a23304a4b8f5107c0c3302536'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:35.114501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a6ca367a-9509-4008-a878-50f5b7491ebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693d8a7a23304a4b8f5107c0c3302536'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:35.115630 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a6ca367a-9509-4008-a878-50f5b7491ebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693d8a7a23304a4b8f5107c0c3302536'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:35.147168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a6ca367a-9509-4008-a878-50f5b7491ebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693d8a7a23304a4b8f5107c0c3302536'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:35.172111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 832/1637] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:06:34 2022] DELETE /identity/v3/users/693d8a7a23304a4b8f5107c0c3302536 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:35.174152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f2367-54d2-4790-a56c-b7872b765655 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:35.174495 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f2367-54d2-4790-a56c-b7872b765655 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:35.174790 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f2367-54d2-4790-a56c-b7872b765655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:35.245426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca367a-9509-4008-a878-50f5b7491ebd admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:35.246877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a6ca367a-9509-4008-a878-50f5b7491ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:35.261494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a37f2367-54d2-4790-a56c-b7872b765655 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:35.266448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a37f2367-54d2-4790-a56c-b7872b765655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:35.483308 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 806/1638] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:06:35.508281 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca367a-9509-4008-a878-50f5b7491ebd admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:35.515007 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f2367-54d2-4790-a56c-b7872b765655 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:35.516481 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a37f2367-54d2-4790-a56c-b7872b765655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:35.522489 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaf97a-0c73-4cba-b17a-daa19800eea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:35.523411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaf97a-0c73-4cba-b17a-daa19800eea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:35.523702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaf97a-0c73-4cba-b17a-daa19800eea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:35.525433 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaf97a-0c73-4cba-b17a-daa19800eea1 admin admin] PATH_INFO: `/v3/users/bd69530dd4a64d04a17041b55ff69ba0` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:35.530614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaf97a-0c73-4cba-b17a-daa19800eea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd69530dd4a64d04a17041b55ff69ba0)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:35.547715 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaf97a-0c73-4cba-b17a-daa19800eea1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:35.662341 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f2367-54d2-4790-a56c-b7872b765655 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:35.673721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f0b9a-9c01-444c-ab9c-a1f037b154cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:35.675294 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f0b9a-9c01-444c-ab9c-a1f037b154cc service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:35.677693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f0b9a-9c01-444c-ab9c-a1f037b154cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:35.678200 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f0b9a-9c01-444c-ab9c-a1f037b154cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:35.694967 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2bfaf97a-0c73-4cba-b17a-daa19800eea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd69530dd4a64d04a17041b55ff69ba0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:35.702873 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f0b9a-9c01-444c-ab9c-a1f037b154cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:35.704759 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f0b9a-9c01-444c-ab9c-a1f037b154cc service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:35.725374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2bfaf97a-0c73-4cba-b17a-daa19800eea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd69530dd4a64d04a17041b55ff69ba0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:35.735839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 807/1639] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:35.760472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2bfaf97a-0c73-4cba-b17a-daa19800eea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd69530dd4a64d04a17041b55ff69ba0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:35.761881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2bfaf97a-0c73-4cba-b17a-daa19800eea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd69530dd4a64d04a17041b55ff69ba0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:35.794752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2bfaf97a-0c73-4cba-b17a-daa19800eea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd69530dd4a64d04a17041b55ff69ba0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:35.810090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 833/1640] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:06:35 2022] DELETE /identity/v3/users/bd69530dd4a64d04a17041b55ff69ba0 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:35.814556 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78288d31-2498-466e-a74e-a1af9d2ddf6f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:35.814924 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78288d31-2498-466e-a74e-a1af9d2ddf6f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:35.815432 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78288d31-2498-466e-a74e-a1af9d2ddf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:35.856886 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-78288d31-2498-466e-a74e-a1af9d2ddf6f None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:35.860533 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-78288d31-2498-466e-a74e-a1af9d2ddf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:36.049698 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 808/1641] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:36.077916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaf97a-0c73-4cba-b17a-daa19800eea1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:36.079507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2bfaf97a-0c73-4cba-b17a-daa19800eea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:36.126672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:36.177584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaf97a-0c73-4cba-b17a-daa19800eea1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:36.182192 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cc998-f016-45d7-808d-5c1121545e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:36.183463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cc998-f016-45d7-808d-5c1121545e21 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:36.184512 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cc998-f016-45d7-808d-5c1121545e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:36.184512 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cc998-f016-45d7-808d-5c1121545e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:36.197738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cc998-f016-45d7-808d-5c1121545e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:36.200096 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cc998-f016-45d7-808d-5c1121545e21 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:36.220322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 834/1642] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:36.352929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b13dd4-9d42-4dc2-bf6a-052eaa587855 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:36.353508 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b13dd4-9d42-4dc2-bf6a-052eaa587855 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:36.353941 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b13dd4-9d42-4dc2-bf6a-052eaa587855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:36.451991 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c3b13dd4-9d42-4dc2-bf6a-052eaa587855 None None] MFA Rules not processed for user `ec4a4f7736964e5ca31d0ac8f63ffd19`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:36.453449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c3b13dd4-9d42-4dc2-bf6a-052eaa587855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:36.466732 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:36.731874 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 809/1643] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:36.747992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf28c8-5720-497d-b500-a85d6de7976f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:36.747992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf28c8-5720-497d-b500-a85d6de7976f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:36.747992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf28c8-5720-497d-b500-a85d6de7976f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:36.778207 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-efbf28c8-5720-497d-b500-a85d6de7976f None None] MFA Rules not processed for user `ec4a4f7736964e5ca31d0ac8f63ffd19`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:36.781331 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-efbf28c8-5720-497d-b500-a85d6de7976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:36.808857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 835/1644] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:36.814944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b13dd4-9d42-4dc2-bf6a-052eaa587855 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:36.816999 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c3b13dd4-9d42-4dc2-bf6a-052eaa587855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:37.090368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b13dd4-9d42-4dc2-bf6a-052eaa587855 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:37.102834 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8b86b-1ed3-4845-a1f3-f0a179f05486 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:37.103519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8b86b-1ed3-4845-a1f3-f0a179f05486 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:37.103808 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8b86b-1ed3-4845-a1f3-f0a179f05486 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:37.104112 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8b86b-1ed3-4845-a1f3-f0a179f05486 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:37.139406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8b86b-1ed3-4845-a1f3-f0a179f05486 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:37.141175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8b86b-1ed3-4845-a1f3-f0a179f05486 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:37.160583 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 810/1645] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:37.579604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf28c8-5720-497d-b500-a85d6de7976f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:37.579604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-efbf28c8-5720-497d-b500-a85d6de7976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:37.602404 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf28c8-5720-497d-b500-a85d6de7976f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:37.612727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda7936-2409-4e26-81ea-a5f37c12032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:37.614509 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda7936-2409-4e26-81ea-a5f37c12032f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:37.614802 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda7936-2409-4e26-81ea-a5f37c12032f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:37.622643 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda7936-2409-4e26-81ea-a5f37c12032f admin admin] PATH_INFO: `/v3/projects/3f84a8550b5a43c5b8083ed6426cf977` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:37.624281 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda7936-2409-4e26-81ea-a5f37c12032f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f84a8550b5a43c5b8083ed6426cf977)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:37.626285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda7936-2409-4e26-81ea-a5f37c12032f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:37.741830 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9dda7936-2409-4e26-81ea-a5f37c12032f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f84a8550b5a43c5b8083ed6426cf977', 'request_id': 'req-9dda7936-2409-4e26-81ea-a5f37c12032f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:37.762745 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9dda7936-2409-4e26-81ea-a5f37c12032f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f84a8550b5a43c5b8083ed6426cf977', 'request_id': 'req-9dda7936-2409-4e26-81ea-a5f37c12032f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:37.793962 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9dda7936-2409-4e26-81ea-a5f37c12032f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f84a8550b5a43c5b8083ed6426cf977', 'request_id': 'req-9dda7936-2409-4e26-81ea-a5f37c12032f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:37.815174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9dda7936-2409-4e26-81ea-a5f37c12032f admin admin] The token cache is being invalidate because project 3f84a8550b5a43c5b8083ed6426cf977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:06:37.815483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9dda7936-2409-4e26-81ea-a5f37c12032f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:37.824921 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9dda7936-2409-4e26-81ea-a5f37c12032f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:37.827926 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 836/1646] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:06:37 2022] DELETE /identity/v3/projects/3f84a8550b5a43c5b8083ed6426cf977 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:37.834610 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8b86b-1ed3-4845-a1f3-f0a179f05486 service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:37.873004 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8b86b-1ed3-4845-a1f3-f0a179f05486 service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:38.056877 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e85df1-87b1-4f14-a338-12c4afcf4708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:38.057952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e85df1-87b1-4f14-a338-12c4afcf4708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:38.058383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e85df1-87b1-4f14-a338-12c4afcf4708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:38.058823 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e85df1-87b1-4f14-a338-12c4afcf4708 admin admin] PATH_INFO: `/v3/users/4b2e9119c2a249fa9dd1f4cdfc234a6c` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:38.063096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e85df1-87b1-4f14-a338-12c4afcf4708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b2e9119c2a249fa9dd1f4cdfc234a6c)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:38.074781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e85df1-87b1-4f14-a338-12c4afcf4708 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:38.128576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:38.147773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d2e85df1-87b1-4f14-a338-12c4afcf4708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b2e9119c2a249fa9dd1f4cdfc234a6c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:38.161244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d2e85df1-87b1-4f14-a338-12c4afcf4708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b2e9119c2a249fa9dd1f4cdfc234a6c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:38.188832 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d2e85df1-87b1-4f14-a338-12c4afcf4708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b2e9119c2a249fa9dd1f4cdfc234a6c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:38.189758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d2e85df1-87b1-4f14-a338-12c4afcf4708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b2e9119c2a249fa9dd1f4cdfc234a6c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:38.190454 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d2e85df1-87b1-4f14-a338-12c4afcf4708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b2e9119c2a249fa9dd1f4cdfc234a6c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:38.218885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 811/1647] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:06:37 2022] DELETE /identity/v3/users/4b2e9119c2a249fa9dd1f4cdfc234a6c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:38.541506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28782ff5-d2d9-4c34-8cd9-79892efdfc85 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:38.541862 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28782ff5-d2d9-4c34-8cd9-79892efdfc85 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:38.542216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28782ff5-d2d9-4c34-8cd9-79892efdfc85 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:38.544236 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 837/1648] 10.222.0.41 () {54 vars in 912 bytes} [Mon May 30 12:06:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:38.572277 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d8b46-a06b-41f1-820e-f39714d37b76 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:38.572909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d8b46-a06b-41f1-820e-f39714d37b76 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:38.573412 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d8b46-a06b-41f1-820e-f39714d37b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:38.601132 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ec0d8b46-a06b-41f1-820e-f39714d37b76 None None] MFA Rules not processed for user `ae7bc0d4fd924bfb89f874d1c6fc3d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:38.602369 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ec0d8b46-a06b-41f1-820e-f39714d37b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:38.686894 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 812/1649] 10.222.0.41 () {58 vars in 1009 bytes} [Mon May 30 12:06:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:38.942224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28782ff5-d2d9-4c34-8cd9-79892efdfc85 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:38.943869 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d8b46-a06b-41f1-820e-f39714d37b76 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:38.944541 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-28782ff5-d2d9-4c34-8cd9-79892efdfc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:38.945376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ec0d8b46-a06b-41f1-820e-f39714d37b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:38.966663 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28782ff5-d2d9-4c34-8cd9-79892efdfc85 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:38.979624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54750806-59e0-414f-aa20-5c800dd6e868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:38.980513 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54750806-59e0-414f-aa20-5c800dd6e868 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:38.980787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54750806-59e0-414f-aa20-5c800dd6e868 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:38.981066 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54750806-59e0-414f-aa20-5c800dd6e868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:38.998304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54750806-59e0-414f-aa20-5c800dd6e868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:39.002906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54750806-59e0-414f-aa20-5c800dd6e868 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:39.027120 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 838/1650] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:39.213255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d8b46-a06b-41f1-820e-f39714d37b76 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:39.226616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda95f9-6389-445a-a534-53c9b29441d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:39.230365 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda95f9-6389-445a-a534-53c9b29441d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:39.232296 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda95f9-6389-445a-a534-53c9b29441d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:39.234398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda95f9-6389-445a-a534-53c9b29441d5 admin admin] PATH_INFO: `/v3/projects/17d57d33452046db87681a6af1148849` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:39.240508 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda95f9-6389-445a-a534-53c9b29441d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17d57d33452046db87681a6af1148849)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:39.244579 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: WARNING py.warnings [None req-1cda95f9-6389-445a-a534-53c9b29441d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:06:39.244579 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: warnings.warn(msg) May 30 12:06:39.244579 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: May 30 12:06:39.249003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda95f9-6389-445a-a534-53c9b29441d5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:39.378155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1cda95f9-6389-445a-a534-53c9b29441d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17d57d33452046db87681a6af1148849', 'request_id': 'req-1cda95f9-6389-445a-a534-53c9b29441d5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:39.407199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1cda95f9-6389-445a-a534-53c9b29441d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17d57d33452046db87681a6af1148849', 'request_id': 'req-1cda95f9-6389-445a-a534-53c9b29441d5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:39.460960 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1cda95f9-6389-445a-a534-53c9b29441d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17d57d33452046db87681a6af1148849', 'request_id': 'req-1cda95f9-6389-445a-a534-53c9b29441d5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:39.467864 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:39.486505 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54750806-59e0-414f-aa20-5c800dd6e868 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:39.488621 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-54750806-59e0-414f-aa20-5c800dd6e868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:39.491171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1cda95f9-6389-445a-a534-53c9b29441d5 admin admin] The token cache is being invalidate because project 17d57d33452046db87681a6af1148849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:06:39.491379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1cda95f9-6389-445a-a534-53c9b29441d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:39.502820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1cda95f9-6389-445a-a534-53c9b29441d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:39.509157 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 813/1651] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:06:38 2022] DELETE /identity/v3/projects/17d57d33452046db87681a6af1148849 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:39.511161 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b245b-8574-4815-98a0-a98668ff94ae None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:39.511461 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b245b-8574-4815-98a0-a98668ff94ae None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:39.511786 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b245b-8574-4815-98a0-a98668ff94ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:39.514606 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54750806-59e0-414f-aa20-5c800dd6e868 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:39.573471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9e8b245b-8574-4815-98a0-a98668ff94ae None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:39.577425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9e8b245b-8574-4815-98a0-a98668ff94ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:39.654503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff11b8-5220-4c0d-aabf-b196a0712c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:39.655401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff11b8-5220-4c0d-aabf-b196a0712c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:39.655693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff11b8-5220-4c0d-aabf-b196a0712c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:39.656005 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff11b8-5220-4c0d-aabf-b196a0712c1c admin admin] PATH_INFO: `/v3/projects/49e9a444dd3d4ea5817a380ccf150f4f` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:39.663350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff11b8-5220-4c0d-aabf-b196a0712c1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e9a444dd3d4ea5817a380ccf150f4f)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:39.665361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff11b8-5220-4c0d-aabf-b196a0712c1c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:39.787957 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 814/1652] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:06:39.789832 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a716eb-6602-4c36-a63a-a3659a2fe172 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:39.790195 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a716eb-6602-4c36-a63a-a3659a2fe172 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:39.790492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a716eb-6602-4c36-a63a-a3659a2fe172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:39.790756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:39.829093 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-34a716eb-6602-4c36-a63a-a3659a2fe172 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:39.830068 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-34a716eb-6602-4c36-a63a-a3659a2fe172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:39.833688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-24ff11b8-5220-4c0d-aabf-b196a0712c1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e9a444dd3d4ea5817a380ccf150f4f', 'request_id': 'req-24ff11b8-5220-4c0d-aabf-b196a0712c1c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:39.849252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-24ff11b8-5220-4c0d-aabf-b196a0712c1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e9a444dd3d4ea5817a380ccf150f4f', 'request_id': 'req-24ff11b8-5220-4c0d-aabf-b196a0712c1c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:39.865548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-24ff11b8-5220-4c0d-aabf-b196a0712c1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e9a444dd3d4ea5817a380ccf150f4f', 'request_id': 'req-24ff11b8-5220-4c0d-aabf-b196a0712c1c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:39.885199 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-24ff11b8-5220-4c0d-aabf-b196a0712c1c admin admin] The token cache is being invalidate because project 49e9a444dd3d4ea5817a380ccf150f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:06:39.885886 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-24ff11b8-5220-4c0d-aabf-b196a0712c1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:39.887042 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-24ff11b8-5220-4c0d-aabf-b196a0712c1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:39.890115 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 839/1653] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:06:39 2022] DELETE /identity/v3/projects/49e9a444dd3d4ea5817a380ccf150f4f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:06:39.898754 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839d3de-09d8-439c-9e56-62ebfd70b460 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:39.899438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839d3de-09d8-439c-9e56-62ebfd70b460 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:39.899982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839d3de-09d8-439c-9e56-62ebfd70b460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:39.931454 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f839d3de-09d8-439c-9e56-62ebfd70b460 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:39.932908 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f839d3de-09d8-439c-9e56-62ebfd70b460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:39.947420 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 815/1654] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:39.951789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a716eb-6602-4c36-a63a-a3659a2fe172 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:39.967635 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a716eb-6602-4c36-a63a-a3659a2fe172 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:39.977683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385f39e-b28e-4f3e-92b7-d81f381319cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:39.978686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385f39e-b28e-4f3e-92b7-d81f381319cd admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:39.979042 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385f39e-b28e-4f3e-92b7-d81f381319cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:39.979438 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385f39e-b28e-4f3e-92b7-d81f381319cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:39.980510 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385f39e-b28e-4f3e-92b7-d81f381319cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:06:39.980983 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385f39e-b28e-4f3e-92b7-d81f381319cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:39.982959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385f39e-b28e-4f3e-92b7-d81f381319cd admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:40.004050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 816/1655] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:06:40.019111 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385f39e-b28e-4f3e-92b7-d81f381319cd admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:40.036104 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385f39e-b28e-4f3e-92b7-d81f381319cd admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:40.046490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b843f-3141-471a-af78-0c991095a837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:40.047628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b843f-3141-471a-af78-0c991095a837 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:40.048025 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b843f-3141-471a-af78-0c991095a837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:40.048505 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b843f-3141-471a-af78-0c991095a837 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:40.049290 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b843f-3141-471a-af78-0c991095a837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:40.052563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b843f-3141-471a-af78-0c991095a837 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:40.105792 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 817/1656] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:06:40 2022] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:40.106999 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b843f-3141-471a-af78-0c991095a837 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:40.134935 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 840/1657] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:40.142975 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fdcbd-d69c-414d-8b7e-ce376ed0e8ae None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:40.143758 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fdcbd-d69c-414d-8b7e-ce376ed0e8ae None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:40.144077 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fdcbd-d69c-414d-8b7e-ce376ed0e8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:40.181461 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-281fdcbd-d69c-414d-8b7e-ce376ed0e8ae None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:40.182800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-281fdcbd-d69c-414d-8b7e-ce376ed0e8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:40.268314 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b843f-3141-471a-af78-0c991095a837 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:40.279400 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ee681-8ae1-456a-bb3e-47a24280956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:40.282492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ee681-8ae1-456a-bb3e-47a24280956b admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:40.283126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ee681-8ae1-456a-bb3e-47a24280956b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:40.283464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ee681-8ae1-456a-bb3e-47a24280956b admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:40.284237 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ee681-8ae1-456a-bb3e-47a24280956b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:40.291424 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ee681-8ae1-456a-bb3e-47a24280956b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:40.321682 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:40.373702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 818/1658] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:06:40 2022] POST /identity/v3/users => generated 291 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:40.378416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ee681-8ae1-456a-bb3e-47a24280956b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:40.396877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 841/1659] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:06:40.401278 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fdcbd-d69c-414d-8b7e-ce376ed0e8ae None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:40.424361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ee681-8ae1-456a-bb3e-47a24280956b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:40.443402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fdcbd-d69c-414d-8b7e-ce376ed0e8ae None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:40.446894 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b941c1-de11-43ab-89dc-166b1fd2f911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:40.449488 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b941c1-de11-43ab-89dc-166b1fd2f911 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:40.451219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b941c1-de11-43ab-89dc-166b1fd2f911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:40.451219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b941c1-de11-43ab-89dc-166b1fd2f911 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:40.454151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b941c1-de11-43ab-89dc-166b1fd2f911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:40.460977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b941c1-de11-43ab-89dc-166b1fd2f911 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:40.463361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d850f-f7e3-4954-8e07-c6fea7a19159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:40.465631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d850f-f7e3-4954-8e07-c6fea7a19159 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:40.465936 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d850f-f7e3-4954-8e07-c6fea7a19159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:40.467106 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d850f-f7e3-4954-8e07-c6fea7a19159 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:40.469833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d850f-f7e3-4954-8e07-c6fea7a19159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:06:40.473919 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d850f-f7e3-4954-8e07-c6fea7a19159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:40.478250 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d850f-f7e3-4954-8e07-c6fea7a19159 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:40.500466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 819/1660] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:40.508085 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b941c1-de11-43ab-89dc-166b1fd2f911 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:40.517798 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 842/1661] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:06:40.520256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a5ac2-4f6a-47b3-a4df-d42903c83fb9 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:40.521227 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a5ac2-4f6a-47b3-a4df-d42903c83fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:40.522966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b941c1-de11-43ab-89dc-166b1fd2f911 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:40.528646 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ff5f8-320a-43a6-9433-8efa7be4b93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:40.529466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ff5f8-320a-43a6-9433-8efa7be4b93f admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:40.529861 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ff5f8-320a-43a6-9433-8efa7be4b93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:40.530352 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ff5f8-320a-43a6-9433-8efa7be4b93f admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:40.531286 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ff5f8-320a-43a6-9433-8efa7be4b93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:40.534778 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ff5f8-320a-43a6-9433-8efa7be4b93f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:40.552059 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a5ac2-4f6a-47b3-a4df-d42903c83fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:40.555436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 820/1662] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:40.573147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ff5f8-320a-43a6-9433-8efa7be4b93f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:40.614789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ff5f8-320a-43a6-9433-8efa7be4b93f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:40.631767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-cc2a5ac2-4f6a-47b3-a4df-d42903c83fb9 None None] MFA Rules not processed for user `e12d075bc9144a5e8de3fe53004e9052`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:40.635510 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cc2a5ac2-4f6a-47b3-a4df-d42903c83fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:40.636175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b2925-0cf9-4d1f-9c59-75e8e501d81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:40.640728 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b2925-0cf9-4d1f-9c59-75e8e501d81b admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:40.642393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b2925-0cf9-4d1f-9c59-75e8e501d81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:40.642788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b2925-0cf9-4d1f-9c59-75e8e501d81b admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:40.644244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b2925-0cf9-4d1f-9c59-75e8e501d81b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:40.650092 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b2925-0cf9-4d1f-9c59-75e8e501d81b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:40.737093 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 821/1663] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:06:40 2022] POST /identity/v3/projects => generated 355 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:40.738801 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b2925-0cf9-4d1f-9c59-75e8e501d81b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:40.750180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:40.893935 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 843/1664] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:40.907644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a5ac2-4f6a-47b3-a4df-d42903c83fb9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:40.934521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b2925-0cf9-4d1f-9c59-75e8e501d81b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:40.940720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef30a1c-9a38-4623-8dc1-c510a8d56309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:40.942643 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef30a1c-9a38-4623-8dc1-c510a8d56309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:40.943270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef30a1c-9a38-4623-8dc1-c510a8d56309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:40.943370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a5ac2-4f6a-47b3-a4df-d42903c83fb9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:40.943901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef30a1c-9a38-4623-8dc1-c510a8d56309 admin admin] PATH_INFO: `/v3/projects/c8a0aece32fa4a40878b4dc26c79c758/users/2a0fede7313347b395451b69c9e3c66b/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:40.960764 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffee28f-26a8-4106-9c92-abf950733e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:40.961388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffee28f-26a8-4106-9c92-abf950733e7b admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:40.961672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffee28f-26a8-4106-9c92-abf950733e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:40.962599 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffee28f-26a8-4106-9c92-abf950733e7b admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:40.963812 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffee28f-26a8-4106-9c92-abf950733e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:40.966470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffee28f-26a8-4106-9c92-abf950733e7b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:40.981295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef30a1c-9a38-4623-8dc1-c510a8d56309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a0aece32fa4a40878b4dc26c79c758, user_id=2a0fede7313347b395451b69c9e3c66b, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:40.990825 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef30a1c-9a38-4623-8dc1-c510a8d56309 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:41.034556 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 822/1665] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:40 2022] PUT /identity/v3/projects/c8a0aece32fa4a40878b4dc26c79c758/users/2a0fede7313347b395451b69c9e3c66b/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:41.062922 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d950cd-d367-4c67-8d98-ebc2f5030d0a None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:41.063350 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d950cd-d367-4c67-8d98-ebc2f5030d0a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:41.063913 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 844/1666] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:06:40 2022] POST /identity/v3/users => generated 278 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:41.068106 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d950cd-d367-4c67-8d98-ebc2f5030d0a None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:41.068192 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffee28f-26a8-4106-9c92-abf950733e7b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:41.070634 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 823/1667] 10.222.0.41 () {54 vars in 960 bytes} [Mon May 30 12:06:41 2022] GET /identity => generated 270 bytes in 35 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:41.072129 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4ffee28f-26a8-4106-9c92-abf950733e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:41.074116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b8049-476c-41db-8247-fbbdb44198ad None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:41.074521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b8049-476c-41db-8247-fbbdb44198ad None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:41.077760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b8049-476c-41db-8247-fbbdb44198ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:41.151719 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9e1b8049-476c-41db-8247-fbbdb44198ad None None] MFA Rules not processed for user `2a0fede7313347b395451b69c9e3c66b`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:41.153375 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9e1b8049-476c-41db-8247-fbbdb44198ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:41.291699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffee28f-26a8-4106-9c92-abf950733e7b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:41.345159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 824/1668] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:41.355801 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b8049-476c-41db-8247-fbbdb44198ad None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:41.413853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:41.488784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6ff7b-8ac0-4fb6-85bb-6ede20214aab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:41.489643 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6ff7b-8ac0-4fb6-85bb-6ede20214aab service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:41.489951 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6ff7b-8ac0-4fb6-85bb-6ede20214aab service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:41.490233 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6ff7b-8ac0-4fb6-85bb-6ede20214aab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:41.535760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b8049-476c-41db-8247-fbbdb44198ad None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:41.551843 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a780498-a241-4fde-b1d7-62aa7d115103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:41.552554 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a780498-a241-4fde-b1d7-62aa7d115103 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:41.552838 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a780498-a241-4fde-b1d7-62aa7d115103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:41.553116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a780498-a241-4fde-b1d7-62aa7d115103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:41.554015 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a780498-a241-4fde-b1d7-62aa7d115103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:41.555812 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a780498-a241-4fde-b1d7-62aa7d115103 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:41.581412 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 825/1669] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:41.588015 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82620ca5-9ba7-4a63-95b1-5de4ac1d1553 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:41.588416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82620ca5-9ba7-4a63-95b1-5de4ac1d1553 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:41.588700 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82620ca5-9ba7-4a63-95b1-5de4ac1d1553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:41.621401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:41.626409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-82620ca5-9ba7-4a63-95b1-5de4ac1d1553 None None] MFA Rules not processed for user `48b43eb1a0ac4db5adee3512453459aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:41.627648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-82620ca5-9ba7-4a63-95b1-5de4ac1d1553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:41.630978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6ff7b-8ac0-4fb6-85bb-6ede20214aab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:41.633522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6ff7b-8ac0-4fb6-85bb-6ede20214aab service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:41.661127 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 845/1670] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:41.662423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6ff7b-8ac0-4fb6-85bb-6ede20214aab service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:41.702608 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6ff7b-8ac0-4fb6-85bb-6ede20214aab service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:41.712846 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a49af8-e472-4374-bd7a-ac8257310bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:41.713747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a49af8-e472-4374-bd7a-ac8257310bfc admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:41.714147 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a49af8-e472-4374-bd7a-ac8257310bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:41.714570 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a49af8-e472-4374-bd7a-ac8257310bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:41.716974 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a49af8-e472-4374-bd7a-ac8257310bfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:41.719102 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a49af8-e472-4374-bd7a-ac8257310bfc admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:41.793056 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 846/1671] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:06:41 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:41.797332 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a49af8-e472-4374-bd7a-ac8257310bfc admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:41.810200 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 826/1672] 10.222.0.41 () {58 vars in 1057 bytes} [Mon May 30 12:06:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:41.812130 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82620ca5-9ba7-4a63-95b1-5de4ac1d1553 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:41.845315 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82620ca5-9ba7-4a63-95b1-5de4ac1d1553 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:42.002918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a49af8-e472-4374-bd7a-ac8257310bfc admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:42.015489 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36f410-11da-40df-977e-b3dc713d5ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:42.016820 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36f410-11da-40df-977e-b3dc713d5ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:42.017762 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20af4fb-5127-4313-97e7-dbbecc7eccb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:42.018630 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36f410-11da-40df-977e-b3dc713d5ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:42.019310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20af4fb-5127-4313-97e7-dbbecc7eccb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:42.019310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20af4fb-5127-4313-97e7-dbbecc7eccb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:42.020432 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20af4fb-5127-4313-97e7-dbbecc7eccb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:42.021364 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20af4fb-5127-4313-97e7-dbbecc7eccb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:42.021581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36f410-11da-40df-977e-b3dc713d5ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:42.023682 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36f410-11da-40df-977e-b3dc713d5ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:42.023833 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20af4fb-5127-4313-97e7-dbbecc7eccb3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:42.027913 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36f410-11da-40df-977e-b3dc713d5ff3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:42.057735 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 847/1673] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:42.059224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36f410-11da-40df-977e-b3dc713d5ff3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:42.071700 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 827/1674] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:06:41 2022] POST /identity/v3/users => generated 296 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:42.071700 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20af4fb-5127-4313-97e7-dbbecc7eccb3 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:42.104948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20af4fb-5127-4313-97e7-dbbecc7eccb3 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:42.123385 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2c41c-343e-4de5-bb8c-12f8e1b5dc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:42.124519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2c41c-343e-4de5-bb8c-12f8e1b5dc52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:42.124925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2c41c-343e-4de5-bb8c-12f8e1b5dc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:42.125315 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2c41c-343e-4de5-bb8c-12f8e1b5dc52 admin admin] PATH_INFO: `/v3/projects/c053ca4f54ad4cb78c07e0b870fab0cd/users/1a93ec4393e444d5ae18c69033762a90/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:42.164515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2c41c-343e-4de5-bb8c-12f8e1b5dc52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c053ca4f54ad4cb78c07e0b870fab0cd, user_id=1a93ec4393e444d5ae18c69033762a90, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:42.171264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2c41c-343e-4de5-bb8c-12f8e1b5dc52 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:42.202675 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 828/1675] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:42 2022] PUT /identity/v3/projects/c053ca4f54ad4cb78c07e0b870fab0cd/users/1a93ec4393e444d5ae18c69033762a90/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:42.203699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2c41c-343e-4de5-bb8c-12f8e1b5dc52 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:42.218624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36f410-11da-40df-977e-b3dc713d5ff3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:42.273904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:42.322584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be41ed5-1acc-4f1b-8506-e2464f696936 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b43eb1a0ac4db5adee3512453459aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:42.323861 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be41ed5-1acc-4f1b-8506-e2464f696936 service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:42.324287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be41ed5-1acc-4f1b-8506-e2464f696936 service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:42.324724 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be41ed5-1acc-4f1b-8506-e2464f696936 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:42.327340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1be41ed5-1acc-4f1b-8506-e2464f696936 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:42.352617 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be41ed5-1acc-4f1b-8506-e2464f696936 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:42.354836 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be41ed5-1acc-4f1b-8506-e2464f696936 service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:42.368268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:42.379349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 848/1676] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:42.383017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8045f-a581-40c1-998e-411320f857a9 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:42.383319 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8045f-a581-40c1-998e-411320f857a9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:42.384438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8045f-a581-40c1-998e-411320f857a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:42.451453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ade8045f-a581-40c1-998e-411320f857a9 None None] MFA Rules not processed for user `1a93ec4393e444d5ae18c69033762a90`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:42.452818 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ade8045f-a581-40c1-998e-411320f857a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:42.479856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2c41c-343e-4de5-bb8c-12f8e1b5dc52 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:42.496103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2324f-830f-41aa-93fc-8c2b8a20f54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:42.514382 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2324f-830f-41aa-93fc-8c2b8a20f54a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:42.517177 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2324f-830f-41aa-93fc-8c2b8a20f54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:42.517538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2324f-830f-41aa-93fc-8c2b8a20f54a admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:42.522975 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2324f-830f-41aa-93fc-8c2b8a20f54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:42.531122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2324f-830f-41aa-93fc-8c2b8a20f54a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:42.603467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 829/1677] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:42.604545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2324f-830f-41aa-93fc-8c2b8a20f54a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:42.622282 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 849/1678] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:42 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:42.623387 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8045f-a581-40c1-998e-411320f857a9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:42.647832 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2324f-830f-41aa-93fc-8c2b8a20f54a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:42.662075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef5dd4-77fe-40df-9f29-d6a2a341ffbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:42.663629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef5dd4-77fe-40df-9f29-d6a2a341ffbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:42.663629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef5dd4-77fe-40df-9f29-d6a2a341ffbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:42.663629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef5dd4-77fe-40df-9f29-d6a2a341ffbf admin admin] PATH_INFO: `/v3/projects/6a6bb751f4ba45f29d3fe7aae2a5da27/users/26a2e158d7b744528cf1539c18465bfe/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:42.670723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8045f-a581-40c1-998e-411320f857a9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:42.687379 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae542c2-ef16-4c07-80bf-42b464739207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:42.688151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae542c2-ef16-4c07-80bf-42b464739207 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:42.688411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae542c2-ef16-4c07-80bf-42b464739207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:42.688697 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae542c2-ef16-4c07-80bf-42b464739207 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:42.694745 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae542c2-ef16-4c07-80bf-42b464739207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:42.703395 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae542c2-ef16-4c07-80bf-42b464739207 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:42.711623 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef5dd4-77fe-40df-9f29-d6a2a341ffbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6bb751f4ba45f29d3fe7aae2a5da27, user_id=26a2e158d7b744528cf1539c18465bfe, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:42.717342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef5dd4-77fe-40df-9f29-d6a2a341ffbf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:42.792080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 830/1679] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:42 2022] PUT /identity/v3/projects/6a6bb751f4ba45f29d3fe7aae2a5da27/users/26a2e158d7b744528cf1539c18465bfe/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:42.797073 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef5dd4-77fe-40df-9f29-d6a2a341ffbf admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:42.828693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 850/1680] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:06:42 2022] POST /identity/v3/projects => generated 355 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:42.835335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae542c2-ef16-4c07-80bf-42b464739207 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:42.976802 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef5dd4-77fe-40df-9f29-d6a2a341ffbf admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:43.123743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae542c2-ef16-4c07-80bf-42b464739207 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:43.134073 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb4ed4-0ace-49d5-b1d7-8a9877e1e378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:43.135493 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb4ed4-0ace-49d5-b1d7-8a9877e1e378 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:43.135795 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb4ed4-0ace-49d5-b1d7-8a9877e1e378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:43.136181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb4ed4-0ace-49d5-b1d7-8a9877e1e378 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:43.136907 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb4ed4-0ace-49d5-b1d7-8a9877e1e378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:43.138859 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb4ed4-0ace-49d5-b1d7-8a9877e1e378 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:43.172291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a13427-6f45-466d-af45-cc8c61a922a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:43.174300 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a13427-6f45-466d-af45-cc8c61a922a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:43.175195 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a13427-6f45-466d-af45-cc8c61a922a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:43.177148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a13427-6f45-466d-af45-cc8c61a922a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:43.180135 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a13427-6f45-466d-af45-cc8c61a922a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:43.187910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a13427-6f45-466d-af45-cc8c61a922a6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:43.210198 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 851/1681] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:06:42 2022] POST /identity/v3/users => generated 284 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:43.214825 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb4ed4-0ace-49d5-b1d7-8a9877e1e378 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:43.229906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb4ed4-0ace-49d5-b1d7-8a9877e1e378 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:43.252477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 831/1682] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:43.268121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b082b-ebc3-448e-81c5-a4550ef514a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:43.269827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b082b-ebc3-448e-81c5-a4550ef514a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:43.269827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b082b-ebc3-448e-81c5-a4550ef514a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:43.270028 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b082b-ebc3-448e-81c5-a4550ef514a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:43.270729 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b082b-ebc3-448e-81c5-a4550ef514a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:43.271290 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a13427-6f45-466d-af45-cc8c61a922a6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:43.272288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b082b-ebc3-448e-81c5-a4550ef514a6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:43.287044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a13427-6f45-466d-af45-cc8c61a922a6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:43.300013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2f2e2-f7ab-4649-9e35-9f285ecac0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:43.304631 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2f2e2-f7ab-4649-9e35-9f285ecac0c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:43.304914 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2f2e2-f7ab-4649-9e35-9f285ecac0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:43.306349 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2f2e2-f7ab-4649-9e35-9f285ecac0c2 admin admin] PATH_INFO: `/v3/projects/6a6bb751f4ba45f29d3fe7aae2a5da27/users/26a2e158d7b744528cf1539c18465bfe/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:43.313775 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2f2e2-f7ab-4649-9e35-9f285ecac0c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6bb751f4ba45f29d3fe7aae2a5da27, user_id=26a2e158d7b744528cf1539c18465bfe, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:43.314537 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 852/1683] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:43.315437 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b082b-ebc3-448e-81c5-a4550ef514a6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:43.321022 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2f2e2-f7ab-4649-9e35-9f285ecac0c2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:43.350407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b082b-ebc3-448e-81c5-a4550ef514a6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:43.360794 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 832/1684] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:43 2022] PUT /identity/v3/projects/6a6bb751f4ba45f29d3fe7aae2a5da27/users/26a2e158d7b744528cf1539c18465bfe/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:43.366227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521528f-8987-40d5-9865-0cf67d300806 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:43.366519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521528f-8987-40d5-9865-0cf67d300806 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:43.366796 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521528f-8987-40d5-9865-0cf67d300806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:43.428900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5521528f-8987-40d5-9865-0cf67d300806 None None] MFA Rules not processed for user `26a2e158d7b744528cf1539c18465bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:43.432247 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5521528f-8987-40d5-9865-0cf67d300806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:43.448900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:43.470781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:43.499492 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c21e98-ede2-4067-a148-bbb943e91735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:43.500431 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c21e98-ede2-4067-a148-bbb943e91735 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:43.500784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c21e98-ede2-4067-a148-bbb943e91735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:43.500991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c21e98-ede2-4067-a148-bbb943e91735 admin admin] PATH_INFO: `/v3/projects/5a67f945b99940c4990431d99b73d159/users/837fcbb9a46648eba3dafba63ecdc4b4/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:43.552483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c21e98-ede2-4067-a148-bbb943e91735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a67f945b99940c4990431d99b73d159, user_id=837fcbb9a46648eba3dafba63ecdc4b4, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:43.555682 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c21e98-ede2-4067-a148-bbb943e91735 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:43.601642 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 853/1685] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:43 2022] PUT /identity/v3/projects/5a67f945b99940c4990431d99b73d159/users/837fcbb9a46648eba3dafba63ecdc4b4/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:43.605589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c21e98-ede2-4067-a148-bbb943e91735 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:43.611432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e1c21e98-ede2-4067-a148-bbb943e91735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:43.779080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 833/1686] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:43.782271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521528f-8987-40d5-9865-0cf67d300806 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:43.808942 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521528f-8987-40d5-9865-0cf67d300806 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:43.817852 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c21e98-ede2-4067-a148-bbb943e91735 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:43.827057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219dff8-9c3a-4344-8cb8-09c7d0fd4c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:43.827853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219dff8-9c3a-4344-8cb8-09c7d0fd4c94 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:43.831037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219dff8-9c3a-4344-8cb8-09c7d0fd4c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:43.831534 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219dff8-9c3a-4344-8cb8-09c7d0fd4c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:43.833670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e125f8-aae6-4809-84be-5054d2e29f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:43.834502 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219dff8-9c3a-4344-8cb8-09c7d0fd4c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:43.835053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e125f8-aae6-4809-84be-5054d2e29f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:43.835480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e125f8-aae6-4809-84be-5054d2e29f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:43.835935 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e125f8-aae6-4809-84be-5054d2e29f10 admin admin] PATH_INFO: `/v3/users/73143527412b430bb7cfbcd8399ed646` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:43.837769 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e125f8-aae6-4809-84be-5054d2e29f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73143527412b430bb7cfbcd8399ed646)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:43.839903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e125f8-aae6-4809-84be-5054d2e29f10 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:43.841018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219dff8-9c3a-4344-8cb8-09c7d0fd4c94 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:43.869312 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 834/1687] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:43.874335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219dff8-9c3a-4344-8cb8-09c7d0fd4c94 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:43.877689 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5219dff8-9c3a-4344-8cb8-09c7d0fd4c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:43.999561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-31e125f8-aae6-4809-84be-5054d2e29f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73143527412b430bb7cfbcd8399ed646'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:44.029355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-31e125f8-aae6-4809-84be-5054d2e29f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73143527412b430bb7cfbcd8399ed646'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:44.056512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219dff8-9c3a-4344-8cb8-09c7d0fd4c94 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:44.058986 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-31e125f8-aae6-4809-84be-5054d2e29f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73143527412b430bb7cfbcd8399ed646'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:44.060058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-31e125f8-aae6-4809-84be-5054d2e29f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73143527412b430bb7cfbcd8399ed646'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:44.065523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8081f8-5b00-49b3-af97-cfa6280b34c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:44.069019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8081f8-5b00-49b3-af97-cfa6280b34c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:44.069308 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8081f8-5b00-49b3-af97-cfa6280b34c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:44.069600 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8081f8-5b00-49b3-af97-cfa6280b34c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:44.074774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bd8081f8-5b00-49b3-af97-cfa6280b34c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:44.079224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-31e125f8-aae6-4809-84be-5054d2e29f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73143527412b430bb7cfbcd8399ed646'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:44.098085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 854/1688] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:06:43 2022] DELETE /identity/v3/users/73143527412b430bb7cfbcd8399ed646 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:44.103048 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e125f8-aae6-4809-84be-5054d2e29f10 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:44.106839 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-31e125f8-aae6-4809-84be-5054d2e29f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:44.277996 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:44.286739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8081f8-5b00-49b3-af97-cfa6280b34c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:44.296427 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8081f8-5b00-49b3-af97-cfa6280b34c5 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:44.325477 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e125f8-aae6-4809-84be-5054d2e29f10 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:44.340694 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613aada-d113-40ca-9960-94efb8ccfd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:44.342067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613aada-d113-40ca-9960-94efb8ccfd79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:44.342353 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613aada-d113-40ca-9960-94efb8ccfd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:44.342632 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613aada-d113-40ca-9960-94efb8ccfd79 admin admin] PATH_INFO: `/v3/projects/5a67f945b99940c4990431d99b73d159/users/837fcbb9a46648eba3dafba63ecdc4b4/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:44.348524 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 835/1689] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:44.349954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e466d-fa3b-4a62-a880-66a4589868db None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:44.350250 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e466d-fa3b-4a62-a880-66a4589868db None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:44.350533 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e466d-fa3b-4a62-a880-66a4589868db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:44.361791 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613aada-d113-40ca-9960-94efb8ccfd79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a67f945b99940c4990431d99b73d159, user_id=837fcbb9a46648eba3dafba63ecdc4b4, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:44.379857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613aada-d113-40ca-9960-94efb8ccfd79 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:44.405393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-aa7e466d-fa3b-4a62-a880-66a4589868db None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:44.407793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-aa7e466d-fa3b-4a62-a880-66a4589868db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:44.448358 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 855/1690] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:44 2022] PUT /identity/v3/projects/5a67f945b99940c4990431d99b73d159/users/837fcbb9a46648eba3dafba63ecdc4b4/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:44.450593 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4fa46-04b0-4338-a9f5-1cfcd5dfb940 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:44.451295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4fa46-04b0-4338-a9f5-1cfcd5dfb940 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:44.451770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4fa46-04b0-4338-a9f5-1cfcd5dfb940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:44.493467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:44.518609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8fa4fa46-04b0-4338-a9f5-1cfcd5dfb940 None None] MFA Rules not processed for user `837fcbb9a46648eba3dafba63ecdc4b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:44.522283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8fa4fa46-04b0-4338-a9f5-1cfcd5dfb940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:44.545474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 836/1691] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:44.568262 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e466d-fa3b-4a62-a880-66a4589868db None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:44.570647 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-aa7e466d-fa3b-4a62-a880-66a4589868db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:44.737830 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 856/1692] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:44 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:44.740053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4fa46-04b0-4338-a9f5-1cfcd5dfb940 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:44.743378 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8fa4fa46-04b0-4338-a9f5-1cfcd5dfb940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:44.758979 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e466d-fa3b-4a62-a880-66a4589868db None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:44.773120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51192e72-1dba-455e-874f-b060e0ba0a8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:44.774189 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51192e72-1dba-455e-874f-b060e0ba0a8d service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:44.774425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51192e72-1dba-455e-874f-b060e0ba0a8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:44.775922 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51192e72-1dba-455e-874f-b060e0ba0a8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:44.779609 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-51192e72-1dba-455e-874f-b060e0ba0a8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:44.942859 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51192e72-1dba-455e-874f-b060e0ba0a8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:44.945455 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51192e72-1dba-455e-874f-b060e0ba0a8d service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:44.955019 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4fa46-04b0-4338-a9f5-1cfcd5dfb940 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:44.974982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9546ce-c940-4491-b589-66140935eb14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:44.976214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9546ce-c940-4491-b589-66140935eb14 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:44.976654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9546ce-c940-4491-b589-66140935eb14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:44.977190 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9546ce-c940-4491-b589-66140935eb14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:44.986800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 837/1693] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:44.987827 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51192e72-1dba-455e-874f-b060e0ba0a8d service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:44.995618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-51192e72-1dba-455e-874f-b060e0ba0a8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:45.014094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9546ce-c940-4491-b589-66140935eb14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:45.015573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9546ce-c940-4491-b589-66140935eb14 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:45.032129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51192e72-1dba-455e-874f-b060e0ba0a8d service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:45.044304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 857/1694] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:45.046275 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c176d84-5cd3-498c-94e6-cb417320b544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:45.047238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c176d84-5cd3-498c-94e6-cb417320b544 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:45.047530 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c176d84-5cd3-498c-94e6-cb417320b544 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:45.047918 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c176d84-5cd3-498c-94e6-cb417320b544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:45.073317 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c176d84-5cd3-498c-94e6-cb417320b544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:45.075358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c176d84-5cd3-498c-94e6-cb417320b544 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:45.098209 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 838/1695] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:44 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:45.270073 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9546ce-c940-4491-b589-66140935eb14 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:45.282168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9546ce-c940-4491-b589-66140935eb14 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:45.302979 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c457b-2246-45cf-9c99-84ac110c65be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:45.304146 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c457b-2246-45cf-9c99-84ac110c65be service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:45.307687 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c457b-2246-45cf-9c99-84ac110c65be service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:45.310208 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c457b-2246-45cf-9c99-84ac110c65be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:45.315395 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8a9c457b-2246-45cf-9c99-84ac110c65be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:45.446444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c457b-2246-45cf-9c99-84ac110c65be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:45.449040 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c457b-2246-45cf-9c99-84ac110c65be service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:45.483850 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 858/1696] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:45 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:46.421422 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b3874-2f22-49c8-bca5-01212b90a8de None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:46.421847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b3874-2f22-49c8-bca5-01212b90a8de None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:46.422001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b3874-2f22-49c8-bca5-01212b90a8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:46.463930 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-733b3874-2f22-49c8-bca5-01212b90a8de None None] MFA Rules not processed for user `a63dd78421064bbe838b1ed0261c13bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:46.465335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-733b3874-2f22-49c8-bca5-01212b90a8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:46.673410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 839/1697] 10.222.0.41 () {58 vars in 1009 bytes} [Mon May 30 12:06:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:46.753819 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c457b-2246-45cf-9c99-84ac110c65be service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:46.759495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8a9c457b-2246-45cf-9c99-84ac110c65be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:46.823539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c457b-2246-45cf-9c99-84ac110c65be service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:46.845993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e44f6c-a084-45f9-8ba9-7918c8cf112c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:46.846919 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e44f6c-a084-45f9-8ba9-7918c8cf112c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:46.848229 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e44f6c-a084-45f9-8ba9-7918c8cf112c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:46.848229 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e44f6c-a084-45f9-8ba9-7918c8cf112c admin admin] PATH_INFO: `/v3/projects/c7e4c2961f55482491f6194da650b479` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:46.855765 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e44f6c-a084-45f9-8ba9-7918c8cf112c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e4c2961f55482491f6194da650b479)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:46.861416 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e44f6c-a084-45f9-8ba9-7918c8cf112c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:46.872349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:46.967176 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b3874-2f22-49c8-bca5-01212b90a8de None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:46.970333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-733b3874-2f22-49c8-bca5-01212b90a8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:47.045730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-14e44f6c-a084-45f9-8ba9-7918c8cf112c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e4c2961f55482491f6194da650b479', 'request_id': 'req-14e44f6c-a084-45f9-8ba9-7918c8cf112c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:47.083210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-14e44f6c-a084-45f9-8ba9-7918c8cf112c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e4c2961f55482491f6194da650b479', 'request_id': 'req-14e44f6c-a084-45f9-8ba9-7918c8cf112c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:47.122532 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-14e44f6c-a084-45f9-8ba9-7918c8cf112c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e4c2961f55482491f6194da650b479', 'request_id': 'req-14e44f6c-a084-45f9-8ba9-7918c8cf112c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:47.133261 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:47.154297 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-14e44f6c-a084-45f9-8ba9-7918c8cf112c admin admin] The token cache is being invalidate because project c7e4c2961f55482491f6194da650b479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:06:47.155341 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-14e44f6c-a084-45f9-8ba9-7918c8cf112c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:47.157927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-14e44f6c-a084-45f9-8ba9-7918c8cf112c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:47.162999 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 859/1698] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:06:46 2022] DELETE /identity/v3/projects/c7e4c2961f55482491f6194da650b479 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:47.168094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29428c37-6949-4d46-b826-a7a378cd6d2a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:47.168387 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29428c37-6949-4d46-b826-a7a378cd6d2a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:47.169382 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29428c37-6949-4d46-b826-a7a378cd6d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:47.222801 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-29428c37-6949-4d46-b826-a7a378cd6d2a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:47.223805 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-29428c37-6949-4d46-b826-a7a378cd6d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:47.239479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b3874-2f22-49c8-bca5-01212b90a8de None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:47.414547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 860/1699] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:47.420291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158707a-8917-419a-a2a7-a1dda4817040 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:47.420614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158707a-8917-419a-a2a7-a1dda4817040 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:47.420910 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158707a-8917-419a-a2a7-a1dda4817040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:47.440411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910c249-4a4c-4674-918e-c4de5e340835 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e5f980cdb74227bb31c7e7e5eab74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:47.441742 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910c249-4a4c-4674-918e-c4de5e340835 service swift] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:47.442195 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910c249-4a4c-4674-918e-c4de5e340835 service swift] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:47.442477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910c249-4a4c-4674-918e-c4de5e340835 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:47.449397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f910c249-4a4c-4674-918e-c4de5e340835 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:47.508569 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9158707a-8917-419a-a2a7-a1dda4817040 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:47.511343 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9158707a-8917-419a-a2a7-a1dda4817040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:47.535610 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 861/1700] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:47.539773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158707a-8917-419a-a2a7-a1dda4817040 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:47.560686 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158707a-8917-419a-a2a7-a1dda4817040 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:47.574013 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef556877-896c-4fec-886c-47125469b23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:47.574695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef556877-896c-4fec-886c-47125469b23e admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:47.576100 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef556877-896c-4fec-886c-47125469b23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:47.576400 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef556877-896c-4fec-886c-47125469b23e admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:47.580282 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef556877-896c-4fec-886c-47125469b23e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:06:47.580606 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef556877-896c-4fec-886c-47125469b23e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:47.584446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef556877-896c-4fec-886c-47125469b23e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:47.590503 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910c249-4a4c-4674-918e-c4de5e340835 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:47.592909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910c249-4a4c-4674-918e-c4de5e340835 service swift] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:47.616176 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 840/1701] 10.222.0.41 () {60 vars in 1384 bytes} [Mon May 30 12:06:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:06:47.623215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 862/1702] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:06:47.624956 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910c249-4a4c-4674-918e-c4de5e340835 service swift] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:47.661806 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910c249-4a4c-4674-918e-c4de5e340835 service swift] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:47.681480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb6b92-c008-4f57-85bb-9f4545d49602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:47.682418 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb6b92-c008-4f57-85bb-9f4545d49602 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:47.682903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb6b92-c008-4f57-85bb-9f4545d49602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:47.683494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb6b92-c008-4f57-85bb-9f4545d49602 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:47.684489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb6b92-c008-4f57-85bb-9f4545d49602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:47.687631 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb6b92-c008-4f57-85bb-9f4545d49602 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:47.738865 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 841/1703] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:06:47 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:06:47.742716 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef556877-896c-4fec-886c-47125469b23e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:47.763869 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef556877-896c-4fec-886c-47125469b23e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:47.839152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139270e-0702-4999-b23e-c543866ed7c5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:47.839648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139270e-0702-4999-b23e-c543866ed7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:47.840074 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139270e-0702-4999-b23e-c543866ed7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:47.977397 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487d7a5-b60b-499c-86f4-68cc3c7b04c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:47.978430 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487d7a5-b60b-499c-86f4-68cc3c7b04c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:47.978910 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487d7a5-b60b-499c-86f4-68cc3c7b04c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:47.985838 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487d7a5-b60b-499c-86f4-68cc3c7b04c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:47.987014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487d7a5-b60b-499c-86f4-68cc3c7b04c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:47.989935 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487d7a5-b60b-499c-86f4-68cc3c7b04c3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:48.003113 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a139270e-0702-4999-b23e-c543866ed7c5 None None] MFA Rules not processed for user `9c9292fdef7f41af8fcb9375ce1764e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:48.012811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a139270e-0702-4999-b23e-c543866ed7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:48.042607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 863/1704] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:06:47 2022] POST /identity/v3/users => generated 284 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:48.043915 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487d7a5-b60b-499c-86f4-68cc3c7b04c3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:48.058485 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:48.069631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487d7a5-b60b-499c-86f4-68cc3c7b04c3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:48.084257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1283f61-bd68-4271-9f51-31af6e3a3dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:48.085275 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1283f61-bd68-4271-9f51-31af6e3a3dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:48.085763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1283f61-bd68-4271-9f51-31af6e3a3dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:48.086240 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1283f61-bd68-4271-9f51-31af6e3a3dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:48.087438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1283f61-bd68-4271-9f51-31af6e3a3dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:48.090642 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1283f61-bd68-4271-9f51-31af6e3a3dfa admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:48.116750 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 864/1705] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:48.127012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1283f61-bd68-4271-9f51-31af6e3a3dfa admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:48.166238 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1283f61-bd68-4271-9f51-31af6e3a3dfa admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:48.181057 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb912f-e64f-4240-9d04-a16636994858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:48.183444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb912f-e64f-4240-9d04-a16636994858 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:48.183779 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb912f-e64f-4240-9d04-a16636994858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:48.184197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb912f-e64f-4240-9d04-a16636994858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:48.186601 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb912f-e64f-4240-9d04-a16636994858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:48.193068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb912f-e64f-4240-9d04-a16636994858 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:48.221585 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 865/1706] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:48.229646 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb912f-e64f-4240-9d04-a16636994858 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:48.237115 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:48.249428 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb912f-e64f-4240-9d04-a16636994858 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:48.256635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0f584-de31-4300-8f59-20a6ac46a0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:48.257607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0f584-de31-4300-8f59-20a6ac46a0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:48.257927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0f584-de31-4300-8f59-20a6ac46a0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:48.258453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0f584-de31-4300-8f59-20a6ac46a0e4 admin admin] PATH_INFO: `/v3/projects/b0c6acbd08194a038284379017f7eb53/users/b560c3359c3349ee9232b72bb2202dc7/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:48.281021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0f584-de31-4300-8f59-20a6ac46a0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c6acbd08194a038284379017f7eb53, user_id=b560c3359c3349ee9232b72bb2202dc7, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:48.286272 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0f584-de31-4300-8f59-20a6ac46a0e4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:48.320288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 866/1707] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:48 2022] PUT /identity/v3/projects/b0c6acbd08194a038284379017f7eb53/users/b560c3359c3349ee9232b72bb2202dc7/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:48.322143 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a800ce2-eae5-4c37-824b-5537fbdab228 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:48.322443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a800ce2-eae5-4c37-824b-5537fbdab228 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:48.322807 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a800ce2-eae5-4c37-824b-5537fbdab228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:48.364060 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 842/1708] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 525 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:48.365068 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139270e-0702-4999-b23e-c543866ed7c5 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:48.371766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a139270e-0702-4999-b23e-c543866ed7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:48.405754 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139270e-0702-4999-b23e-c543866ed7c5 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:48.407793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6a800ce2-eae5-4c37-824b-5537fbdab228 None None] MFA Rules not processed for user `b560c3359c3349ee9232b72bb2202dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:48.409120 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6a800ce2-eae5-4c37-824b-5537fbdab228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:48.538035 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f396f45-5606-417b-af58-9d1342bed34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:48.539713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f396f45-5606-417b-af58-9d1342bed34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:48.540219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f396f45-5606-417b-af58-9d1342bed34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:48.540882 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f396f45-5606-417b-af58-9d1342bed34e admin admin] PATH_INFO: `/v3/users/4d9f4ab27d4745639b532b61c440d819` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:48.547024 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f396f45-5606-417b-af58-9d1342bed34e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d9f4ab27d4745639b532b61c440d819)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:48.550076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f396f45-5606-417b-af58-9d1342bed34e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:48.568172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 867/1709] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:48.569596 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a800ce2-eae5-4c37-824b-5537fbdab228 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:48.574242 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6a800ce2-eae5-4c37-824b-5537fbdab228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:48.665396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8f396f45-5606-417b-af58-9d1342bed34e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d9f4ab27d4745639b532b61c440d819'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:48.688517 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8f396f45-5606-417b-af58-9d1342bed34e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d9f4ab27d4745639b532b61c440d819'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:48.718196 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8f396f45-5606-417b-af58-9d1342bed34e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d9f4ab27d4745639b532b61c440d819'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:48.720266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8f396f45-5606-417b-af58-9d1342bed34e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d9f4ab27d4745639b532b61c440d819'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:48.721260 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8f396f45-5606-417b-af58-9d1342bed34e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d9f4ab27d4745639b532b61c440d819'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:48.759096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 843/1710] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:06:48 2022] DELETE /identity/v3/users/4d9f4ab27d4745639b532b61c440d819 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:48.769810 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a800ce2-eae5-4c37-824b-5537fbdab228 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:48.770361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcc9e0-417e-4f32-8832-cc204e238d4d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:48.771229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcc9e0-417e-4f32-8832-cc204e238d4d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:48.771229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcc9e0-417e-4f32-8832-cc204e238d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:48.828333 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:48.852718 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e955d-1905-4356-a693-68d93c7ba7ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:48.853955 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e955d-1905-4356-a693-68d93c7ba7ec service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:48.854632 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e955d-1905-4356-a693-68d93c7ba7ec service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:48.855292 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e955d-1905-4356-a693-68d93c7ba7ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:48.857377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-693e955d-1905-4356-a693-68d93c7ba7ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:48.910402 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-33dcc9e0-417e-4f32-8832-cc204e238d4d None None] MFA Rules not processed for user `e12d075bc9144a5e8de3fe53004e9052`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:48.930426 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-33dcc9e0-417e-4f32-8832-cc204e238d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:48.945444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e955d-1905-4356-a693-68d93c7ba7ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:48.947688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e955d-1905-4356-a693-68d93c7ba7ec service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:48.960844 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 868/1711] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:48.962538 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e955d-1905-4356-a693-68d93c7ba7ec service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:48.964735 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-693e955d-1905-4356-a693-68d93c7ba7ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:49.159938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 844/1712] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:49.162442 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56e7c7-5a32-4304-8ddb-ef888fbddfd3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:49.162785 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56e7c7-5a32-4304-8ddb-ef888fbddfd3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:49.163624 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56e7c7-5a32-4304-8ddb-ef888fbddfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:49.173663 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:49.211023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-fd56e7c7-5a32-4304-8ddb-ef888fbddfd3 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:49.213642 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fd56e7c7-5a32-4304-8ddb-ef888fbddfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:49.230989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 845/1713] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:49.230989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f7701-9a52-478b-9dcd-37bdb5086f63 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:49.230989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f7701-9a52-478b-9dcd-37bdb5086f63 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:49.230989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f7701-9a52-478b-9dcd-37bdb5086f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:49.237485 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e955d-1905-4356-a693-68d93c7ba7ec service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:49.271084 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34282d-6efe-4a30-821f-52a7dd926151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:49.271776 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34282d-6efe-4a30-821f-52a7dd926151 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:49.272110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34282d-6efe-4a30-821f-52a7dd926151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:49.272403 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34282d-6efe-4a30-821f-52a7dd926151 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:49.273090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34282d-6efe-4a30-821f-52a7dd926151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:49.275019 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34282d-6efe-4a30-821f-52a7dd926151 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:49.322148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5c2f7701-9a52-478b-9dcd-37bdb5086f63 None None] MFA Rules not processed for user `5ee1e385f10e4ed4849ef2febc22e497`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:49.327273 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5c2f7701-9a52-478b-9dcd-37bdb5086f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:49.395176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 869/1714] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:06:48 2022] POST /identity/v3/projects => generated 369 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:49.396070 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34282d-6efe-4a30-821f-52a7dd926151 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:49.407446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2e34282d-6efe-4a30-821f-52a7dd926151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:49.673043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34282d-6efe-4a30-821f-52a7dd926151 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:49.704417 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 846/1715] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:49.714042 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ed8b0-ff30-47e6-9d44-9a283ffa3999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:49.721278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f7701-9a52-478b-9dcd-37bdb5086f63 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:49.723989 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ed8b0-ff30-47e6-9d44-9a283ffa3999 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:49.725629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ed8b0-ff30-47e6-9d44-9a283ffa3999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:49.727977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ed8b0-ff30-47e6-9d44-9a283ffa3999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:49.799339 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f7701-9a52-478b-9dcd-37bdb5086f63 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:49.814897 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:50.037418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ed8b0-ff30-47e6-9d44-9a283ffa3999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:50.042541 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ed8b0-ff30-47e6-9d44-9a283ffa3999 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:50.077306 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 870/1716] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:50.078107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ed8b0-ff30-47e6-9d44-9a283ffa3999 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:50.084350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f58ed8b0-ff30-47e6-9d44-9a283ffa3999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:50.130086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17f8ca-d7fa-4ca8-9f85-c0137b7de655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:50.131164 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17f8ca-d7fa-4ca8-9f85-c0137b7de655 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:50.131649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17f8ca-d7fa-4ca8-9f85-c0137b7de655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:50.132194 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17f8ca-d7fa-4ca8-9f85-c0137b7de655 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:50.133120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17f8ca-d7fa-4ca8-9f85-c0137b7de655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:50.149428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17f8ca-d7fa-4ca8-9f85-c0137b7de655 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:50.201730 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 847/1717] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:06:49 2022] POST /identity/v3/users => generated 291 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:50.202658 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17f8ca-d7fa-4ca8-9f85-c0137b7de655 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:50.226297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17f8ca-d7fa-4ca8-9f85-c0137b7de655 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:50.236387 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024639e6-832f-4a8a-ba61-179cfcba2ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:50.237399 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024639e6-832f-4a8a-ba61-179cfcba2ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:50.238879 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024639e6-832f-4a8a-ba61-179cfcba2ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:50.239352 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024639e6-832f-4a8a-ba61-179cfcba2ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:50.244649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024639e6-832f-4a8a-ba61-179cfcba2ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:50.246761 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024639e6-832f-4a8a-ba61-179cfcba2ce2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:50.283712 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 848/1718] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:50.291243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024639e6-832f-4a8a-ba61-179cfcba2ce2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:50.317010 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024639e6-832f-4a8a-ba61-179cfcba2ce2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:50.333717 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ed8b0-ff30-47e6-9d44-9a283ffa3999 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:50.341735 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02602350-9536-4de5-a9b5-a5e90c4fbaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:50.342892 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02602350-9536-4de5-a9b5-a5e90c4fbaea admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:50.344113 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02602350-9536-4de5-a9b5-a5e90c4fbaea admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:50.346196 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02602350-9536-4de5-a9b5-a5e90c4fbaea admin admin] PATH_INFO: `/v3/projects/f19d8710e5054a6c8d65a7cbd7132f90/users/23eb30e574884ae9a83c68b86d269ca7/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:50.346662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63d280-c229-4395-b949-9f2c1015bdb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:50.348351 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63d280-c229-4395-b949-9f2c1015bdb3 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:50.353209 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63d280-c229-4395-b949-9f2c1015bdb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:50.353927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63d280-c229-4395-b949-9f2c1015bdb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:50.371842 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02602350-9536-4de5-a9b5-a5e90c4fbaea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19d8710e5054a6c8d65a7cbd7132f90, user_id=23eb30e574884ae9a83c68b86d269ca7, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:50.375312 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02602350-9536-4de5-a9b5-a5e90c4fbaea admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:50.412845 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 849/1719] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:50 2022] PUT /identity/v3/projects/f19d8710e5054a6c8d65a7cbd7132f90/users/23eb30e574884ae9a83c68b86d269ca7/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:50.414459 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02602350-9536-4de5-a9b5-a5e90c4fbaea admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:50.493552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:50.525483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02602350-9536-4de5-a9b5-a5e90c4fbaea admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:50.534163 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde04cf3-fa01-4c3f-8c46-f4ef26f27007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:50.538567 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde04cf3-fa01-4c3f-8c46-f4ef26f27007 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:50.540198 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63d280-c229-4395-b949-9f2c1015bdb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:50.541314 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde04cf3-fa01-4c3f-8c46-f4ef26f27007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:50.542012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63d280-c229-4395-b949-9f2c1015bdb3 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:50.542848 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde04cf3-fa01-4c3f-8c46-f4ef26f27007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:50.546011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde04cf3-fa01-4c3f-8c46-f4ef26f27007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:50.548854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde04cf3-fa01-4c3f-8c46-f4ef26f27007 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:50.556755 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 871/1720] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:50.569800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 850/1721] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:50.571035 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63d280-c229-4395-b949-9f2c1015bdb3 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:50.593420 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63d280-c229-4395-b949-9f2c1015bdb3 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:50.616598 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963966d-aa70-445a-8cef-531648f6da9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:50.617522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963966d-aa70-445a-8cef-531648f6da9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:50.617808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963966d-aa70-445a-8cef-531648f6da9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:50.618102 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963966d-aa70-445a-8cef-531648f6da9b admin admin] PATH_INFO: `/v3/projects/f19d8710e5054a6c8d65a7cbd7132f90/users/23eb30e574884ae9a83c68b86d269ca7/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:50.624013 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963966d-aa70-445a-8cef-531648f6da9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19d8710e5054a6c8d65a7cbd7132f90, user_id=23eb30e574884ae9a83c68b86d269ca7, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:50.627026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963966d-aa70-445a-8cef-531648f6da9b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:50.664866 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 872/1722] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:50 2022] PUT /identity/v3/projects/f19d8710e5054a6c8d65a7cbd7132f90/users/23eb30e574884ae9a83c68b86d269ca7/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:50.666899 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2527e0-1674-48fe-ab9d-6aeb27741e3a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:50.667197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2527e0-1674-48fe-ab9d-6aeb27741e3a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:50.667555 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2527e0-1674-48fe-ab9d-6aeb27741e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:50.727284 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7b2527e0-1674-48fe-ab9d-6aeb27741e3a None None] MFA Rules not processed for user `23eb30e574884ae9a83c68b86d269ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:50.729425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7b2527e0-1674-48fe-ab9d-6aeb27741e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:50.879737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 851/1723] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:50 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:50.892407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963966d-aa70-445a-8cef-531648f6da9b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:50.896514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7963966d-aa70-445a-8cef-531648f6da9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:51.031906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:51.068600 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963966d-aa70-445a-8cef-531648f6da9b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:51.081085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ca083-34ad-44e7-b792-e7e3077ceb65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:51.090777 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ca083-34ad-44e7-b792-e7e3077ceb65 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:51.091400 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ca083-34ad-44e7-b792-e7e3077ceb65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:51.091921 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ca083-34ad-44e7-b792-e7e3077ceb65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:51.115192 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ca083-34ad-44e7-b792-e7e3077ceb65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:51.118883 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ca083-34ad-44e7-b792-e7e3077ceb65 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:51.154069 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 873/1724] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:50 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:51.511406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21437bc1-afe4-4205-84a7-9eaaf6579634 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:51.512087 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21437bc1-afe4-4205-84a7-9eaaf6579634 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:51.512478 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21437bc1-afe4-4205-84a7-9eaaf6579634 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:51.514340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 852/1725] 10.222.0.41 () {54 vars in 912 bytes} [Mon May 30 12:06:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:51.530309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd868d-aa8d-4e80-bd72-8eeee650a341 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:51.530727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd868d-aa8d-4e80-bd72-8eeee650a341 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:51.530881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd868d-aa8d-4e80-bd72-8eeee650a341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:51.570345 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-67cd868d-aa8d-4e80-bd72-8eeee650a341 None None] MFA Rules not processed for user `ae7bc0d4fd924bfb89f874d1c6fc3d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:51.575771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-67cd868d-aa8d-4e80-bd72-8eeee650a341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:51.748304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 874/1726] 10.222.0.41 () {58 vars in 1009 bytes} [Mon May 30 12:06:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:51.836401 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21437bc1-afe4-4205-84a7-9eaaf6579634 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:51.855399 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21437bc1-afe4-4205-84a7-9eaaf6579634 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:51.893695 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2cf37-4046-4a18-a1e2-2edbc0db40f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:51.897358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2cf37-4046-4a18-a1e2-2edbc0db40f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:51.899737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2cf37-4046-4a18-a1e2-2edbc0db40f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:51.902391 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2cf37-4046-4a18-a1e2-2edbc0db40f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:51.913460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2cf37-4046-4a18-a1e2-2edbc0db40f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:51.915291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2cf37-4046-4a18-a1e2-2edbc0db40f8 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:51.956221 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 853/1727] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:52.355112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd868d-aa8d-4e80-bd72-8eeee650a341 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:52.356636 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-67cd868d-aa8d-4e80-bd72-8eeee650a341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:52.476609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd868d-aa8d-4e80-bd72-8eeee650a341 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:52.484109 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fd3c8-860b-4f51-95e9-2fe96a569cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:52.486148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fd3c8-860b-4f51-95e9-2fe96a569cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:52.486644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fd3c8-860b-4f51-95e9-2fe96a569cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:52.487103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fd3c8-860b-4f51-95e9-2fe96a569cd0 admin admin] PATH_INFO: `/v3/projects/067216e811b44e6d8d11874090c70b5a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:52.489644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00fd3c8-860b-4f51-95e9-2fe96a569cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=067216e811b44e6d8d11874090c70b5a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:52.499016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00fd3c8-860b-4f51-95e9-2fe96a569cd0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:52.619540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d00fd3c8-860b-4f51-95e9-2fe96a569cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067216e811b44e6d8d11874090c70b5a', 'request_id': 'req-d00fd3c8-860b-4f51-95e9-2fe96a569cd0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:52.664296 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d00fd3c8-860b-4f51-95e9-2fe96a569cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067216e811b44e6d8d11874090c70b5a', 'request_id': 'req-d00fd3c8-860b-4f51-95e9-2fe96a569cd0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:52.695057 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d00fd3c8-860b-4f51-95e9-2fe96a569cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067216e811b44e6d8d11874090c70b5a', 'request_id': 'req-d00fd3c8-860b-4f51-95e9-2fe96a569cd0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:52.748694 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d00fd3c8-860b-4f51-95e9-2fe96a569cd0 admin admin] The token cache is being invalidate because project 067216e811b44e6d8d11874090c70b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:06:52.749080 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d00fd3c8-860b-4f51-95e9-2fe96a569cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:52.750295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d00fd3c8-860b-4f51-95e9-2fe96a569cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:52.754498 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 875/1728] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:06:52 2022] DELETE /identity/v3/projects/067216e811b44e6d8d11874090c70b5a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:52.761328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df52311-8f3f-48bc-9417-7bdab0363143 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:52.761925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df52311-8f3f-48bc-9417-7bdab0363143 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:52.762473 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df52311-8f3f-48bc-9417-7bdab0363143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:52.827545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0df52311-8f3f-48bc-9417-7bdab0363143 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:52.829206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0df52311-8f3f-48bc-9417-7bdab0363143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:53.108508 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 854/1729] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:06:53.121938 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3859b-2445-40a0-ae4d-c2962404f92d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:53.122323 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3859b-2445-40a0-ae4d-c2962404f92d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:53.122619 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3859b-2445-40a0-ae4d-c2962404f92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:53.178706 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9be3859b-2445-40a0-ae4d-c2962404f92d None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:53.181412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9be3859b-2445-40a0-ae4d-c2962404f92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:53.231017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 876/1730] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:53.232886 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df52311-8f3f-48bc-9417-7bdab0363143 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:53.263248 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df52311-8f3f-48bc-9417-7bdab0363143 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:53.288559 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fb53b-b90b-4018-9f9b-9326080b9075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:53.289255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fb53b-b90b-4018-9f9b-9326080b9075 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:53.289544 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fb53b-b90b-4018-9f9b-9326080b9075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:53.289836 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fb53b-b90b-4018-9f9b-9326080b9075 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:53.290612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fb53b-b90b-4018-9f9b-9326080b9075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:06:53.290901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fb53b-b90b-4018-9f9b-9326080b9075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:53.310385 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fb53b-b90b-4018-9f9b-9326080b9075 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:53.340073 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2a511-54d0-4749-b741-b262c958d007 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:53.340384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2a511-54d0-4749-b741-b262c958d007 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:53.340967 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2a511-54d0-4749-b741-b262c958d007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:53.418910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 855/1731] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:06:53.419877 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fb53b-b90b-4018-9f9b-9326080b9075 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:53.423786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-99a2a511-54d0-4749-b741-b262c958d007 None None] MFA Rules not processed for user `ae7bc0d4fd924bfb89f874d1c6fc3d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:53.428613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-99a2a511-54d0-4749-b741-b262c958d007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:53.475959 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:53.483781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fb53b-b90b-4018-9f9b-9326080b9075 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:53.535865 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ebca1-d8cc-4b6c-9e44-3bc7f72e2c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:53.542429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ebca1-d8cc-4b6c-9e44-3bc7f72e2c9f admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:53.543755 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ebca1-d8cc-4b6c-9e44-3bc7f72e2c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:53.546184 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ebca1-d8cc-4b6c-9e44-3bc7f72e2c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:53.553988 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ebca1-d8cc-4b6c-9e44-3bc7f72e2c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:53.586025 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ebca1-d8cc-4b6c-9e44-3bc7f72e2c9f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:53.712007 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 877/1732] 10.222.0.66 () {58 vars in 1015 bytes} [Mon May 30 12:06:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:53.726731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 856/1733] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:06:53 2022] POST /identity/v3/projects => generated 371 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:53.741228 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2a511-54d0-4749-b741-b262c958d007 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:53.765610 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2a511-54d0-4749-b741-b262c958d007 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:53.814541 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ebca1-d8cc-4b6c-9e44-3bc7f72e2c9f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:53.816501 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bc8ebca1-d8cc-4b6c-9e44-3bc7f72e2c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:53.944184 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:54.150574 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df60a99-7c20-49d6-872f-ac3ea712bf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:54.151793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df60a99-7c20-49d6-872f-ac3ea712bf0f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:54.155629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df60a99-7c20-49d6-872f-ac3ea712bf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:54.156374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df60a99-7c20-49d6-872f-ac3ea712bf0f admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:54.158285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ebca1-d8cc-4b6c-9e44-3bc7f72e2c9f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:54.161055 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df60a99-7c20-49d6-872f-ac3ea712bf0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:54.164065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df60a99-7c20-49d6-872f-ac3ea712bf0f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:54.178340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165b4ae-9e6c-4e4f-8e07-cd0e24d5cabe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:54.180979 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165b4ae-9e6c-4e4f-8e07-cd0e24d5cabe service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:54.181612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165b4ae-9e6c-4e4f-8e07-cd0e24d5cabe service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:54.183359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165b4ae-9e6c-4e4f-8e07-cd0e24d5cabe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:54.214247 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165b4ae-9e6c-4e4f-8e07-cd0e24d5cabe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:54.217358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165b4ae-9e6c-4e4f-8e07-cd0e24d5cabe service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:54.249027 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 878/1734] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:06:53 2022] POST /identity/v3/users => generated 286 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:54.250019 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df60a99-7c20-49d6-872f-ac3ea712bf0f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:54.251397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 857/1735] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:06:54.275620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df60a99-7c20-49d6-872f-ac3ea712bf0f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:54.311270 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b497a-a7a8-4815-bf1b-373a5fcffa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:54.312435 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b497a-a7a8-4815-bf1b-373a5fcffa45 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:54.315310 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b497a-a7a8-4815-bf1b-373a5fcffa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:54.315636 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b497a-a7a8-4815-bf1b-373a5fcffa45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:54.316567 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b497a-a7a8-4815-bf1b-373a5fcffa45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:54.318525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b497a-a7a8-4815-bf1b-373a5fcffa45 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:54.390006 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165b4ae-9e6c-4e4f-8e07-cd0e24d5cabe service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:54.399421 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 879/1736] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:54.426445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165b4ae-9e6c-4e4f-8e07-cd0e24d5cabe service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:54.433711 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377676ab-4ce4-43c8-9537-16b5f8ac7a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:54.435465 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377676ab-4ce4-43c8-9537-16b5f8ac7a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:54.436019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377676ab-4ce4-43c8-9537-16b5f8ac7a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:54.436440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377676ab-4ce4-43c8-9537-16b5f8ac7a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:54.437333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377676ab-4ce4-43c8-9537-16b5f8ac7a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:54.439181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377676ab-4ce4-43c8-9537-16b5f8ac7a65 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:54.468016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 858/1737] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:54.470655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b497a-a7a8-4815-bf1b-373a5fcffa45 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:54.499630 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b497a-a7a8-4815-bf1b-373a5fcffa45 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:54.526396 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb3c0b-1e46-4aca-bc4c-98265ac76afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:54.527314 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb3c0b-1e46-4aca-bc4c-98265ac76afc admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:54.527604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb3c0b-1e46-4aca-bc4c-98265ac76afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:54.527905 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb3c0b-1e46-4aca-bc4c-98265ac76afc admin admin] PATH_INFO: `/v3/projects/2935932f7cbb4bdf94800586cf2d4d2d/users/36a9c6e32ff14ea380aa1fef801ea4d0/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:54.604159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb3c0b-1e46-4aca-bc4c-98265ac76afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2935932f7cbb4bdf94800586cf2d4d2d, user_id=36a9c6e32ff14ea380aa1fef801ea4d0, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:54.611516 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb3c0b-1e46-4aca-bc4c-98265ac76afc admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:54.706150 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 880/1738] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:54 2022] PUT /identity/v3/projects/2935932f7cbb4bdf94800586cf2d4d2d/users/36a9c6e32ff14ea380aa1fef801ea4d0/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:54.715294 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233df775-219e-4261-a60c-9189c97d6f8c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:54.715294 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233df775-219e-4261-a60c-9189c97d6f8c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:54.715294 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233df775-219e-4261-a60c-9189c97d6f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:54.822399 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-233df775-219e-4261-a60c-9189c97d6f8c None None] MFA Rules not processed for user `36a9c6e32ff14ea380aa1fef801ea4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:54.823645 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-233df775-219e-4261-a60c-9189c97d6f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:55.062615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 859/1739] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:55.069120 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb3c0b-1e46-4aca-bc4c-98265ac76afc admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:55.385758 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb3c0b-1e46-4aca-bc4c-98265ac76afc admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:55.421580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f5c16-3c63-40d8-bfc4-fdec8515570c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:55.422549 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f5c16-3c63-40d8-bfc4-fdec8515570c admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:55.422976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f5c16-3c63-40d8-bfc4-fdec8515570c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:55.423394 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f5c16-3c63-40d8-bfc4-fdec8515570c admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:55.424275 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f5c16-3c63-40d8-bfc4-fdec8515570c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:55.436297 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f5c16-3c63-40d8-bfc4-fdec8515570c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:55.546961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233df775-219e-4261-a60c-9189c97d6f8c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:55.552177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 881/1740] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:06:55 2022] POST /identity/v3/projects => generated 373 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:06:55.576356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233df775-219e-4261-a60c-9189c97d6f8c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:55.780193 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091742d-7967-4d3e-aed8-48ce01aec38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:55.780904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091742d-7967-4d3e-aed8-48ce01aec38f admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:55.781383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091742d-7967-4d3e-aed8-48ce01aec38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:55.782496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091742d-7967-4d3e-aed8-48ce01aec38f admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:55.783388 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091742d-7967-4d3e-aed8-48ce01aec38f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:55.792986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091742d-7967-4d3e-aed8-48ce01aec38f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:55.858650 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f5c16-3c63-40d8-bfc4-fdec8515570c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:55.866978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:55.867232 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 860/1741] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:06:55 2022] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:06:55.873901 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f5c16-3c63-40d8-bfc4-fdec8515570c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:55.917254 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f279a5-24b6-48c3-a786-341f29f0210e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:55.918328 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f279a5-24b6-48c3-a786-341f29f0210e admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:55.918785 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f279a5-24b6-48c3-a786-341f29f0210e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:55.919243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f279a5-24b6-48c3-a786-341f29f0210e admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:55.921956 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f279a5-24b6-48c3-a786-341f29f0210e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:55.926906 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091742d-7967-4d3e-aed8-48ce01aec38f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:55.928947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9091742d-7967-4d3e-aed8-48ce01aec38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:55.940481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f279a5-24b6-48c3-a786-341f29f0210e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:55.965442 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091742d-7967-4d3e-aed8-48ce01aec38f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:56.014498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc340960-3e68-426f-95d4-cbff3551f86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:56.022172 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc340960-3e68-426f-95d4-cbff3551f86e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:56.022934 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc340960-3e68-426f-95d4-cbff3551f86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:56.023708 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc340960-3e68-426f-95d4-cbff3551f86e admin admin] PATH_INFO: `/v3/users/b560c3359c3349ee9232b72bb2202dc7` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:56.034078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc340960-3e68-426f-95d4-cbff3551f86e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b560c3359c3349ee9232b72bb2202dc7)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:56.037741 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc340960-3e68-426f-95d4-cbff3551f86e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:56.038347 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 882/1742] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:06:56.039615 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f279a5-24b6-48c3-a786-341f29f0210e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:56.077616 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f279a5-24b6-48c3-a786-341f29f0210e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:56.109077 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8592f1f-1b7e-4eab-a5f3-302be34d231e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:56.110589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8592f1f-1b7e-4eab-a5f3-302be34d231e admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:56.111085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8592f1f-1b7e-4eab-a5f3-302be34d231e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:56.111569 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8592f1f-1b7e-4eab-a5f3-302be34d231e admin admin] PATH_INFO: `/v3/projects/6f73317e58e943bb8a7a6426323db943/users/9ca9b0d8810b49c19f14d8a98852c6fc/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:56.131369 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:56.163602 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8592f1f-1b7e-4eab-a5f3-302be34d231e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f73317e58e943bb8a7a6426323db943, user_id=9ca9b0d8810b49c19f14d8a98852c6fc, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:56.167803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8592f1f-1b7e-4eab-a5f3-302be34d231e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:56.194823 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bc340960-3e68-426f-95d4-cbff3551f86e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b560c3359c3349ee9232b72bb2202dc7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:56.209845 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bc340960-3e68-426f-95d4-cbff3551f86e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b560c3359c3349ee9232b72bb2202dc7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:56.219851 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 883/1743] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:56 2022] PUT /identity/v3/projects/6f73317e58e943bb8a7a6426323db943/users/9ca9b0d8810b49c19f14d8a98852c6fc/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:56.225653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1254ee7-0512-4dc3-b6a2-9c45bb9589d8 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:56.227125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1254ee7-0512-4dc3-b6a2-9c45bb9589d8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:56.227721 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1254ee7-0512-4dc3-b6a2-9c45bb9589d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:56.281416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bc340960-3e68-426f-95d4-cbff3551f86e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b560c3359c3349ee9232b72bb2202dc7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:56.284387 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bc340960-3e68-426f-95d4-cbff3551f86e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b560c3359c3349ee9232b72bb2202dc7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:56.285158 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e1254ee7-0512-4dc3-b6a2-9c45bb9589d8 None None] MFA Rules not processed for user `5ee1e385f10e4ed4849ef2febc22e497`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:56.286472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e1254ee7-0512-4dc3-b6a2-9c45bb9589d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:56.287236 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bc340960-3e68-426f-95d4-cbff3551f86e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b560c3359c3349ee9232b72bb2202dc7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:56.308608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 861/1744] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:06:55 2022] DELETE /identity/v3/users/b560c3359c3349ee9232b72bb2202dc7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:06:56.309970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc340960-3e68-426f-95d4-cbff3551f86e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:56.313820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bc340960-3e68-426f-95d4-cbff3551f86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:56.483704 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc340960-3e68-426f-95d4-cbff3551f86e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:56.532171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 884/1745] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:56.534302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2ca0d-f1b5-4a4c-86a1-dfcf908f0c02 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:56.535523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2ca0d-f1b5-4a4c-86a1-dfcf908f0c02 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:56.541109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d64382-170d-4f49-af58-d717756d7b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:56.543841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d64382-170d-4f49-af58-d717756d7b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:56.544584 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d64382-170d-4f49-af58-d717756d7b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:56.544926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d64382-170d-4f49-af58-d717756d7b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:56.547649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d64382-170d-4f49-af58-d717756d7b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:56.550321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d64382-170d-4f49-af58-d717756d7b79 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:56.560206 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2ca0d-f1b5-4a4c-86a1-dfcf908f0c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:56.589593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 862/1746] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:06:56.591414 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79265bfb-e66f-469c-97e8-f6559630f141 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:56.591608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79265bfb-e66f-469c-97e8-f6559630f141 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:56.594498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79265bfb-e66f-469c-97e8-f6559630f141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:56.630113 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-79265bfb-e66f-469c-97e8-f6559630f141 None None] MFA Rules not processed for user `9c9292fdef7f41af8fcb9375ce1764e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:56.631655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-79265bfb-e66f-469c-97e8-f6559630f141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:56.660816 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e5c2ca0d-f1b5-4a4c-86a1-dfcf908f0c02 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:56.663598 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e5c2ca0d-f1b5-4a4c-86a1-dfcf908f0c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:56.724252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 885/1747] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:56.736158 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2ca0d-f1b5-4a4c-86a1-dfcf908f0c02 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:56.781447 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2ca0d-f1b5-4a4c-86a1-dfcf908f0c02 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:56.791998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 863/1748] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:56.803370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cd1f7-aef3-4de1-8712-4d1af3b05807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:56.804466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cd1f7-aef3-4de1-8712-4d1af3b05807 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:56.805037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cd1f7-aef3-4de1-8712-4d1af3b05807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:56.805471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cd1f7-aef3-4de1-8712-4d1af3b05807 admin admin] PATH_INFO: `/v3/projects/6f73317e58e943bb8a7a6426323db943/users/9ca9b0d8810b49c19f14d8a98852c6fc/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:56.810573 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79265bfb-e66f-469c-97e8-f6559630f141 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:56.811614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cd1f7-aef3-4de1-8712-4d1af3b05807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f73317e58e943bb8a7a6426323db943, user_id=9ca9b0d8810b49c19f14d8a98852c6fc, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:56.812100 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-79265bfb-e66f-469c-97e8-f6559630f141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:56.819408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cd1f7-aef3-4de1-8712-4d1af3b05807 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:56.886302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 886/1749] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:06:56 2022] PUT /identity/v3/projects/6f73317e58e943bb8a7a6426323db943/users/9ca9b0d8810b49c19f14d8a98852c6fc/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:56.899563 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1a7bd-be16-48b4-a589-930142f0d2ae None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:56.900876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1a7bd-be16-48b4-a589-930142f0d2ae None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:56.904257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1a7bd-be16-48b4-a589-930142f0d2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:57.034837 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:57.058428 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2cf1a7bd-be16-48b4-a589-930142f0d2ae None None] MFA Rules not processed for user `9ca9b0d8810b49c19f14d8a98852c6fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:57.059612 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2cf1a7bd-be16-48b4-a589-930142f0d2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:57.109827 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79265bfb-e66f-469c-97e8-f6559630f141 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:57.379133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e538c67-7c05-4962-ab4f-8b0347e4c8cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:57.380010 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e538c67-7c05-4962-ab4f-8b0347e4c8cb service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:57.380288 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e538c67-7c05-4962-ab4f-8b0347e4c8cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:57.380569 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e538c67-7c05-4962-ab4f-8b0347e4c8cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:57.441962 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 887/1750] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 543 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:57.454769 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1a7bd-be16-48b4-a589-930142f0d2ae None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:57.460077 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2cf1a7bd-be16-48b4-a589-930142f0d2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:57.621018 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:57.650658 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e538c67-7c05-4962-ab4f-8b0347e4c8cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:57.652278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e538c67-7c05-4962-ab4f-8b0347e4c8cb service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:57.703454 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1a7bd-be16-48b4-a589-930142f0d2ae None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:57.723656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0bd84-2c95-421d-8f0a-a99a3c61cd73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:57.724376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0bd84-2c95-421d-8f0a-a99a3c61cd73 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:57.724665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0bd84-2c95-421d-8f0a-a99a3c61cd73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:57.724945 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0bd84-2c95-421d-8f0a-a99a3c61cd73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:57.725460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 864/1751] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 912 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:57.752803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0bd84-2c95-421d-8f0a-a99a3c61cd73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:57.754914 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0bd84-2c95-421d-8f0a-a99a3c61cd73 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:57.793056 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 888/1752] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:58.020019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e538c67-7c05-4962-ab4f-8b0347e4c8cb service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:58.021689 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2e538c67-7c05-4962-ab4f-8b0347e4c8cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:58.046788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e538c67-7c05-4962-ab4f-8b0347e4c8cb service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:58.062845 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e14723-1d22-4baf-9934-54f74bde93a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:58.064055 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e14723-1d22-4baf-9934-54f74bde93a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:58.064486 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e14723-1d22-4baf-9934-54f74bde93a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:58.064908 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e14723-1d22-4baf-9934-54f74bde93a6 admin admin] PATH_INFO: `/v3/users/2a0fede7313347b395451b69c9e3c66b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:58.069426 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e14723-1d22-4baf-9934-54f74bde93a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a0fede7313347b395451b69c9e3c66b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:58.071612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e14723-1d22-4baf-9934-54f74bde93a6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:58.203688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-68e14723-1d22-4baf-9934-54f74bde93a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a0fede7313347b395451b69c9e3c66b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:58.222686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-68e14723-1d22-4baf-9934-54f74bde93a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a0fede7313347b395451b69c9e3c66b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:58.249096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-68e14723-1d22-4baf-9934-54f74bde93a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a0fede7313347b395451b69c9e3c66b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:58.249883 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-68e14723-1d22-4baf-9934-54f74bde93a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a0fede7313347b395451b69c9e3c66b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:58.250626 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-68e14723-1d22-4baf-9934-54f74bde93a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a0fede7313347b395451b69c9e3c66b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:58.278837 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 865/1753] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:06:58 2022] DELETE /identity/v3/users/2a0fede7313347b395451b69c9e3c66b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:06:58.281910 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37755f-7e17-4897-a0ce-d5e3ade8bf10 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:58.282883 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37755f-7e17-4897-a0ce-d5e3ade8bf10 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:58.283386 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37755f-7e17-4897-a0ce-d5e3ade8bf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:58.367148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8d37755f-7e17-4897-a0ce-d5e3ade8bf10 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:58.371587 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8d37755f-7e17-4897-a0ce-d5e3ade8bf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:58.662587 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 889/1754] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:58.801936 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e14723-1d22-4baf-9934-54f74bde93a6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:58.803915 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-68e14723-1d22-4baf-9934-54f74bde93a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:58.896276 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:58.997974 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37755f-7e17-4897-a0ce-d5e3ade8bf10 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:58.999886 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8d37755f-7e17-4897-a0ce-d5e3ade8bf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:59.058477 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37755f-7e17-4897-a0ce-d5e3ade8bf10 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:59.096178 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ad8c1-f4f9-4358-a12a-3bdea51ff2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:59.101165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ad8c1-f4f9-4358-a12a-3bdea51ff2e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:59.104426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ad8c1-f4f9-4358-a12a-3bdea51ff2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:59.106373 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ad8c1-f4f9-4358-a12a-3bdea51ff2e3 admin admin] PATH_INFO: `/v3/users/36a9c6e32ff14ea380aa1fef801ea4d0` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:59.114749 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ad8c1-f4f9-4358-a12a-3bdea51ff2e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a9c6e32ff14ea380aa1fef801ea4d0)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:59.119749 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e14723-1d22-4baf-9934-54f74bde93a6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:59.138439 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ad8c1-f4f9-4358-a12a-3bdea51ff2e3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:59.153952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d09c46-0d34-4a42-9bc5-77680cedf942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:59.155851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d09c46-0d34-4a42-9bc5-77680cedf942 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:59.156252 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d09c46-0d34-4a42-9bc5-77680cedf942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:59.158451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d09c46-0d34-4a42-9bc5-77680cedf942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:59.193702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d09c46-0d34-4a42-9bc5-77680cedf942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:59.205876 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d09c46-0d34-4a42-9bc5-77680cedf942 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:59.255382 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 866/1755] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:59.317147 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c13ad8c1-f4f9-4358-a12a-3bdea51ff2e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a9c6e32ff14ea380aa1fef801ea4d0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:59.337091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c13ad8c1-f4f9-4358-a12a-3bdea51ff2e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a9c6e32ff14ea380aa1fef801ea4d0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:59.369401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c13ad8c1-f4f9-4358-a12a-3bdea51ff2e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a9c6e32ff14ea380aa1fef801ea4d0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:59.372427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c13ad8c1-f4f9-4358-a12a-3bdea51ff2e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a9c6e32ff14ea380aa1fef801ea4d0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:59.403564 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c13ad8c1-f4f9-4358-a12a-3bdea51ff2e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a9c6e32ff14ea380aa1fef801ea4d0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:06:59.429095 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 890/1756] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:06:58 2022] DELETE /identity/v3/users/36a9c6e32ff14ea380aa1fef801ea4d0 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:06:59.434537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7c2e5-52ca-44dd-ba15-d40888454f6f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:59.435683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7c2e5-52ca-44dd-ba15-d40888454f6f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:59.436776 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7c2e5-52ca-44dd-ba15-d40888454f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:59.467514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-64b7c2e5-52ca-44dd-ba15-d40888454f6f None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:59.469399 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-64b7c2e5-52ca-44dd-ba15-d40888454f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:59.572911 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 867/1757] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:59.921911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ad8c1-f4f9-4358-a12a-3bdea51ff2e3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:59.925729 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c13ad8c1-f4f9-4358-a12a-3bdea51ff2e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:00.193140 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ad8c1-f4f9-4358-a12a-3bdea51ff2e3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:00.220225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db9980-1f68-44a8-9a6c-b8a9c2e85c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:00.223353 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db9980-1f68-44a8-9a6c-b8a9c2e85c7f service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:00.224644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db9980-1f68-44a8-9a6c-b8a9c2e85c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:00.226760 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db9980-1f68-44a8-9a6c-b8a9c2e85c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:00.291655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db9980-1f68-44a8-9a6c-b8a9c2e85c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:00.293489 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db9980-1f68-44a8-9a6c-b8a9c2e85c7f service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:00.318343 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:00.329252 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80218315-5751-4f31-9c2e-45be508685d8 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:00.330150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80218315-5751-4f31-9c2e-45be508685d8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:00.334582 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80218315-5751-4f31-9c2e-45be508685d8 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:00.334582 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 868/1758] 10.222.0.41 () {54 vars in 921 bytes} [Mon May 30 12:07:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:00.343368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 891/1759] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:00.357790 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378220e-20d1-41f1-8aff-8944db0972fb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:00.358630 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378220e-20d1-41f1-8aff-8944db0972fb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:00.359157 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378220e-20d1-41f1-8aff-8944db0972fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:00.414315 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e378220e-20d1-41f1-8aff-8944db0972fb None None] MFA Rules not processed for user `bb3820a613744c15b840681fe6b6e808`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:00.419244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e378220e-20d1-41f1-8aff-8944db0972fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:00.552868 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 869/1760] 10.222.0.41 () {58 vars in 1018 bytes} [Mon May 30 12:07:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:00.943967 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db9980-1f68-44a8-9a6c-b8a9c2e85c7f service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:00.943967 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-38db9980-1f68-44a8-9a6c-b8a9c2e85c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:00.974696 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db9980-1f68-44a8-9a6c-b8a9c2e85c7f service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:00.992099 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f04599-76a8-4507-8a4f-d83e7a8f7261 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:00.994212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f04599-76a8-4507-8a4f-d83e7a8f7261 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:00.996171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f04599-76a8-4507-8a4f-d83e7a8f7261 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:00.996502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f04599-76a8-4507-8a4f-d83e7a8f7261 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:01.033287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f04599-76a8-4507-8a4f-d83e7a8f7261 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:01.042851 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f04599-76a8-4507-8a4f-d83e7a8f7261 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:01.107405 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 892/1761] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:01.696913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378220e-20d1-41f1-8aff-8944db0972fb None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:01.698995 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e378220e-20d1-41f1-8aff-8944db0972fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:01.739343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378220e-20d1-41f1-8aff-8944db0972fb None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:01.756489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1269ae-3e69-45e4-abb6-a822c3021901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:01.757455 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1269ae-3e69-45e4-abb6-a822c3021901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:01.757776 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1269ae-3e69-45e4-abb6-a822c3021901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:01.761726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1269ae-3e69-45e4-abb6-a822c3021901 admin admin] PATH_INFO: `/v3/projects/c8a0aece32fa4a40878b4dc26c79c758` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:01.770838 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1269ae-3e69-45e4-abb6-a822c3021901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a0aece32fa4a40878b4dc26c79c758)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:01.776757 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1269ae-3e69-45e4-abb6-a822c3021901 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:01.978610 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:02.000869 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ec1269ae-3e69-45e4-abb6-a822c3021901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a0aece32fa4a40878b4dc26c79c758', 'request_id': 'req-ec1269ae-3e69-45e4-abb6-a822c3021901'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:02.026205 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ec1269ae-3e69-45e4-abb6-a822c3021901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a0aece32fa4a40878b4dc26c79c758', 'request_id': 'req-ec1269ae-3e69-45e4-abb6-a822c3021901'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:02.059395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ec1269ae-3e69-45e4-abb6-a822c3021901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a0aece32fa4a40878b4dc26c79c758', 'request_id': 'req-ec1269ae-3e69-45e4-abb6-a822c3021901'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:02.107111 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ec1269ae-3e69-45e4-abb6-a822c3021901 admin admin] The token cache is being invalidate because project c8a0aece32fa4a40878b4dc26c79c758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:02.111340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ec1269ae-3e69-45e4-abb6-a822c3021901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:02.115243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ec1269ae-3e69-45e4-abb6-a822c3021901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:02.119084 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 870/1762] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:01 2022] DELETE /identity/v3/projects/c8a0aece32fa4a40878b4dc26c79c758 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:02.124527 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f04599-76a8-4507-8a4f-d83e7a8f7261 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:02.143784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f04599-76a8-4507-8a4f-d83e7a8f7261 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:02.372945 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a87ef1-b1e1-48ca-a7be-dc477f6b0c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:02.375927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a87ef1-b1e1-48ca-a7be-dc477f6b0c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:02.380279 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a87ef1-b1e1-48ca-a7be-dc477f6b0c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:02.380766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a87ef1-b1e1-48ca-a7be-dc477f6b0c5c admin admin] PATH_INFO: `/v3/users/26a2e158d7b744528cf1539c18465bfe` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:02.384980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a87ef1-b1e1-48ca-a7be-dc477f6b0c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a2e158d7b744528cf1539c18465bfe)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:02.387107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a87ef1-b1e1-48ca-a7be-dc477f6b0c5c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:02.615873 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-21a87ef1-b1e1-48ca-a7be-dc477f6b0c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a2e158d7b744528cf1539c18465bfe'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:02.642332 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-21a87ef1-b1e1-48ca-a7be-dc477f6b0c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a2e158d7b744528cf1539c18465bfe'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:02.658686 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-21a87ef1-b1e1-48ca-a7be-dc477f6b0c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a2e158d7b744528cf1539c18465bfe'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:02.659557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-21a87ef1-b1e1-48ca-a7be-dc477f6b0c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a2e158d7b744528cf1539c18465bfe'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:02.669922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-21a87ef1-b1e1-48ca-a7be-dc477f6b0c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a2e158d7b744528cf1539c18465bfe'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:02.683009 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 893/1763] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:02 2022] DELETE /identity/v3/users/26a2e158d7b744528cf1539c18465bfe => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:02.688574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1269ae-3e69-45e4-abb6-a822c3021901 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:02.690167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ec1269ae-3e69-45e4-abb6-a822c3021901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:02.718436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1269ae-3e69-45e4-abb6-a822c3021901 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:02.892587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d834f-26d1-4608-b2ff-2c59e558a3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:02.894626 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d834f-26d1-4608-b2ff-2c59e558a3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:02.895109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d834f-26d1-4608-b2ff-2c59e558a3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:02.895522 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d834f-26d1-4608-b2ff-2c59e558a3a8 admin admin] PATH_INFO: `/v3/projects/b0c6acbd08194a038284379017f7eb53` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:02.898174 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d834f-26d1-4608-b2ff-2c59e558a3a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c6acbd08194a038284379017f7eb53)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:02.901659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d834f-26d1-4608-b2ff-2c59e558a3a8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:02.998437 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-474d834f-26d1-4608-b2ff-2c59e558a3a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c6acbd08194a038284379017f7eb53', 'request_id': 'req-474d834f-26d1-4608-b2ff-2c59e558a3a8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:03.022489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-474d834f-26d1-4608-b2ff-2c59e558a3a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c6acbd08194a038284379017f7eb53', 'request_id': 'req-474d834f-26d1-4608-b2ff-2c59e558a3a8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:03.037595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-474d834f-26d1-4608-b2ff-2c59e558a3a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c6acbd08194a038284379017f7eb53', 'request_id': 'req-474d834f-26d1-4608-b2ff-2c59e558a3a8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:03.072104 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-474d834f-26d1-4608-b2ff-2c59e558a3a8 admin admin] The token cache is being invalidate because project b0c6acbd08194a038284379017f7eb53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:03.072417 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-474d834f-26d1-4608-b2ff-2c59e558a3a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:03.073481 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-474d834f-26d1-4608-b2ff-2c59e558a3a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:03.079003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 871/1764] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:02 2022] DELETE /identity/v3/projects/b0c6acbd08194a038284379017f7eb53 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:03.080304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a87ef1-b1e1-48ca-a7be-dc477f6b0c5c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:03.082663 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-21a87ef1-b1e1-48ca-a7be-dc477f6b0c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:03.106287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a87ef1-b1e1-48ca-a7be-dc477f6b0c5c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:03.198294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20305eb-a7b6-4811-8efb-a0a3f2c941c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:03.199995 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20305eb-a7b6-4811-8efb-a0a3f2c941c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:03.200488 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20305eb-a7b6-4811-8efb-a0a3f2c941c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:03.200917 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20305eb-a7b6-4811-8efb-a0a3f2c941c6 admin admin] PATH_INFO: `/v3/users/23eb30e574884ae9a83c68b86d269ca7` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:03.202342 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20305eb-a7b6-4811-8efb-a0a3f2c941c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23eb30e574884ae9a83c68b86d269ca7)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:03.204556 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20305eb-a7b6-4811-8efb-a0a3f2c941c6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:03.211251 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:03.324969 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b20305eb-a7b6-4811-8efb-a0a3f2c941c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23eb30e574884ae9a83c68b86d269ca7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:03.352486 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b20305eb-a7b6-4811-8efb-a0a3f2c941c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23eb30e574884ae9a83c68b86d269ca7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:03.403644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b20305eb-a7b6-4811-8efb-a0a3f2c941c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23eb30e574884ae9a83c68b86d269ca7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:03.409046 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b20305eb-a7b6-4811-8efb-a0a3f2c941c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23eb30e574884ae9a83c68b86d269ca7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:03.461218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b20305eb-a7b6-4811-8efb-a0a3f2c941c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23eb30e574884ae9a83c68b86d269ca7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:03.491343 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 894/1765] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:03 2022] DELETE /identity/v3/users/23eb30e574884ae9a83c68b86d269ca7 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:04.636045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d834f-26d1-4608-b2ff-2c59e558a3a8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:04.638240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-474d834f-26d1-4608-b2ff-2c59e558a3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:04.662727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20305eb-a7b6-4811-8efb-a0a3f2c941c6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:04.664682 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b20305eb-a7b6-4811-8efb-a0a3f2c941c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:04.666499 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d834f-26d1-4608-b2ff-2c59e558a3a8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:04.828629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532673da-5e23-401c-8b43-81ac8c59c40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:04.829686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532673da-5e23-401c-8b43-81ac8c59c40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:04.830251 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532673da-5e23-401c-8b43-81ac8c59c40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:04.830829 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532673da-5e23-401c-8b43-81ac8c59c40b admin admin] PATH_INFO: `/v3/projects/6a6bb751f4ba45f29d3fe7aae2a5da27` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:04.834324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532673da-5e23-401c-8b43-81ac8c59c40b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a6bb751f4ba45f29d3fe7aae2a5da27)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:04.836645 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532673da-5e23-401c-8b43-81ac8c59c40b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:04.867366 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20305eb-a7b6-4811-8efb-a0a3f2c941c6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:04.871898 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:04.879669 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244106e-b322-4e65-8277-66e731dde4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:04.881490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244106e-b322-4e65-8277-66e731dde4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:04.887677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244106e-b322-4e65-8277-66e731dde4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:04.888416 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244106e-b322-4e65-8277-66e731dde4ff admin admin] PATH_INFO: `/v3/projects/2935932f7cbb4bdf94800586cf2d4d2d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:04.914444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244106e-b322-4e65-8277-66e731dde4ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2935932f7cbb4bdf94800586cf2d4d2d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:04.918561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244106e-b322-4e65-8277-66e731dde4ff admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:04.990786 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-532673da-5e23-401c-8b43-81ac8c59c40b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a6bb751f4ba45f29d3fe7aae2a5da27', 'request_id': 'req-532673da-5e23-401c-8b43-81ac8c59c40b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:05.008773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-532673da-5e23-401c-8b43-81ac8c59c40b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a6bb751f4ba45f29d3fe7aae2a5da27', 'request_id': 'req-532673da-5e23-401c-8b43-81ac8c59c40b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:05.019316 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-532673da-5e23-401c-8b43-81ac8c59c40b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a6bb751f4ba45f29d3fe7aae2a5da27', 'request_id': 'req-532673da-5e23-401c-8b43-81ac8c59c40b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:05.041393 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3244106e-b322-4e65-8277-66e731dde4ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2935932f7cbb4bdf94800586cf2d4d2d', 'request_id': 'req-3244106e-b322-4e65-8277-66e731dde4ff'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:05.049384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3244106e-b322-4e65-8277-66e731dde4ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2935932f7cbb4bdf94800586cf2d4d2d', 'request_id': 'req-3244106e-b322-4e65-8277-66e731dde4ff'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:05.052814 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-532673da-5e23-401c-8b43-81ac8c59c40b admin admin] The token cache is being invalidate because project 6a6bb751f4ba45f29d3fe7aae2a5da27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:05.053113 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-532673da-5e23-401c-8b43-81ac8c59c40b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:05.058393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-532673da-5e23-401c-8b43-81ac8c59c40b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:05.058847 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3244106e-b322-4e65-8277-66e731dde4ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2935932f7cbb4bdf94800586cf2d4d2d', 'request_id': 'req-3244106e-b322-4e65-8277-66e731dde4ff'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:05.060576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 872/1766] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:04 2022] DELETE /identity/v3/projects/6a6bb751f4ba45f29d3fe7aae2a5da27 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:05.067619 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020cda6-6691-4944-b9f4-553576b66c5c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:05.068116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020cda6-6691-4944-b9f4-553576b66c5c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:05.068514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020cda6-6691-4944-b9f4-553576b66c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:05.076073 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3244106e-b322-4e65-8277-66e731dde4ff admin admin] The token cache is being invalidate because project 2935932f7cbb4bdf94800586cf2d4d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:05.076615 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3244106e-b322-4e65-8277-66e731dde4ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:05.078005 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3244106e-b322-4e65-8277-66e731dde4ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:05.080113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 895/1767] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:04 2022] DELETE /identity/v3/projects/2935932f7cbb4bdf94800586cf2d4d2d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:05.085165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244106e-b322-4e65-8277-66e731dde4ff admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:05.086930 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3244106e-b322-4e65-8277-66e731dde4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:05.095959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7020cda6-6691-4944-b9f4-553576b66c5c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:05.102119 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7020cda6-6691-4944-b9f4-553576b66c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:05.121560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:05.225274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 873/1768] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:07:05.236926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f077463-0ec1-4b14-a312-f3fb93121b35 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:05.237379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f077463-0ec1-4b14-a312-f3fb93121b35 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:05.238779 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f077463-0ec1-4b14-a312-f3fb93121b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:05.239457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244106e-b322-4e65-8277-66e731dde4ff admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:05.244493 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432b5bd-c8ec-4b12-9ee9-dd342660d980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:05.245372 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432b5bd-c8ec-4b12-9ee9-dd342660d980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:05.245652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432b5bd-c8ec-4b12-9ee9-dd342660d980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:05.245944 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432b5bd-c8ec-4b12-9ee9-dd342660d980 admin admin] PATH_INFO: `/v3/users/9ca9b0d8810b49c19f14d8a98852c6fc` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:05.247147 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432b5bd-c8ec-4b12-9ee9-dd342660d980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca9b0d8810b49c19f14d8a98852c6fc)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:05.249102 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432b5bd-c8ec-4b12-9ee9-dd342660d980 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:05.274708 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5f077463-0ec1-4b14-a312-f3fb93121b35 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:05.275636 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5f077463-0ec1-4b14-a312-f3fb93121b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:05.285033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 874/1769] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:05.289122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f077463-0ec1-4b14-a312-f3fb93121b35 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:05.305084 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f077463-0ec1-4b14-a312-f3fb93121b35 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:05.314107 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af45f94-b74d-4695-8727-e3384bd27ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:05.314799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af45f94-b74d-4695-8727-e3384bd27ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:05.315093 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af45f94-b74d-4695-8727-e3384bd27ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:05.315479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af45f94-b74d-4695-8727-e3384bd27ff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:05.316231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af45f94-b74d-4695-8727-e3384bd27ff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:07:05.316546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af45f94-b74d-4695-8727-e3384bd27ff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:05.318218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af45f94-b74d-4695-8727-e3384bd27ff2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:05.326586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7432b5bd-c8ec-4b12-9ee9-dd342660d980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca9b0d8810b49c19f14d8a98852c6fc'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:05.333471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 875/1770] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:07:05.336957 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af45f94-b74d-4695-8727-e3384bd27ff2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:05.339203 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7432b5bd-c8ec-4b12-9ee9-dd342660d980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca9b0d8810b49c19f14d8a98852c6fc'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:05.351763 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af45f94-b74d-4695-8727-e3384bd27ff2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:05.356394 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7432b5bd-c8ec-4b12-9ee9-dd342660d980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca9b0d8810b49c19f14d8a98852c6fc'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:05.357143 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb309194-616d-47e5-b359-6edd2c1dac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:05.357508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7432b5bd-c8ec-4b12-9ee9-dd342660d980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca9b0d8810b49c19f14d8a98852c6fc'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:05.357960 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb309194-616d-47e5-b359-6edd2c1dac20 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:05.358446 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb309194-616d-47e5-b359-6edd2c1dac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:05.358747 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb309194-616d-47e5-b359-6edd2c1dac20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:05.359862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb309194-616d-47e5-b359-6edd2c1dac20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:05.361914 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb309194-616d-47e5-b359-6edd2c1dac20 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:05.371341 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7432b5bd-c8ec-4b12-9ee9-dd342660d980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca9b0d8810b49c19f14d8a98852c6fc'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:05.381786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 896/1771] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:05 2022] DELETE /identity/v3/users/9ca9b0d8810b49c19f14d8a98852c6fc => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:05.411434 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 876/1772] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:05 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:05.412626 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432b5bd-c8ec-4b12-9ee9-dd342660d980 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:05.414210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7432b5bd-c8ec-4b12-9ee9-dd342660d980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:05.536767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432b5bd-c8ec-4b12-9ee9-dd342660d980 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:05.662912 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:05.694874 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800887f-af59-4b9b-b937-8ea3ca482aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:05.695741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800887f-af59-4b9b-b937-8ea3ca482aad admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:05.696295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800887f-af59-4b9b-b937-8ea3ca482aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:05.696586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800887f-af59-4b9b-b937-8ea3ca482aad admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:05.697582 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800887f-af59-4b9b-b937-8ea3ca482aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:05.700048 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800887f-af59-4b9b-b937-8ea3ca482aad admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:05.725819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a637e8-666a-4492-80c9-91145650546b None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:05.727314 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a637e8-666a-4492-80c9-91145650546b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:05.728746 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a637e8-666a-4492-80c9-91145650546b None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:05.733506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 877/1773] 10.222.0.41 () {54 vars in 921 bytes} [Mon May 30 12:07:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:05.744656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 897/1774] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:05 2022] POST /identity/v3/users => generated 292 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:05.749641 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a637e8-666a-4492-80c9-91145650546b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:05.765725 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1c703-9888-4899-9d97-b14a627e807a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:05.767697 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1c703-9888-4899-9d97-b14a627e807a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:05.770212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1c703-9888-4899-9d97-b14a627e807a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:05.775950 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a637e8-666a-4492-80c9-91145650546b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:05.790532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5afaca-a4c2-403e-8311-60d01c98374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:05.791941 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5afaca-a4c2-403e-8311-60d01c98374d admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:05.792382 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5afaca-a4c2-403e-8311-60d01c98374d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:05.792826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5afaca-a4c2-403e-8311-60d01c98374d admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:05.794601 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5afaca-a4c2-403e-8311-60d01c98374d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:05.802938 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-59b1c703-9888-4899-9d97-b14a627e807a None None] MFA Rules not processed for user `bb3820a613744c15b840681fe6b6e808`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:05.804996 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-59b1c703-9888-4899-9d97-b14a627e807a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:05.809323 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5afaca-a4c2-403e-8311-60d01c98374d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:05.843387 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 878/1775] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:07:05.847702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5afaca-a4c2-403e-8311-60d01c98374d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:05.864353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5afaca-a4c2-403e-8311-60d01c98374d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:05.871356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f50ff-218d-4eb6-a944-75bb4a6451e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:05.872823 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f50ff-218d-4eb6-a944-75bb4a6451e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:05.873232 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f50ff-218d-4eb6-a944-75bb4a6451e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:05.874389 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f50ff-218d-4eb6-a944-75bb4a6451e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:05.875239 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f50ff-218d-4eb6-a944-75bb4a6451e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:05.878070 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f50ff-218d-4eb6-a944-75bb4a6451e4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:05.895647 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 879/1776] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:07:05.896692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f50ff-218d-4eb6-a944-75bb4a6451e4 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:05.908528 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f50ff-218d-4eb6-a944-75bb4a6451e4 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:05.915193 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacedd8-bcda-402e-bb02-50de1ea16110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:05.916572 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacedd8-bcda-402e-bb02-50de1ea16110 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:05.917075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacedd8-bcda-402e-bb02-50de1ea16110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:05.917630 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacedd8-bcda-402e-bb02-50de1ea16110 admin admin] PATH_INFO: `/v3/projects/c36e7772e3c84ddd9ebfb2e3103b276b/users/7486dfb9b208449c964917a8a0042c22/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:05.944397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacedd8-bcda-402e-bb02-50de1ea16110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c36e7772e3c84ddd9ebfb2e3103b276b, user_id=7486dfb9b208449c964917a8a0042c22, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:05.948844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacedd8-bcda-402e-bb02-50de1ea16110 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:05.966535 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 880/1777] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:05 2022] PUT /identity/v3/projects/c36e7772e3c84ddd9ebfb2e3103b276b/users/7486dfb9b208449c964917a8a0042c22/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:05.975687 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 898/1778] 10.222.0.41 () {58 vars in 1018 bytes} [Mon May 30 12:07:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:05.975687 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1c703-9888-4899-9d97-b14a627e807a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:05.978833 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7ff72-d3c0-452f-b57b-4a50f630832f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:05.979284 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7ff72-d3c0-452f-b57b-4a50f630832f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:05.979764 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7ff72-d3c0-452f-b57b-4a50f630832f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:05.980531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-59b1c703-9888-4899-9d97-b14a627e807a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:06.001968 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1c703-9888-4899-9d97-b14a627e807a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:06.005679 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:06.021261 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4fd7ff72-d3c0-452f-b57b-4a50f630832f None None] MFA Rules not processed for user `7486dfb9b208449c964917a8a0042c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:06.023295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4fd7ff72-d3c0-452f-b57b-4a50f630832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:06.120358 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0beef31-1bdc-4f3a-a3c3-1f9c5974e063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:06.121214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0beef31-1bdc-4f3a-a3c3-1f9c5974e063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:06.121501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0beef31-1bdc-4f3a-a3c3-1f9c5974e063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:06.121785 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0beef31-1bdc-4f3a-a3c3-1f9c5974e063 admin admin] PATH_INFO: `/v3/projects/6f73317e58e943bb8a7a6426323db943` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:06.123046 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0beef31-1bdc-4f3a-a3c3-1f9c5974e063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f73317e58e943bb8a7a6426323db943)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:06.125159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0beef31-1bdc-4f3a-a3c3-1f9c5974e063 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:06.140870 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 881/1779] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:06.142048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7ff72-d3c0-452f-b57b-4a50f630832f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:06.143418 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4fd7ff72-d3c0-452f-b57b-4a50f630832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:06.160202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7ff72-d3c0-452f-b57b-4a50f630832f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:06.166758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c9460-9956-41c7-b3f9-5f15e6bcf83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:06.167771 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c9460-9956-41c7-b3f9-5f15e6bcf83e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:06.168088 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c9460-9956-41c7-b3f9-5f15e6bcf83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:06.168783 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c9460-9956-41c7-b3f9-5f15e6bcf83e admin admin] PATH_INFO: `/v3/projects/f19d8710e5054a6c8d65a7cbd7132f90` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:06.169625 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c9460-9956-41c7-b3f9-5f15e6bcf83e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19d8710e5054a6c8d65a7cbd7132f90)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:06.171566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c9460-9956-41c7-b3f9-5f15e6bcf83e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:06.201669 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a0beef31-1bdc-4f3a-a3c3-1f9c5974e063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f73317e58e943bb8a7a6426323db943', 'request_id': 'req-a0beef31-1bdc-4f3a-a3c3-1f9c5974e063'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:06.224816 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a0beef31-1bdc-4f3a-a3c3-1f9c5974e063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f73317e58e943bb8a7a6426323db943', 'request_id': 'req-a0beef31-1bdc-4f3a-a3c3-1f9c5974e063'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:06.229867 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2a4c9460-9956-41c7-b3f9-5f15e6bcf83e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19d8710e5054a6c8d65a7cbd7132f90', 'request_id': 'req-2a4c9460-9956-41c7-b3f9-5f15e6bcf83e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:06.236341 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a0beef31-1bdc-4f3a-a3c3-1f9c5974e063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f73317e58e943bb8a7a6426323db943', 'request_id': 'req-a0beef31-1bdc-4f3a-a3c3-1f9c5974e063'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:06.240617 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:06.240857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2a4c9460-9956-41c7-b3f9-5f15e6bcf83e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19d8710e5054a6c8d65a7cbd7132f90', 'request_id': 'req-2a4c9460-9956-41c7-b3f9-5f15e6bcf83e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:06.250160 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2a4c9460-9956-41c7-b3f9-5f15e6bcf83e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19d8710e5054a6c8d65a7cbd7132f90', 'request_id': 'req-2a4c9460-9956-41c7-b3f9-5f15e6bcf83e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:06.261647 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a0beef31-1bdc-4f3a-a3c3-1f9c5974e063 admin admin] The token cache is being invalidate because project 6f73317e58e943bb8a7a6426323db943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:06.262243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a0beef31-1bdc-4f3a-a3c3-1f9c5974e063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:06.262839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2a4c9460-9956-41c7-b3f9-5f15e6bcf83e admin admin] The token cache is being invalidate because project f19d8710e5054a6c8d65a7cbd7132f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:06.263140 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2a4c9460-9956-41c7-b3f9-5f15e6bcf83e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:06.263586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a0beef31-1bdc-4f3a-a3c3-1f9c5974e063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:06.263806 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2a4c9460-9956-41c7-b3f9-5f15e6bcf83e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:06.265940 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 882/1781] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:06 2022] DELETE /identity/v3/projects/f19d8710e5054a6c8d65a7cbd7132f90 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:06.266139 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 899/1781] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:05 2022] DELETE /identity/v3/projects/6f73317e58e943bb8a7a6426323db943 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:06.266644 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c9460-9956-41c7-b3f9-5f15e6bcf83e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:06.267430 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0beef31-1bdc-4f3a-a3c3-1f9c5974e063 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:06.268209 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2a4c9460-9956-41c7-b3f9-5f15e6bcf83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:06.269987 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a0beef31-1bdc-4f3a-a3c3-1f9c5974e063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:06.363420 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c9460-9956-41c7-b3f9-5f15e6bcf83e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:06.363981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0beef31-1bdc-4f3a-a3c3-1f9c5974e063 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:06.369433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e665a-668c-477a-9806-6af7c4152e33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:06.370152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e665a-668c-477a-9806-6af7c4152e33 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:06.370438 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e665a-668c-477a-9806-6af7c4152e33 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:06.370871 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e665a-668c-477a-9806-6af7c4152e33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:06.373259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3b7e665a-668c-477a-9806-6af7c4152e33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:06.387866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e665a-668c-477a-9806-6af7c4152e33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:06.389879 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e665a-668c-477a-9806-6af7c4152e33 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:06.417275 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 883/1782] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:06.418808 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b33097-c021-4483-a6d9-70eb293954f3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:06.421202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b33097-c021-4483-a6d9-70eb293954f3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:06.421503 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b33097-c021-4483-a6d9-70eb293954f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:06.451740 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32631e49-9c85-4f24-8d57-2b4569c6ce32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:06.452723 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:06.456989 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32631e49-9c85-4f24-8d57-2b4569c6ce32 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:06.457612 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32631e49-9c85-4f24-8d57-2b4569c6ce32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:06.460055 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32631e49-9c85-4f24-8d57-2b4569c6ce32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:06.460827 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-27b33097-c021-4483-a6d9-70eb293954f3 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:06.462469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32631e49-9c85-4f24-8d57-2b4569c6ce32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:06.465944 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32631e49-9c85-4f24-8d57-2b4569c6ce32 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:06.488686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-27b33097-c021-4483-a6d9-70eb293954f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:06.508952 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 900/1783] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:06 2022] POST /identity/v3/projects => generated 381 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:06.510223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc3ae-c5e6-43c5-91be-6a9f5da83292 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:06.510570 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc3ae-c5e6-43c5-91be-6a9f5da83292 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:06.510905 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc3ae-c5e6-43c5-91be-6a9f5da83292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:06.515623 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 884/1784] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:06.518199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b33097-c021-4483-a6d9-70eb293954f3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:06.539388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b2adc3ae-c5e6-43c5-91be-6a9f5da83292 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:06.541157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b2adc3ae-c5e6-43c5-91be-6a9f5da83292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:06.547783 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b33097-c021-4483-a6d9-70eb293954f3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:06.624592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b0a42-7a50-4d38-a25d-001e018fc97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:06.625295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b0a42-7a50-4d38-a25d-001e018fc97d admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:06.625586 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b0a42-7a50-4d38-a25d-001e018fc97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:06.625871 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b0a42-7a50-4d38-a25d-001e018fc97d admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:06.626584 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b0a42-7a50-4d38-a25d-001e018fc97d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:06.629400 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b0a42-7a50-4d38-a25d-001e018fc97d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:06.668632 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 885/1785] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:06 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:06.669956 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f2f1c-4489-4f5c-95ae-df8e48257f2b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:06.670878 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f2f1c-4489-4f5c-95ae-df8e48257f2b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:06.671177 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f2f1c-4489-4f5c-95ae-df8e48257f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:06.701649 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 901/1786] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:06.713840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adc3ae-c5e6-43c5-91be-6a9f5da83292 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:06.719594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b04f2f1c-4489-4f5c-95ae-df8e48257f2b None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:06.723428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b04f2f1c-4489-4f5c-95ae-df8e48257f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:06.725304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adc3ae-c5e6-43c5-91be-6a9f5da83292 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:06.730513 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea95560-c5f4-4f25-8ffc-463ed75a43ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:06.731479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea95560-c5f4-4f25-8ffc-463ed75a43ae admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:06.731990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea95560-c5f4-4f25-8ffc-463ed75a43ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:06.732451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea95560-c5f4-4f25-8ffc-463ed75a43ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:06.733394 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea95560-c5f4-4f25-8ffc-463ed75a43ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:06.736139 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea95560-c5f4-4f25-8ffc-463ed75a43ae admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:06.747890 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 902/1787] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:06.749176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196493a1-a2f8-4531-8e6b-950d699bab07 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:06.749473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196493a1-a2f8-4531-8e6b-950d699bab07 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:06.749756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196493a1-a2f8-4531-8e6b-950d699bab07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:06.766408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 886/1788] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:06.769623 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f2f1c-4489-4f5c-95ae-df8e48257f2b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:06.772540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-196493a1-a2f8-4531-8e6b-950d699bab07 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:06.773784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-196493a1-a2f8-4531-8e6b-950d699bab07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:06.783804 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 903/1789] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:06.785612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f2f1c-4489-4f5c-95ae-df8e48257f2b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:06.785735 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196493a1-a2f8-4531-8e6b-950d699bab07 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:06.791875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaae30c-be07-463a-962b-53529ed679b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:06.792787 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaae30c-be07-463a-962b-53529ed679b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:06.793075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaae30c-be07-463a-962b-53529ed679b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:06.793359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaae30c-be07-463a-962b-53529ed679b7 admin admin] PATH_INFO: `/v3/projects/35941a8d41614229a24d608eea150689/users/655f6377b0704d5c8c2f9481e6cfc5ef/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:06.797699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196493a1-a2f8-4531-8e6b-950d699bab07 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:06.803886 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421b511-2d92-4426-a8bf-f4c68810580e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:06.804715 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421b511-2d92-4426-a8bf-f4c68810580e admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:06.805121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421b511-2d92-4426-a8bf-f4c68810580e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:06.805501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421b511-2d92-4426-a8bf-f4c68810580e admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:06.806471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421b511-2d92-4426-a8bf-f4c68810580e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:07:06.806881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421b511-2d92-4426-a8bf-f4c68810580e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:06.808710 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421b511-2d92-4426-a8bf-f4c68810580e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:06.811007 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:06.823784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 904/1790] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:07:06.825124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421b511-2d92-4426-a8bf-f4c68810580e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:06.836654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421b511-2d92-4426-a8bf-f4c68810580e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:06.838655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaae30c-be07-463a-962b-53529ed679b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35941a8d41614229a24d608eea150689, user_id=655f6377b0704d5c8c2f9481e6cfc5ef, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:06.842290 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaae30c-be07-463a-962b-53529ed679b7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:06.842914 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43636a-6f71-438e-9052-b4dfec62747a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:06.843985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43636a-6f71-438e-9052-b4dfec62747a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:06.844379 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43636a-6f71-438e-9052-b4dfec62747a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:06.844817 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43636a-6f71-438e-9052-b4dfec62747a admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:06.845912 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43636a-6f71-438e-9052-b4dfec62747a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:07:06.845912 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43636a-6f71-438e-9052-b4dfec62747a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:06.847783 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43636a-6f71-438e-9052-b4dfec62747a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:06.858370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 887/1791] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:06 2022] PUT /identity/v3/projects/35941a8d41614229a24d608eea150689/users/655f6377b0704d5c8c2f9481e6cfc5ef/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:06.862703 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaae30c-be07-463a-962b-53529ed679b7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:06.902191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 905/1792] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:07:06.903972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43636a-6f71-438e-9052-b4dfec62747a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:06.936940 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43636a-6f71-438e-9052-b4dfec62747a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:06.948456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaae30c-be07-463a-962b-53529ed679b7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:06.953292 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff74df-f7cf-4616-aef5-0d8d4a371aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:06.954080 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff74df-f7cf-4616-aef5-0d8d4a371aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:06.954220 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501b3ce-bfac-4502-b682-f1416f0f4aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:06.954370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff74df-f7cf-4616-aef5-0d8d4a371aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:06.954652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff74df-f7cf-4616-aef5-0d8d4a371aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:06.955301 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501b3ce-bfac-4502-b682-f1416f0f4aec admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:06.955698 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501b3ce-bfac-4502-b682-f1416f0f4aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:06.956748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501b3ce-bfac-4502-b682-f1416f0f4aec admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:06.957690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501b3ce-bfac-4502-b682-f1416f0f4aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:06.958205 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff74df-f7cf-4616-aef5-0d8d4a371aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:06.959921 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501b3ce-bfac-4502-b682-f1416f0f4aec admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:06.960502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff74df-f7cf-4616-aef5-0d8d4a371aa8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:06.982504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 906/1793] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:06.983363 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff74df-f7cf-4616-aef5-0d8d4a371aa8 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:07.004863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 888/1794] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:06 2022] POST /identity/v3/projects => generated 369 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:07.006025 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501b3ce-bfac-4502-b682-f1416f0f4aec admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:07.010846 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff74df-f7cf-4616-aef5-0d8d4a371aa8 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:07.111147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:07.152873 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222aaf75-621c-4e84-a1b6-391ee9a77732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:07.153696 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aaf75-621c-4e84-a1b6-391ee9a77732 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:07.153994 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aaf75-621c-4e84-a1b6-391ee9a77732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:07.154270 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aaf75-621c-4e84-a1b6-391ee9a77732 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:07.154978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222aaf75-621c-4e84-a1b6-391ee9a77732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:07.159609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222aaf75-621c-4e84-a1b6-391ee9a77732 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:07.161380 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501b3ce-bfac-4502-b682-f1416f0f4aec admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:07.172632 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcf290-e32d-41a4-b221-6a8413ada67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:07.173540 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcf290-e32d-41a4-b221-6a8413ada67f admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:07.173821 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcf290-e32d-41a4-b221-6a8413ada67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:07.174093 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcf290-e32d-41a4-b221-6a8413ada67f admin admin] PATH_INFO: `/v3/projects/35941a8d41614229a24d608eea150689/users/655f6377b0704d5c8c2f9481e6cfc5ef/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:07.179757 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcf290-e32d-41a4-b221-6a8413ada67f admin admin] RBAC: Authorizing `identity:create_grant(project_id=35941a8d41614229a24d608eea150689, user_id=655f6377b0704d5c8c2f9481e6cfc5ef, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:07.184826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcf290-e32d-41a4-b221-6a8413ada67f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:07.214366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 889/1795] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:07 2022] PUT /identity/v3/projects/35941a8d41614229a24d608eea150689/users/655f6377b0704d5c8c2f9481e6cfc5ef/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:07.214366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcf290-e32d-41a4-b221-6a8413ada67f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:07.223540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 907/1796] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:06 2022] POST /identity/v3/projects => generated 365 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:07.231399 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688c4a8-9cad-4d83-aae6-26cb036d1187 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:07.232440 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688c4a8-9cad-4d83-aae6-26cb036d1187 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:07.234335 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688c4a8-9cad-4d83-aae6-26cb036d1187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:07.307195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6688c4a8-9cad-4d83-aae6-26cb036d1187 None None] MFA Rules not processed for user `655f6377b0704d5c8c2f9481e6cfc5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:07.309871 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6688c4a8-9cad-4d83-aae6-26cb036d1187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:07.337129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcf290-e32d-41a4-b221-6a8413ada67f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:07.415794 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 908/1797] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:07.425822 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688c4a8-9cad-4d83-aae6-26cb036d1187 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:07.437047 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84e831-6cd2-4046-84f7-4cba29e64efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:07.437738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84e831-6cd2-4046-84f7-4cba29e64efc admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:07.438028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84e831-6cd2-4046-84f7-4cba29e64efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:07.438480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84e831-6cd2-4046-84f7-4cba29e64efc admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:07.439197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84e831-6cd2-4046-84f7-4cba29e64efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:07.443193 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84e831-6cd2-4046-84f7-4cba29e64efc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:07.446698 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688c4a8-9cad-4d83-aae6-26cb036d1187 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:07.454480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd9053-86ce-4a3e-bb0b-e55a42281d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:07.455666 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd9053-86ce-4a3e-bb0b-e55a42281d58 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:07.456935 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd9053-86ce-4a3e-bb0b-e55a42281d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:07.457643 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd9053-86ce-4a3e-bb0b-e55a42281d58 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:07.458982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd9053-86ce-4a3e-bb0b-e55a42281d58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:07.461802 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd9053-86ce-4a3e-bb0b-e55a42281d58 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:07.475030 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 890/1798] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:07 2022] POST /identity/v3/users => generated 285 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:07.476537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84e831-6cd2-4046-84f7-4cba29e64efc admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:07.478427 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8e84e831-6cd2-4046-84f7-4cba29e64efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:07.499036 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 909/1799] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:07 2022] POST /identity/v3/users => generated 283 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:07.500781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd9053-86ce-4a3e-bb0b-e55a42281d58 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:07.516202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd9053-86ce-4a3e-bb0b-e55a42281d58 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:07.523474 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a6af7-1e20-411c-ba62-b0210147fd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:07.524293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a6af7-1e20-411c-ba62-b0210147fd47 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:07.524650 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a6af7-1e20-411c-ba62-b0210147fd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:07.525005 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a6af7-1e20-411c-ba62-b0210147fd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:07.525829 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a6af7-1e20-411c-ba62-b0210147fd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:07.528610 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a6af7-1e20-411c-ba62-b0210147fd47 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:07.550415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 910/1800] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:07.551626 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a6af7-1e20-411c-ba62-b0210147fd47 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:07.565776 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a6af7-1e20-411c-ba62-b0210147fd47 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:07.572268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be14527-7415-45d6-aca5-76de133741e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:07.572971 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be14527-7415-45d6-aca5-76de133741e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:07.573255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be14527-7415-45d6-aca5-76de133741e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:07.573556 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be14527-7415-45d6-aca5-76de133741e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:07.574467 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be14527-7415-45d6-aca5-76de133741e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:07.575962 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be14527-7415-45d6-aca5-76de133741e5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:07.582211 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84e831-6cd2-4046-84f7-4cba29e64efc admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:07.585048 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:07.594077 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71724137-96a9-4138-92b5-58b944e54924 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:07.594762 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71724137-96a9-4138-92b5-58b944e54924 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:07.595059 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71724137-96a9-4138-92b5-58b944e54924 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:07.595340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71724137-96a9-4138-92b5-58b944e54924 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:07.596446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 911/1801] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:07.599999 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be14527-7415-45d6-aca5-76de133741e5 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:07.608378 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71724137-96a9-4138-92b5-58b944e54924 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:07.610371 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71724137-96a9-4138-92b5-58b944e54924 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:07.611320 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be14527-7415-45d6-aca5-76de133741e5 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:07.619837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffe0de-88c8-4c0a-9338-118812348f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:07.620541 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffe0de-88c8-4c0a-9338-118812348f75 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:07.620833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffe0de-88c8-4c0a-9338-118812348f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:07.621115 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffe0de-88c8-4c0a-9338-118812348f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:07.621931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffe0de-88c8-4c0a-9338-118812348f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:07.623561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffe0de-88c8-4c0a-9338-118812348f75 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:07.624050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 891/1802] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:07.624957 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71724137-96a9-4138-92b5-58b944e54924 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:07.637036 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71724137-96a9-4138-92b5-58b944e54924 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:07.643529 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94821f-1159-4863-8ca9-976dc8997d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:07.644340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94821f-1159-4863-8ca9-976dc8997d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:07.644633 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94821f-1159-4863-8ca9-976dc8997d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:07.644909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94821f-1159-4863-8ca9-976dc8997d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:07.645845 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94821f-1159-4863-8ca9-976dc8997d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:07.647855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94821f-1159-4863-8ca9-976dc8997d18 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:07.663167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 892/1803] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:07.663734 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 912/1804] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:07.664062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94821f-1159-4863-8ca9-976dc8997d18 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:07.667669 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffe0de-88c8-4c0a-9338-118812348f75 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:07.679448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94821f-1159-4863-8ca9-976dc8997d18 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:07.688089 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffe0de-88c8-4c0a-9338-118812348f75 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:07.695758 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644445b-8d0b-4fa3-b955-2beeaf43eb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:07.697792 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644445b-8d0b-4fa3-b955-2beeaf43eb00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:07.698329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644445b-8d0b-4fa3-b955-2beeaf43eb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:07.698886 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644445b-8d0b-4fa3-b955-2beeaf43eb00 admin admin] PATH_INFO: `/v3/projects/94330b2869ed47028eeee9e76ba8a4b1/users/2aca03e927c1413eb794f05b62c8d1dc/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:07.703218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc46fa-adb3-43b6-8116-2701f3da4cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:07.704168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc46fa-adb3-43b6-8116-2701f3da4cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:07.704462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc46fa-adb3-43b6-8116-2701f3da4cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:07.704739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc46fa-adb3-43b6-8116-2701f3da4cf6 admin admin] PATH_INFO: `/v3/projects/b3ed7e75f2c046e68e295d9a207ce03d/users/46f28cea9e514313b6fe742c970b45fe/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:07.712431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:07.724338 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644445b-8d0b-4fa3-b955-2beeaf43eb00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94330b2869ed47028eeee9e76ba8a4b1, user_id=2aca03e927c1413eb794f05b62c8d1dc, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:07.730209 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644445b-8d0b-4fa3-b955-2beeaf43eb00 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:07.744769 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc46fa-adb3-43b6-8116-2701f3da4cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ed7e75f2c046e68e295d9a207ce03d, user_id=46f28cea9e514313b6fe742c970b45fe, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:07.753439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc46fa-adb3-43b6-8116-2701f3da4cf6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:07.757767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 913/1805] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:07 2022] PUT /identity/v3/projects/94330b2869ed47028eeee9e76ba8a4b1/users/2aca03e927c1413eb794f05b62c8d1dc/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:07.770548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644445b-8d0b-4fa3-b955-2beeaf43eb00 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:07.793939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 893/1806] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:07 2022] PUT /identity/v3/projects/b3ed7e75f2c046e68e295d9a207ce03d/users/46f28cea9e514313b6fe742c970b45fe/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:07.796315 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a98f1-afc6-4a4e-b21f-84b7b232b452 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:07.796679 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a98f1-afc6-4a4e-b21f-84b7b232b452 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:07.797156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a98f1-afc6-4a4e-b21f-84b7b232b452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:07.827854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-eb1a98f1-afc6-4a4e-b21f-84b7b232b452 None None] MFA Rules not processed for user `2aca03e927c1413eb794f05b62c8d1dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:07.829541 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-eb1a98f1-afc6-4a4e-b21f-84b7b232b452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:07.845540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644445b-8d0b-4fa3-b955-2beeaf43eb00 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:07.911110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483347f-1436-4cab-a9ea-a617266cabb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:07.911619 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 894/1807] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:07.911745 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483347f-1436-4cab-a9ea-a617266cabb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:07.912123 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483347f-1436-4cab-a9ea-a617266cabb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:07.912343 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483347f-1436-4cab-a9ea-a617266cabb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:07.913066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a00dec-70d5-471b-9ba2-96f973040461 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:07.913368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a00dec-70d5-471b-9ba2-96f973040461 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:07.913649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a00dec-70d5-471b-9ba2-96f973040461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:07.916343 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c483347f-1436-4cab-a9ea-a617266cabb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:07.945319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-37a00dec-70d5-471b-9ba2-96f973040461 None None] MFA Rules not processed for user `46f28cea9e514313b6fe742c970b45fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:07.946583 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-37a00dec-70d5-471b-9ba2-96f973040461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:08.006347 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483347f-1436-4cab-a9ea-a617266cabb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:08.007803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483347f-1436-4cab-a9ea-a617266cabb5 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:08.020009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 895/1808] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:08.024043 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a00dec-70d5-471b-9ba2-96f973040461 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:08.028032 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 914/1809] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:08.030321 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483347f-1436-4cab-a9ea-a617266cabb5 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:08.089930 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:08.117130 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a00dec-70d5-471b-9ba2-96f973040461 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:08.123019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915ac17-698e-460b-8fce-cac7f7fd355a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:08.123709 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915ac17-698e-460b-8fce-cac7f7fd355a admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:08.124291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915ac17-698e-460b-8fce-cac7f7fd355a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:08.124570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915ac17-698e-460b-8fce-cac7f7fd355a admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:08.125342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915ac17-698e-460b-8fce-cac7f7fd355a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:08.129014 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915ac17-698e-460b-8fce-cac7f7fd355a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:08.131701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483347f-1436-4cab-a9ea-a617266cabb5 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:08.137878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241de91-224c-4610-a131-d96b632fa86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:08.139119 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241de91-224c-4610-a131-d96b632fa86c admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:08.139119 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241de91-224c-4610-a131-d96b632fa86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:08.139394 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241de91-224c-4610-a131-d96b632fa86c admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:08.140370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241de91-224c-4610-a131-d96b632fa86c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:08.142315 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241de91-224c-4610-a131-d96b632fa86c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:08.148474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:08.182522 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 896/1810] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:08 2022] POST /identity/v3/projects => generated 369 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:08.185699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 915/1811] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:08 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:08.186720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915ac17-698e-460b-8fce-cac7f7fd355a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:08.189387 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241de91-224c-4610-a131-d96b632fa86c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:08.328224 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915ac17-698e-460b-8fce-cac7f7fd355a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:08.358078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241de91-224c-4610-a131-d96b632fa86c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:08.388071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746c7f7-9e54-40e6-bcf6-0c9cb45c6f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:08.388695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746c7f7-9e54-40e6-bcf6-0c9cb45c6f2b admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:08.389024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746c7f7-9e54-40e6-bcf6-0c9cb45c6f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:08.389313 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746c7f7-9e54-40e6-bcf6-0c9cb45c6f2b admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:08.390397 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746c7f7-9e54-40e6-bcf6-0c9cb45c6f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:08.392575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746c7f7-9e54-40e6-bcf6-0c9cb45c6f2b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:08.437390 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 916/1812] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:08 2022] POST /identity/v3/users => generated 288 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:07:08.451080 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746c7f7-9e54-40e6-bcf6-0c9cb45c6f2b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:08.496986 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746c7f7-9e54-40e6-bcf6-0c9cb45c6f2b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:08.517157 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb0dc4-e0da-45ef-88d3-3ef86338b3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:08.520167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb0dc4-e0da-45ef-88d3-3ef86338b3cf admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:08.520167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb0dc4-e0da-45ef-88d3-3ef86338b3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:08.520167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb0dc4-e0da-45ef-88d3-3ef86338b3cf admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:08.520506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b395f9-1417-403b-bc8a-efd2eb51a3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:08.520506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b395f9-1417-403b-bc8a-efd2eb51a3de admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:08.520672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b395f9-1417-403b-bc8a-efd2eb51a3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:08.521119 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b395f9-1417-403b-bc8a-efd2eb51a3de admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:08.523758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb0dc4-e0da-45ef-88d3-3ef86338b3cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:08.527792 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb0dc4-e0da-45ef-88d3-3ef86338b3cf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:08.529981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b395f9-1417-403b-bc8a-efd2eb51a3de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:08.535659 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b395f9-1417-403b-bc8a-efd2eb51a3de admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:08.568407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 917/1813] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:08.570075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b395f9-1417-403b-bc8a-efd2eb51a3de admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:08.584612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 897/1814] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:08 2022] POST /identity/v3/users => generated 291 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:08.585380 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb0dc4-e0da-45ef-88d3-3ef86338b3cf admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:08.611361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb0dc4-e0da-45ef-88d3-3ef86338b3cf admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:08.613900 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b395f9-1417-403b-bc8a-efd2eb51a3de admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:08.627126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c9b6a-a94d-4e38-ad0b-e1f7c2dcbc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:08.628363 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c9b6a-a94d-4e38-ad0b-e1f7c2dcbc40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:08.628694 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c9b6a-a94d-4e38-ad0b-e1f7c2dcbc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:08.631255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c9b6a-a94d-4e38-ad0b-e1f7c2dcbc40 admin admin] PATH_INFO: `/v3/projects/7856477627fe4bca995218f78483d45d/users/2697f350f3c944b29167d56007da5619/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:08.639847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22513f6d-9df7-426e-a25d-59b79e4b6789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:08.641812 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22513f6d-9df7-426e-a25d-59b79e4b6789 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:08.641812 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22513f6d-9df7-426e-a25d-59b79e4b6789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:08.641985 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22513f6d-9df7-426e-a25d-59b79e4b6789 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:08.644952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22513f6d-9df7-426e-a25d-59b79e4b6789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:08.649276 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22513f6d-9df7-426e-a25d-59b79e4b6789 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:08.672173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c9b6a-a94d-4e38-ad0b-e1f7c2dcbc40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7856477627fe4bca995218f78483d45d, user_id=2697f350f3c944b29167d56007da5619, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:08.672890 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 898/1815] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:08.673786 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22513f6d-9df7-426e-a25d-59b79e4b6789 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:08.675656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c9b6a-a94d-4e38-ad0b-e1f7c2dcbc40 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:08.698127 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22513f6d-9df7-426e-a25d-59b79e4b6789 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:08.701829 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 918/1816] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:08 2022] PUT /identity/v3/projects/7856477627fe4bca995218f78483d45d/users/2697f350f3c944b29167d56007da5619/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:08.706363 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c9b6a-a94d-4e38-ad0b-e1f7c2dcbc40 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:08.824980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343f678-9f98-48a0-b911-1d085cd23033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:08.825907 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343f678-9f98-48a0-b911-1d085cd23033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:08.826380 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343f678-9f98-48a0-b911-1d085cd23033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:08.826726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343f678-9f98-48a0-b911-1d085cd23033 admin admin] PATH_INFO: `/v3/projects/495bfec33794499aa4a8d4b9c7e8f6be/users/7c4e14fbb58e40169266e344fb06c000/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:08.829338 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c9b6a-a94d-4e38-ad0b-e1f7c2dcbc40 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:08.840271 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03811ebd-813c-4148-8684-6d32300dced1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:08.841253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03811ebd-813c-4148-8684-6d32300dced1 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:08.841850 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03811ebd-813c-4148-8684-6d32300dced1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:08.842728 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03811ebd-813c-4148-8684-6d32300dced1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:08.844939 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03811ebd-813c-4148-8684-6d32300dced1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:08.845821 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343f678-9f98-48a0-b911-1d085cd23033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=495bfec33794499aa4a8d4b9c7e8f6be, user_id=7c4e14fbb58e40169266e344fb06c000, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:08.846644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03811ebd-813c-4148-8684-6d32300dced1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:08.850055 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343f678-9f98-48a0-b911-1d085cd23033 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:08.855165 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:08.868934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 919/1817] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:07:08.869879 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03811ebd-813c-4148-8684-6d32300dced1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:08.872785 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 899/1818] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:08 2022] PUT /identity/v3/projects/495bfec33794499aa4a8d4b9c7e8f6be/users/7c4e14fbb58e40169266e344fb06c000/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:08.876548 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343f678-9f98-48a0-b911-1d085cd23033 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:08.883657 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03811ebd-813c-4148-8684-6d32300dced1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:08.902905 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:08.976400 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343f678-9f98-48a0-b911-1d085cd23033 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:08.992123 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037bcfe-b7c0-43ee-add9-01cd6b08346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:08.994527 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037bcfe-b7c0-43ee-add9-01cd6b08346a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:08.995105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037bcfe-b7c0-43ee-add9-01cd6b08346a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:08.995591 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037bcfe-b7c0-43ee-add9-01cd6b08346a admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:08.996592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037bcfe-b7c0-43ee-add9-01cd6b08346a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:08.998389 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037bcfe-b7c0-43ee-add9-01cd6b08346a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:09.044261 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 900/1819] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:09.046515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037bcfe-b7c0-43ee-add9-01cd6b08346a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:09.089738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037bcfe-b7c0-43ee-add9-01cd6b08346a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:09.091118 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b7981-66d4-4e81-b73b-b093dbf52bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:09.092093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b7981-66d4-4e81-b73b-b093dbf52bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:09.094290 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b7981-66d4-4e81-b73b-b093dbf52bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:09.094290 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b7981-66d4-4e81-b73b-b093dbf52bf5 admin admin] PATH_INFO: `/v3/projects/7856477627fe4bca995218f78483d45d/users/2697f350f3c944b29167d56007da5619/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:09.101949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b7981-66d4-4e81-b73b-b093dbf52bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7856477627fe4bca995218f78483d45d, user_id=2697f350f3c944b29167d56007da5619, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:09.101949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b7981-66d4-4e81-b73b-b093dbf52bf5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:09.108531 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e24c8-9831-4bca-9353-0a55e009eb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:09.109785 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e24c8-9831-4bca-9353-0a55e009eb42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:09.110027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e24c8-9831-4bca-9353-0a55e009eb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:09.110304 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e24c8-9831-4bca-9353-0a55e009eb42 admin admin] PATH_INFO: `/v3/projects/495bfec33794499aa4a8d4b9c7e8f6be/users/7c4e14fbb58e40169266e344fb06c000/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:09.114935 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e24c8-9831-4bca-9353-0a55e009eb42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=495bfec33794499aa4a8d4b9c7e8f6be, user_id=7c4e14fbb58e40169266e344fb06c000, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:09.120753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e24c8-9831-4bca-9353-0a55e009eb42 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:09.146088 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 920/1820] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:08 2022] PUT /identity/v3/projects/7856477627fe4bca995218f78483d45d/users/2697f350f3c944b29167d56007da5619/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:09.148092 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21805539-bf46-4aa3-b1d9-005223ea481e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:09.148394 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21805539-bf46-4aa3-b1d9-005223ea481e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:09.148668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21805539-bf46-4aa3-b1d9-005223ea481e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:09.166331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 901/1821] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:09 2022] PUT /identity/v3/projects/495bfec33794499aa4a8d4b9c7e8f6be/users/7c4e14fbb58e40169266e344fb06c000/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:09.178613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdaaa4-e48d-4afa-98fc-455f3b619c06 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:09.178893 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdaaa4-e48d-4afa-98fc-455f3b619c06 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:09.179182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdaaa4-e48d-4afa-98fc-455f3b619c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:09.242221 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-21805539-bf46-4aa3-b1d9-005223ea481e None None] MFA Rules not processed for user `2697f350f3c944b29167d56007da5619`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:09.243881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-21805539-bf46-4aa3-b1d9-005223ea481e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:09.245134 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6dbdaaa4-e48d-4afa-98fc-455f3b619c06 None None] MFA Rules not processed for user `7c4e14fbb58e40169266e344fb06c000`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:09.246429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6dbdaaa4-e48d-4afa-98fc-455f3b619c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:09.362983 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 921/1822] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:09 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:09.376650 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21805539-bf46-4aa3-b1d9-005223ea481e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:09.413553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 902/1823] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:09.426088 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdaaa4-e48d-4afa-98fc-455f3b619c06 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:09.429395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6dbdaaa4-e48d-4afa-98fc-455f3b619c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:09.478380 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21805539-bf46-4aa3-b1d9-005223ea481e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:09.486534 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a7300-f9d8-4304-890f-11b60e5a68ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:09.487869 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a7300-f9d8-4304-890f-11b60e5a68ff service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:09.488437 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a7300-f9d8-4304-890f-11b60e5a68ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:09.488733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a7300-f9d8-4304-890f-11b60e5a68ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:09.519056 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a7300-f9d8-4304-890f-11b60e5a68ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:09.521823 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a7300-f9d8-4304-890f-11b60e5a68ff service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:09.547137 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 922/1824] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:09 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:09.595168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdaaa4-e48d-4afa-98fc-455f3b619c06 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:09.600591 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ad6c2-4ee5-48a1-8f81-be322b8346eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:09.601691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ad6c2-4ee5-48a1-8f81-be322b8346eb service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:09.602404 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ad6c2-4ee5-48a1-8f81-be322b8346eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:09.602404 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ad6c2-4ee5-48a1-8f81-be322b8346eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:09.616216 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ad6c2-4ee5-48a1-8f81-be322b8346eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:09.620343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ad6c2-4ee5-48a1-8f81-be322b8346eb service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:09.651496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 903/1825] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:09 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:09.742513 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a7300-f9d8-4304-890f-11b60e5a68ff service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:09.756833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a7300-f9d8-4304-890f-11b60e5a68ff service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:09.762061 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d67e8-ab64-4f90-a5a1-88f049293118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:09.762900 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d67e8-ab64-4f90-a5a1-88f049293118 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:09.763275 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d67e8-ab64-4f90-a5a1-88f049293118 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:09.763712 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d67e8-ab64-4f90-a5a1-88f049293118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:09.823615 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:09.868150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ad6c2-4ee5-48a1-8f81-be322b8346eb service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:09.881150 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d67e8-ab64-4f90-a5a1-88f049293118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:09.882744 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d67e8-ab64-4f90-a5a1-88f049293118 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:09.884311 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ad6c2-4ee5-48a1-8f81-be322b8346eb service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:09.890226 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdfa45-57ff-4578-a678-7d74edd1610a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:09.891062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdfa45-57ff-4578-a678-7d74edd1610a service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:09.891360 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdfa45-57ff-4578-a678-7d74edd1610a service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:09.891644 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdfa45-57ff-4578-a678-7d74edd1610a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:09.893278 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 923/1826] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:09.913222 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:10.013113 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdfa45-57ff-4578-a678-7d74edd1610a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:10.014903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdfa45-57ff-4578-a678-7d74edd1610a service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:10.026884 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 904/1827] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:10.847389 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d67e8-ab64-4f90-a5a1-88f049293118 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:10.849057 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c77d67e8-ab64-4f90-a5a1-88f049293118 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:10.918845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d67e8-ab64-4f90-a5a1-88f049293118 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:10.923669 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53420bc3-22da-4840-be2a-44492a883c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:10.924681 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53420bc3-22da-4840-be2a-44492a883c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:10.925056 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53420bc3-22da-4840-be2a-44492a883c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:10.925340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53420bc3-22da-4840-be2a-44492a883c43 admin admin] PATH_INFO: `/v3/users/1a93ec4393e444d5ae18c69033762a90` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:10.926544 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53420bc3-22da-4840-be2a-44492a883c43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a93ec4393e444d5ae18c69033762a90)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:10.928515 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53420bc3-22da-4840-be2a-44492a883c43 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:10.976089 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-53420bc3-22da-4840-be2a-44492a883c43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a93ec4393e444d5ae18c69033762a90'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:10.985053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-53420bc3-22da-4840-be2a-44492a883c43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a93ec4393e444d5ae18c69033762a90'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:10.997584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-53420bc3-22da-4840-be2a-44492a883c43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a93ec4393e444d5ae18c69033762a90'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:10.998295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-53420bc3-22da-4840-be2a-44492a883c43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a93ec4393e444d5ae18c69033762a90'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:11.006865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-53420bc3-22da-4840-be2a-44492a883c43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a93ec4393e444d5ae18c69033762a90'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:11.012914 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 924/1828] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:10 2022] DELETE /identity/v3/users/1a93ec4393e444d5ae18c69033762a90 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:11.017305 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd8da1-5c06-4ec7-9c5b-97fcf53840d0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:11.017773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd8da1-5c06-4ec7-9c5b-97fcf53840d0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:11.018012 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd8da1-5c06-4ec7-9c5b-97fcf53840d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:11.036332 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-80fd8da1-5c06-4ec7-9c5b-97fcf53840d0 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:11.037557 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-80fd8da1-5c06-4ec7-9c5b-97fcf53840d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:11.101543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 905/1829] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:11.112925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53420bc3-22da-4840-be2a-44492a883c43 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:11.114479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-53420bc3-22da-4840-be2a-44492a883c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:11.202491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53420bc3-22da-4840-be2a-44492a883c43 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:11.207159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48af615-40fe-4634-94b8-44daf188ec41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:11.208264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48af615-40fe-4634-94b8-44daf188ec41 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:11.208264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48af615-40fe-4634-94b8-44daf188ec41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:11.208462 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48af615-40fe-4634-94b8-44daf188ec41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:11.214994 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:11.224714 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48af615-40fe-4634-94b8-44daf188ec41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:11.229140 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48af615-40fe-4634-94b8-44daf188ec41 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:11.246607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 925/1830] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:11.511687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b478367-5111-4120-a08d-8b611364f55b None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:11.512020 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b478367-5111-4120-a08d-8b611364f55b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:11.512360 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b478367-5111-4120-a08d-8b611364f55b None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:11.514075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 906/1831] 10.222.0.41 () {54 vars in 921 bytes} [Mon May 30 12:07:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:11.522700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdf644-8a0e-4bc4-9618-7128b47fe1ec None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:11.523091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdf644-8a0e-4bc4-9618-7128b47fe1ec None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:11.523459 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdf644-8a0e-4bc4-9618-7128b47fe1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:11.560053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f5fdf644-8a0e-4bc4-9618-7128b47fe1ec None None] MFA Rules not processed for user `bb3820a613744c15b840681fe6b6e808`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:11.561389 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f5fdf644-8a0e-4bc4-9618-7128b47fe1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:11.704848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 926/1832] 10.222.0.41 () {58 vars in 1018 bytes} [Mon May 30 12:07:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:11.719933 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b478367-5111-4120-a08d-8b611364f55b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:11.722615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1b478367-5111-4120-a08d-8b611364f55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:11.755198 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b478367-5111-4120-a08d-8b611364f55b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:11.767206 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdf644-8a0e-4bc4-9618-7128b47fe1ec None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:11.769199 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f5fdf644-8a0e-4bc4-9618-7128b47fe1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:11.779301 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97f742-a094-452d-89f5-37b411e85ae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:11.780092 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97f742-a094-452d-89f5-37b411e85ae5 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:11.780392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97f742-a094-452d-89f5-37b411e85ae5 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:11.780675 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97f742-a094-452d-89f5-37b411e85ae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:11.793491 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97f742-a094-452d-89f5-37b411e85ae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:11.794498 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdf644-8a0e-4bc4-9618-7128b47fe1ec None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:11.796545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97f742-a094-452d-89f5-37b411e85ae5 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:11.807548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad47a3d-9437-46a7-a619-d0a14fea3f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:11.809589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad47a3d-9437-46a7-a619-d0a14fea3f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:11.809883 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad47a3d-9437-46a7-a619-d0a14fea3f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:11.811090 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 907/1833] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:11.811393 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad47a3d-9437-46a7-a619-d0a14fea3f08 admin admin] PATH_INFO: `/v3/users/7486dfb9b208449c964917a8a0042c22` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:11.814357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad47a3d-9437-46a7-a619-d0a14fea3f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7486dfb9b208449c964917a8a0042c22)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:11.817746 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad47a3d-9437-46a7-a619-d0a14fea3f08 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:11.936819 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4ad47a3d-9437-46a7-a619-d0a14fea3f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7486dfb9b208449c964917a8a0042c22'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:12.007898 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4ad47a3d-9437-46a7-a619-d0a14fea3f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7486dfb9b208449c964917a8a0042c22'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:12.038205 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4ad47a3d-9437-46a7-a619-d0a14fea3f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7486dfb9b208449c964917a8a0042c22'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:12.039134 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4ad47a3d-9437-46a7-a619-d0a14fea3f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7486dfb9b208449c964917a8a0042c22'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:12.048600 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4ad47a3d-9437-46a7-a619-d0a14fea3f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7486dfb9b208449c964917a8a0042c22'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:12.080383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 927/1834] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:11 2022] DELETE /identity/v3/users/7486dfb9b208449c964917a8a0042c22 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:12.081868 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e102a-269a-4805-8e1e-8fbbf9ee3914 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:12.082796 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e102a-269a-4805-8e1e-8fbbf9ee3914 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:12.083412 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e102a-269a-4805-8e1e-8fbbf9ee3914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:12.126719 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5b8e102a-269a-4805-8e1e-8fbbf9ee3914 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:12.128944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5b8e102a-269a-4805-8e1e-8fbbf9ee3914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:12.243952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 908/1835] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:12.249845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad47a3d-9437-46a7-a619-d0a14fea3f08 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:12.251963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4ad47a3d-9437-46a7-a619-d0a14fea3f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:12.272964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad47a3d-9437-46a7-a619-d0a14fea3f08 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:12.281570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e102a-269a-4805-8e1e-8fbbf9ee3914 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:12.283310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5b8e102a-269a-4805-8e1e-8fbbf9ee3914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:12.286263 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aefaa3-e523-4f57-8b94-5d15f93b45d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:12.287169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aefaa3-e523-4f57-8b94-5d15f93b45d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:12.287456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aefaa3-e523-4f57-8b94-5d15f93b45d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:12.287739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aefaa3-e523-4f57-8b94-5d15f93b45d8 admin admin] PATH_INFO: `/v3/projects/c053ca4f54ad4cb78c07e0b870fab0cd` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:12.290438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aefaa3-e523-4f57-8b94-5d15f93b45d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c053ca4f54ad4cb78c07e0b870fab0cd)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:12.300696 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aefaa3-e523-4f57-8b94-5d15f93b45d8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:12.395626 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:12.421932 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-57aefaa3-e523-4f57-8b94-5d15f93b45d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c053ca4f54ad4cb78c07e0b870fab0cd', 'request_id': 'req-57aefaa3-e523-4f57-8b94-5d15f93b45d8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:12.433330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:12.439807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e102a-269a-4805-8e1e-8fbbf9ee3914 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:12.448109 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-57aefaa3-e523-4f57-8b94-5d15f93b45d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c053ca4f54ad4cb78c07e0b870fab0cd', 'request_id': 'req-57aefaa3-e523-4f57-8b94-5d15f93b45d8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:12.465843 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-57aefaa3-e523-4f57-8b94-5d15f93b45d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c053ca4f54ad4cb78c07e0b870fab0cd', 'request_id': 'req-57aefaa3-e523-4f57-8b94-5d15f93b45d8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:12.494574 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-57aefaa3-e523-4f57-8b94-5d15f93b45d8 admin admin] The token cache is being invalidate because project c053ca4f54ad4cb78c07e0b870fab0cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:12.494890 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-57aefaa3-e523-4f57-8b94-5d15f93b45d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:12.495645 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-57aefaa3-e523-4f57-8b94-5d15f93b45d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:12.497421 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 928/1836] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:12 2022] DELETE /identity/v3/projects/c053ca4f54ad4cb78c07e0b870fab0cd => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:12.502582 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aefaa3-e523-4f57-8b94-5d15f93b45d8 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:12.505116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-57aefaa3-e523-4f57-8b94-5d15f93b45d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:12.514820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f92675-94a9-4067-b367-23bf4096fd7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:12.515597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f92675-94a9-4067-b367-23bf4096fd7e service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:12.515856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f92675-94a9-4067-b367-23bf4096fd7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:12.516225 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f92675-94a9-4067-b367-23bf4096fd7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:12.519593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c4f92675-94a9-4067-b367-23bf4096fd7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:12.591868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aefaa3-e523-4f57-8b94-5d15f93b45d8 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:12.599631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33d6bb-8ea0-4baf-a3ad-d059f6b4d16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:12.600372 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33d6bb-8ea0-4baf-a3ad-d059f6b4d16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:12.600647 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33d6bb-8ea0-4baf-a3ad-d059f6b4d16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:12.600929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33d6bb-8ea0-4baf-a3ad-d059f6b4d16e admin admin] PATH_INFO: `/v3/users/837fcbb9a46648eba3dafba63ecdc4b4` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:12.602365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33d6bb-8ea0-4baf-a3ad-d059f6b4d16e admin admin] RBAC: Authorizing `identity:delete_user(user_id=837fcbb9a46648eba3dafba63ecdc4b4)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:12.604415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33d6bb-8ea0-4baf-a3ad-d059f6b4d16e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:12.614030 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f92675-94a9-4067-b367-23bf4096fd7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:12.615550 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f92675-94a9-4067-b367-23bf4096fd7e service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:12.626273 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 909/1837] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:07:12.685001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1e33d6bb-8ea0-4baf-a3ad-d059f6b4d16e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '837fcbb9a46648eba3dafba63ecdc4b4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:12.712775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1e33d6bb-8ea0-4baf-a3ad-d059f6b4d16e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '837fcbb9a46648eba3dafba63ecdc4b4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:12.731398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1e33d6bb-8ea0-4baf-a3ad-d059f6b4d16e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '837fcbb9a46648eba3dafba63ecdc4b4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:12.731846 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1e33d6bb-8ea0-4baf-a3ad-d059f6b4d16e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '837fcbb9a46648eba3dafba63ecdc4b4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:12.741476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1e33d6bb-8ea0-4baf-a3ad-d059f6b4d16e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '837fcbb9a46648eba3dafba63ecdc4b4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:12.751433 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 929/1838] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:12 2022] DELETE /identity/v3/users/837fcbb9a46648eba3dafba63ecdc4b4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:13.051925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f92675-94a9-4067-b367-23bf4096fd7e service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:13.064443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33d6bb-8ea0-4baf-a3ad-d059f6b4d16e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:13.067041 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1e33d6bb-8ea0-4baf-a3ad-d059f6b4d16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:13.072078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f92675-94a9-4067-b367-23bf4096fd7e service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:13.145798 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c0658-2571-4566-bec4-e2d6a1f795db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:13.146712 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c0658-2571-4566-bec4-e2d6a1f795db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:13.147011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c0658-2571-4566-bec4-e2d6a1f795db admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:13.147450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c0658-2571-4566-bec4-e2d6a1f795db admin admin] PATH_INFO: `/v3/projects/5a67f945b99940c4990431d99b73d159` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:13.149014 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c0658-2571-4566-bec4-e2d6a1f795db admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a67f945b99940c4990431d99b73d159)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:13.150966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c0658-2571-4566-bec4-e2d6a1f795db admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:13.159887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33d6bb-8ea0-4baf-a3ad-d059f6b4d16e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:13.165773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc746369-8314-4e74-93f8-26ea329e014a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:13.166652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc746369-8314-4e74-93f8-26ea329e014a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:13.166940 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc746369-8314-4e74-93f8-26ea329e014a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:13.167268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc746369-8314-4e74-93f8-26ea329e014a admin admin] PATH_INFO: `/v3/projects/c36e7772e3c84ddd9ebfb2e3103b276b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:13.169126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc746369-8314-4e74-93f8-26ea329e014a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c36e7772e3c84ddd9ebfb2e3103b276b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:13.171074 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc746369-8314-4e74-93f8-26ea329e014a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:13.172950 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:13.207427 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:13.209407 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-265c0658-2571-4566-bec4-e2d6a1f795db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a67f945b99940c4990431d99b73d159', 'request_id': 'req-265c0658-2571-4566-bec4-e2d6a1f795db'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:13.217921 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-265c0658-2571-4566-bec4-e2d6a1f795db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a67f945b99940c4990431d99b73d159', 'request_id': 'req-265c0658-2571-4566-bec4-e2d6a1f795db'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:13.224774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-265c0658-2571-4566-bec4-e2d6a1f795db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a67f945b99940c4990431d99b73d159', 'request_id': 'req-265c0658-2571-4566-bec4-e2d6a1f795db'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:13.232560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fc746369-8314-4e74-93f8-26ea329e014a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c36e7772e3c84ddd9ebfb2e3103b276b', 'request_id': 'req-fc746369-8314-4e74-93f8-26ea329e014a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:13.235727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-265c0658-2571-4566-bec4-e2d6a1f795db admin admin] The token cache is being invalidate because project 5a67f945b99940c4990431d99b73d159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:13.236355 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-265c0658-2571-4566-bec4-e2d6a1f795db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:13.236774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-265c0658-2571-4566-bec4-e2d6a1f795db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:13.239254 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 910/1839] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:13 2022] DELETE /identity/v3/projects/5a67f945b99940c4990431d99b73d159 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:13.241449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fc746369-8314-4e74-93f8-26ea329e014a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c36e7772e3c84ddd9ebfb2e3103b276b', 'request_id': 'req-fc746369-8314-4e74-93f8-26ea329e014a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:13.244343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddae1c3-a9f3-4b29-948e-dd0dd913073c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:13.245049 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddae1c3-a9f3-4b29-948e-dd0dd913073c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:13.245406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddae1c3-a9f3-4b29-948e-dd0dd913073c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:13.251670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fc746369-8314-4e74-93f8-26ea329e014a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c36e7772e3c84ddd9ebfb2e3103b276b', 'request_id': 'req-fc746369-8314-4e74-93f8-26ea329e014a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:13.264397 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fc746369-8314-4e74-93f8-26ea329e014a admin admin] The token cache is being invalidate because project c36e7772e3c84ddd9ebfb2e3103b276b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:13.264830 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fc746369-8314-4e74-93f8-26ea329e014a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:13.265573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fc746369-8314-4e74-93f8-26ea329e014a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:13.266330 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-dddae1c3-a9f3-4b29-948e-dd0dd913073c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:13.267549 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-dddae1c3-a9f3-4b29-948e-dd0dd913073c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:13.271631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 930/1840] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:13 2022] DELETE /identity/v3/projects/c36e7772e3c84ddd9ebfb2e3103b276b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:13.272612 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc746369-8314-4e74-93f8-26ea329e014a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:13.273915 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-fc746369-8314-4e74-93f8-26ea329e014a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:13.346786 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 911/1841] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:07:13.348969 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3fcf5-7019-4a6f-a081-23c06b09461f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:13.349453 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3fcf5-7019-4a6f-a081-23c06b09461f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:13.349769 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3fcf5-7019-4a6f-a081-23c06b09461f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:13.371723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc746369-8314-4e74-93f8-26ea329e014a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:13.377131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc14fb-185d-4a51-be18-7fd7d4fb90d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:13.378179 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc14fb-185d-4a51-be18-7fd7d4fb90d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:13.378473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc14fb-185d-4a51-be18-7fd7d4fb90d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:13.378750 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc14fb-185d-4a51-be18-7fd7d4fb90d8 admin admin] PATH_INFO: `/v3/users/655f6377b0704d5c8c2f9481e6cfc5ef` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:13.380088 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc14fb-185d-4a51-be18-7fd7d4fb90d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=655f6377b0704d5c8c2f9481e6cfc5ef)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:13.382149 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc14fb-185d-4a51-be18-7fd7d4fb90d8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:13.382277 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d5c3fcf5-7019-4a6f-a081-23c06b09461f None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:13.383513 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d5c3fcf5-7019-4a6f-a081-23c06b09461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:13.392396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 912/1842] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:13.396928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3fcf5-7019-4a6f-a081-23c06b09461f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:13.407635 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3fcf5-7019-4a6f-a081-23c06b09461f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:13.415529 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e6569-7b68-49a8-b3c7-314cf90308f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:13.416307 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e6569-7b68-49a8-b3c7-314cf90308f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:13.416641 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e6569-7b68-49a8-b3c7-314cf90308f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:13.416927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e6569-7b68-49a8-b3c7-314cf90308f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:13.418269 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e6569-7b68-49a8-b3c7-314cf90308f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:07:13.418622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e6569-7b68-49a8-b3c7-314cf90308f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:13.421161 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e6569-7b68-49a8-b3c7-314cf90308f2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:13.450732 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1ddc14fb-185d-4a51-be18-7fd7d4fb90d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '655f6377b0704d5c8c2f9481e6cfc5ef'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:13.460683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 913/1843] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:07:13.462604 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e6569-7b68-49a8-b3c7-314cf90308f2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:13.465904 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1ddc14fb-185d-4a51-be18-7fd7d4fb90d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '655f6377b0704d5c8c2f9481e6cfc5ef'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:13.490603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1ddc14fb-185d-4a51-be18-7fd7d4fb90d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '655f6377b0704d5c8c2f9481e6cfc5ef'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:13.491332 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e6569-7b68-49a8-b3c7-314cf90308f2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:13.491871 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1ddc14fb-185d-4a51-be18-7fd7d4fb90d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '655f6377b0704d5c8c2f9481e6cfc5ef'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:13.503433 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1ddc14fb-185d-4a51-be18-7fd7d4fb90d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '655f6377b0704d5c8c2f9481e6cfc5ef'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:13.504588 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4534307-91f9-43d4-b5b1-dc43e5bba73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:13.506058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4534307-91f9-43d4-b5b1-dc43e5bba73c admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:13.506058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4534307-91f9-43d4-b5b1-dc43e5bba73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:13.506305 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4534307-91f9-43d4-b5b1-dc43e5bba73c admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:13.507913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4534307-91f9-43d4-b5b1-dc43e5bba73c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:13.514462 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 931/1844] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:13 2022] DELETE /identity/v3/users/655f6377b0704d5c8c2f9481e6cfc5ef => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:13.515507 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4534307-91f9-43d4-b5b1-dc43e5bba73c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:13.608164 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 914/1845] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:13 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:13.615308 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc14fb-185d-4a51-be18-7fd7d4fb90d8 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:13.616894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1ddc14fb-185d-4a51-be18-7fd7d4fb90d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:13.642239 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:13.740583 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc14fb-185d-4a51-be18-7fd7d4fb90d8 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:13.859599 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64abccf-c52b-4b08-8b58-718aad65b472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:13.861869 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64abccf-c52b-4b08-8b58-718aad65b472 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:13.862393 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64abccf-c52b-4b08-8b58-718aad65b472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:13.862572 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64abccf-c52b-4b08-8b58-718aad65b472 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:13.863244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64abccf-c52b-4b08-8b58-718aad65b472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:13.866143 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64abccf-c52b-4b08-8b58-718aad65b472 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:13.925374 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4534307-91f9-43d4-b5b1-dc43e5bba73c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:13.926079 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 932/1846] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:13 2022] POST /identity/v3/users => generated 289 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:13.947966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4534307-91f9-43d4-b5b1-dc43e5bba73c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:13.953106 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cd684-b43f-40b2-87d8-c7b48f6143fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:13.953824 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cd684-b43f-40b2-87d8-c7b48f6143fe admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:13.954123 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cd684-b43f-40b2-87d8-c7b48f6143fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:13.954406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cd684-b43f-40b2-87d8-c7b48f6143fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:13.955152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cd684-b43f-40b2-87d8-c7b48f6143fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:13.959807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cd684-b43f-40b2-87d8-c7b48f6143fe admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:13.986866 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64abccf-c52b-4b08-8b58-718aad65b472 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:14.006375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64abccf-c52b-4b08-8b58-718aad65b472 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:14.007773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 915/1847] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:14.021359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecd629-320e-4da4-b5e4-8ae4855eb84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:14.022825 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecd629-320e-4da4-b5e4-8ae4855eb84f admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.023336 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecd629-320e-4da4-b5e4-8ae4855eb84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.023919 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecd629-320e-4da4-b5e4-8ae4855eb84f admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.024855 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecd629-320e-4da4-b5e4-8ae4855eb84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:14.026667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecd629-320e-4da4-b5e4-8ae4855eb84f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:14.063544 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cd684-b43f-40b2-87d8-c7b48f6143fe admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:14.064007 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 933/1848] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:07:14.075716 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cd684-b43f-40b2-87d8-c7b48f6143fe admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:14.081611 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef324d8-cfca-459a-8d74-0e52fe0aa032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:14.082527 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef324d8-cfca-459a-8d74-0e52fe0aa032 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.082816 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef324d8-cfca-459a-8d74-0e52fe0aa032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.083103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef324d8-cfca-459a-8d74-0e52fe0aa032 admin admin] PATH_INFO: `/v3/projects/f74aa5ae098f4d77b00cf56858ee3491/users/fa213a37bea24cd481f628b25fe09b31/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.100567 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef324d8-cfca-459a-8d74-0e52fe0aa032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74aa5ae098f4d77b00cf56858ee3491, user_id=fa213a37bea24cd481f628b25fe09b31, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:14.103424 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef324d8-cfca-459a-8d74-0e52fe0aa032 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:14.122161 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 916/1849] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:14 2022] PUT /identity/v3/projects/f74aa5ae098f4d77b00cf56858ee3491/users/fa213a37bea24cd481f628b25fe09b31/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:14.132933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e4849-7fc7-40ac-9272-4b2fb65a901e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.133406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e4849-7fc7-40ac-9272-4b2fb65a901e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.133486 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e4849-7fc7-40ac-9272-4b2fb65a901e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.166821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-276e4849-7fc7-40ac-9272-4b2fb65a901e None None] MFA Rules not processed for user `fa213a37bea24cd481f628b25fe09b31`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:14.168179 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-276e4849-7fc7-40ac-9272-4b2fb65a901e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:14.199043 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef324d8-cfca-459a-8d74-0e52fe0aa032 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:14.200971 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bef324d8-cfca-459a-8d74-0e52fe0aa032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:14.309062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:14.313248 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 934/1850] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:14.320082 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e4849-7fc7-40ac-9272-4b2fb65a901e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:14.324444 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef324d8-cfca-459a-8d74-0e52fe0aa032 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:14.332428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707382d0-9649-411f-a062-883149d27af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:14.334703 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707382d0-9649-411f-a062-883149d27af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.335446 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707382d0-9649-411f-a062-883149d27af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.335733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707382d0-9649-411f-a062-883149d27af5 admin admin] PATH_INFO: `/v3/projects/35941a8d41614229a24d608eea150689` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.337034 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707382d0-9649-411f-a062-883149d27af5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35941a8d41614229a24d608eea150689)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:14.339268 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707382d0-9649-411f-a062-883149d27af5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:14.342452 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e4849-7fc7-40ac-9272-4b2fb65a901e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:14.359613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde5371-1080-40af-9a43-1ca0d093c72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:14.360820 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde5371-1080-40af-9a43-1ca0d093c72f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.361181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde5371-1080-40af-9a43-1ca0d093c72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.361470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde5371-1080-40af-9a43-1ca0d093c72f admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.362788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde5371-1080-40af-9a43-1ca0d093c72f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:14.365593 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde5371-1080-40af-9a43-1ca0d093c72f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:14.425471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 935/1851] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:14 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:14.429592 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde5371-1080-40af-9a43-1ca0d093c72f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:14.435241 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:14.450394 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-707382d0-9649-411f-a062-883149d27af5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35941a8d41614229a24d608eea150689', 'request_id': 'req-707382d0-9649-411f-a062-883149d27af5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:14.462019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-707382d0-9649-411f-a062-883149d27af5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35941a8d41614229a24d608eea150689', 'request_id': 'req-707382d0-9649-411f-a062-883149d27af5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:14.470498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-707382d0-9649-411f-a062-883149d27af5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35941a8d41614229a24d608eea150689', 'request_id': 'req-707382d0-9649-411f-a062-883149d27af5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:14.482630 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-707382d0-9649-411f-a062-883149d27af5 admin admin] The token cache is being invalidate because project 35941a8d41614229a24d608eea150689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:14.482925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-707382d0-9649-411f-a062-883149d27af5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:14.483612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-707382d0-9649-411f-a062-883149d27af5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:14.485512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 917/1852] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:14 2022] DELETE /identity/v3/projects/35941a8d41614229a24d608eea150689 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:14.486283 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707382d0-9649-411f-a062-883149d27af5 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:14.488355 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-707382d0-9649-411f-a062-883149d27af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:14.509167 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde5371-1080-40af-9a43-1ca0d093c72f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:14.513811 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2aed98-16cb-4053-8468-4f4f2d2f6516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:14.514488 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aed98-16cb-4053-8468-4f4f2d2f6516 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.514779 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aed98-16cb-4053-8468-4f4f2d2f6516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.515060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aed98-16cb-4053-8468-4f4f2d2f6516 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.515765 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2aed98-16cb-4053-8468-4f4f2d2f6516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:14.517707 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2aed98-16cb-4053-8468-4f4f2d2f6516 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:14.544849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 936/1853] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:14 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:14.544849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28799d63-1ba6-416c-b674-32eddc706816 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.544849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28799d63-1ba6-416c-b674-32eddc706816 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.544849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28799d63-1ba6-416c-b674-32eddc706816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.561943 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707382d0-9649-411f-a062-883149d27af5 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:14.563318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-28799d63-1ba6-416c-b674-32eddc706816 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:14.564673 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-28799d63-1ba6-416c-b674-32eddc706816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:14.567101 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d13fa-f66a-45a2-9e9b-a278f9281574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:14.568004 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d13fa-f66a-45a2-9e9b-a278f9281574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.568326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d13fa-f66a-45a2-9e9b-a278f9281574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.568585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d13fa-f66a-45a2-9e9b-a278f9281574 admin admin] PATH_INFO: `/v3/users/2aca03e927c1413eb794f05b62c8d1dc` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.569801 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d13fa-f66a-45a2-9e9b-a278f9281574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aca03e927c1413eb794f05b62c8d1dc)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:14.571733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d13fa-f66a-45a2-9e9b-a278f9281574 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:14.573832 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 937/1854] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:14.574642 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28799d63-1ba6-416c-b674-32eddc706816 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:14.575899 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-28799d63-1ba6-416c-b674-32eddc706816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:14.587617 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28799d63-1ba6-416c-b674-32eddc706816 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:14.592316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e03ed7-60fc-42aa-8cde-9263eccf44bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:14.592977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e03ed7-60fc-42aa-8cde-9263eccf44bc admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.593262 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e03ed7-60fc-42aa-8cde-9263eccf44bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.593541 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e03ed7-60fc-42aa-8cde-9263eccf44bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.594272 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e03ed7-60fc-42aa-8cde-9263eccf44bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:14.595888 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e03ed7-60fc-42aa-8cde-9263eccf44bc admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:14.606333 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 938/1855] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:14.607631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c968711-581b-412e-8cb2-86ccdce327bb None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.607950 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c968711-581b-412e-8cb2-86ccdce327bb None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.608235 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c968711-581b-412e-8cb2-86ccdce327bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.623867 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-420d13fa-f66a-45a2-9e9b-a278f9281574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aca03e927c1413eb794f05b62c8d1dc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:14.626527 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1c968711-581b-412e-8cb2-86ccdce327bb None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:14.629023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1c968711-581b-412e-8cb2-86ccdce327bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:14.632873 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-420d13fa-f66a-45a2-9e9b-a278f9281574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aca03e927c1413eb794f05b62c8d1dc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:14.637580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 939/1856] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:14.638193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c968711-581b-412e-8cb2-86ccdce327bb None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:14.645656 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-420d13fa-f66a-45a2-9e9b-a278f9281574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aca03e927c1413eb794f05b62c8d1dc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:14.646339 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-420d13fa-f66a-45a2-9e9b-a278f9281574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aca03e927c1413eb794f05b62c8d1dc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:14.646980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-420d13fa-f66a-45a2-9e9b-a278f9281574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aca03e927c1413eb794f05b62c8d1dc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:14.647304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c968711-581b-412e-8cb2-86ccdce327bb None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:14.651901 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a7177-0115-40b1-b8ec-ec40d8ea60f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:14.652770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a7177-0115-40b1-b8ec-ec40d8ea60f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.653055 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a7177-0115-40b1-b8ec-ec40d8ea60f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.653340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a7177-0115-40b1-b8ec-ec40d8ea60f7 admin admin] PATH_INFO: `/v3/projects/d0a94ea3db2840c895287dbdb50d1453/users/4fbe8413705c4f8fbadc1d115e1cb174/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.660685 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 918/1857] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:14 2022] DELETE /identity/v3/users/2aca03e927c1413eb794f05b62c8d1dc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:14.661516 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d13fa-f66a-45a2-9e9b-a278f9281574 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:14.663336 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-420d13fa-f66a-45a2-9e9b-a278f9281574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:14.669133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:14.669289 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a7177-0115-40b1-b8ec-ec40d8ea60f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a94ea3db2840c895287dbdb50d1453, user_id=4fbe8413705c4f8fbadc1d115e1cb174, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:14.671941 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a7177-0115-40b1-b8ec-ec40d8ea60f7 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:14.686200 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 940/1858] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:14 2022] PUT /identity/v3/projects/d0a94ea3db2840c895287dbdb50d1453/users/4fbe8413705c4f8fbadc1d115e1cb174/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:14.687504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da884b18-2951-456c-be23-5703667d9e06 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.687801 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da884b18-2951-456c-be23-5703667d9e06 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.688244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da884b18-2951-456c-be23-5703667d9e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.706793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-da884b18-2951-456c-be23-5703667d9e06 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:14.708980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-da884b18-2951-456c-be23-5703667d9e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:14.740039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d13fa-f66a-45a2-9e9b-a278f9281574 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:14.782812 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 941/1859] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:14.784713 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da884b18-2951-456c-be23-5703667d9e06 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:14.786100 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-da884b18-2951-456c-be23-5703667d9e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:14.799700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da884b18-2951-456c-be23-5703667d9e06 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:14.805571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac681e7-33bd-42f7-b3ad-d1b0582d0e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:14.806522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac681e7-33bd-42f7-b3ad-d1b0582d0e2a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.806833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac681e7-33bd-42f7-b3ad-d1b0582d0e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.807211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac681e7-33bd-42f7-b3ad-d1b0582d0e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.808063 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac681e7-33bd-42f7-b3ad-d1b0582d0e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:14.809607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac681e7-33bd-42f7-b3ad-d1b0582d0e2a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:14.818488 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ced1a-6d7c-494d-b849-4a9a1518d01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:14.819183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ced1a-6d7c-494d-b849-4a9a1518d01a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.819382 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ced1a-6d7c-494d-b849-4a9a1518d01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.819666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ced1a-6d7c-494d-b849-4a9a1518d01a admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.820581 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ced1a-6d7c-494d-b849-4a9a1518d01a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:07:14.820925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 942/1860] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:14.821916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac681e7-33bd-42f7-b3ad-d1b0582d0e2a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:14.823712 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2ac681e7-33bd-42f7-b3ad-d1b0582d0e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:14.823938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ced1a-6d7c-494d-b849-4a9a1518d01a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:14.825584 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ced1a-6d7c-494d-b849-4a9a1518d01a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:14.841978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 919/1861] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:07:14.841978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ced1a-6d7c-494d-b849-4a9a1518d01a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:14.853231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ced1a-6d7c-494d-b849-4a9a1518d01a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:14.858239 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89338c-bc08-4b15-8713-21789b94e9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:14.859206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89338c-bc08-4b15-8713-21789b94e9dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.859757 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89338c-bc08-4b15-8713-21789b94e9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.860077 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89338c-bc08-4b15-8713-21789b94e9dc admin admin] PATH_INFO: `/v3/projects/d0a94ea3db2840c895287dbdb50d1453/users/4fbe8413705c4f8fbadc1d115e1cb174/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.862317 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89338c-bc08-4b15-8713-21789b94e9dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a94ea3db2840c895287dbdb50d1453, user_id=4fbe8413705c4f8fbadc1d115e1cb174, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:14.865531 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89338c-bc08-4b15-8713-21789b94e9dc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:14.870375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:14.881544 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 920/1862] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:14 2022] PUT /identity/v3/projects/d0a94ea3db2840c895287dbdb50d1453/users/4fbe8413705c4f8fbadc1d115e1cb174/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:14.888936 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89338c-bc08-4b15-8713-21789b94e9dc admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:14.896009 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac681e7-33bd-42f7-b3ad-d1b0582d0e2a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:14.947465 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac707b-1d36-4d7d-b2bc-820c5ce52cea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:14.948174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac707b-1d36-4d7d-b2bc-820c5ce52cea service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.948444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac707b-1d36-4d7d-b2bc-820c5ce52cea service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.948723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac707b-1d36-4d7d-b2bc-820c5ce52cea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.951670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89338c-bc08-4b15-8713-21789b94e9dc admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:14.958314 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac707b-1d36-4d7d-b2bc-820c5ce52cea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:14.958497 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9a866-bcf0-4259-99e3-ef5010e48ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:14.959114 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9a866-bcf0-4259-99e3-ef5010e48ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.959405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9a866-bcf0-4259-99e3-ef5010e48ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.959695 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9a866-bcf0-4259-99e3-ef5010e48ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.959915 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac707b-1d36-4d7d-b2bc-820c5ce52cea service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:14.960424 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9a866-bcf0-4259-99e3-ef5010e48ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:14.963069 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9a866-bcf0-4259-99e3-ef5010e48ce8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:14.969647 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 943/1863] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:14.971067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c9847-bd6c-4844-84bf-59a66c74ece4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.972640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c9847-bd6c-4844-84bf-59a66c74ece4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.972944 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c9847-bd6c-4844-84bf-59a66c74ece4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.996482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 921/1864] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:14 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:15.000401 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9a866-bcf0-4259-99e3-ef5010e48ce8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:15.006678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9e3c9847-bd6c-4844-84bf-59a66c74ece4 None None] MFA Rules not processed for user `4fbe8413705c4f8fbadc1d115e1cb174`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:15.008446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9e3c9847-bd6c-4844-84bf-59a66c74ece4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:15.020779 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:15.074344 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9a866-bcf0-4259-99e3-ef5010e48ce8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:15.081725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b333da2-9b33-4732-96a9-97b396428339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:15.082495 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b333da2-9b33-4732-96a9-97b396428339 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:15.082849 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b333da2-9b33-4732-96a9-97b396428339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:15.083200 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b333da2-9b33-4732-96a9-97b396428339 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:15.084007 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b333da2-9b33-4732-96a9-97b396428339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:15.086478 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b333da2-9b33-4732-96a9-97b396428339 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:15.090334 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 944/1865] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:15.099443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c9847-bd6c-4844-84bf-59a66c74ece4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:15.101642 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9e3c9847-bd6c-4844-84bf-59a66c74ece4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:15.114279 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 922/1866] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:14 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:15.116055 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b333da2-9b33-4732-96a9-97b396428339 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:15.128401 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b333da2-9b33-4732-96a9-97b396428339 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:15.134048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f7da8-90b4-4772-ab1f-ccfd0a7fbd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:15.134733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f7da8-90b4-4772-ab1f-ccfd0a7fbd25 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:15.135020 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f7da8-90b4-4772-ab1f-ccfd0a7fbd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:15.135300 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f7da8-90b4-4772-ab1f-ccfd0a7fbd25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:15.136279 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f7da8-90b4-4772-ab1f-ccfd0a7fbd25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:15.137755 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f7da8-90b4-4772-ab1f-ccfd0a7fbd25 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:15.149175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 923/1867] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:15.153276 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f7da8-90b4-4772-ab1f-ccfd0a7fbd25 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:15.164117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f7da8-90b4-4772-ab1f-ccfd0a7fbd25 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:15.169198 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d1f65-e919-4935-856b-7bf2a5fc811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:15.169873 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d1f65-e919-4935-856b-7bf2a5fc811b admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:15.170182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d1f65-e919-4935-856b-7bf2a5fc811b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:15.170439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d1f65-e919-4935-856b-7bf2a5fc811b admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:15.171167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d1f65-e919-4935-856b-7bf2a5fc811b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:15.172928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d1f65-e919-4935-856b-7bf2a5fc811b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:15.175734 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c9847-bd6c-4844-84bf-59a66c74ece4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:15.180424 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc031d4-03ab-4ec6-978c-6a565ef68439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:15.181396 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc031d4-03ab-4ec6-978c-6a565ef68439 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:15.181838 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc031d4-03ab-4ec6-978c-6a565ef68439 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:15.182274 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc031d4-03ab-4ec6-978c-6a565ef68439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:15.184303 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7cc031d4-03ab-4ec6-978c-6a565ef68439 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:15.185628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 924/1868] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:15.189586 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d1f65-e919-4935-856b-7bf2a5fc811b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:15.201556 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d1f65-e919-4935-856b-7bf2a5fc811b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:15.220594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11c279-c1c6-49c4-94f6-fd5c83b0fedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:15.221658 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11c279-c1c6-49c4-94f6-fd5c83b0fedf admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:15.221951 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11c279-c1c6-49c4-94f6-fd5c83b0fedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:15.222229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11c279-c1c6-49c4-94f6-fd5c83b0fedf admin admin] PATH_INFO: `/v3/projects/ccf82c5c75854c13a447055c96c8f62c/users/bdd162bec27047929e11a6683d0ce775/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:15.225848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:15.241119 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11c279-c1c6-49c4-94f6-fd5c83b0fedf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf82c5c75854c13a447055c96c8f62c, user_id=bdd162bec27047929e11a6683d0ce775, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:15.243842 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11c279-c1c6-49c4-94f6-fd5c83b0fedf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:15.258788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc031d4-03ab-4ec6-978c-6a565ef68439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:15.259108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 925/1869] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:15 2022] PUT /identity/v3/projects/ccf82c5c75854c13a447055c96c8f62c/users/bdd162bec27047929e11a6683d0ce775/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:15.260660 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc031d4-03ab-4ec6-978c-6a565ef68439 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:15.271211 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5012ed9-2b15-4a1a-9cf8-2e6101da7eff None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:15.271567 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5012ed9-2b15-4a1a-9cf8-2e6101da7eff None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:15.271876 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5012ed9-2b15-4a1a-9cf8-2e6101da7eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:15.276144 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 945/1870] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:15.302531 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b5012ed9-2b15-4a1a-9cf8-2e6101da7eff None None] MFA Rules not processed for user `bdd162bec27047929e11a6683d0ce775`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:15.303746 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b5012ed9-2b15-4a1a-9cf8-2e6101da7eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:15.389275 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 926/1871] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:15.395148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc031d4-03ab-4ec6-978c-6a565ef68439 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:15.407405 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc031d4-03ab-4ec6-978c-6a565ef68439 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:15.463717 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5012ed9-2b15-4a1a-9cf8-2e6101da7eff None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:15.465923 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b5012ed9-2b15-4a1a-9cf8-2e6101da7eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:15.490638 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fbce6-1268-420c-bfc4-20087da26e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:15.492491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fbce6-1268-420c-bfc4-20087da26e7b admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:15.492943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fbce6-1268-420c-bfc4-20087da26e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:15.493477 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fbce6-1268-420c-bfc4-20087da26e7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:15.506539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fbce6-1268-420c-bfc4-20087da26e7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:15.512813 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fbce6-1268-420c-bfc4-20087da26e7b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:15.565041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:15.567686 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 946/1872] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:15 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:15.572451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fbce6-1268-420c-bfc4-20087da26e7b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:15.591468 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5012ed9-2b15-4a1a-9cf8-2e6101da7eff None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:15.708397 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fbce6-1268-420c-bfc4-20087da26e7b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:15.714016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3b088-3a81-4817-8539-ff31c7c68dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:15.714904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3b088-3a81-4817-8539-ff31c7c68dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:15.715193 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3b088-3a81-4817-8539-ff31c7c68dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:15.715490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3b088-3a81-4817-8539-ff31c7c68dbf admin admin] PATH_INFO: `/v3/projects/94330b2869ed47028eeee9e76ba8a4b1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:15.721814 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3b088-3a81-4817-8539-ff31c7c68dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=94330b2869ed47028eeee9e76ba8a4b1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:15.723468 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a58db7-ec54-4edc-a100-4d8aa106e7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:15.724042 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3b088-3a81-4817-8539-ff31c7c68dbf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:15.724762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a58db7-ec54-4edc-a100-4d8aa106e7cd admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:15.725734 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a58db7-ec54-4edc-a100-4d8aa106e7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:15.726225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a58db7-ec54-4edc-a100-4d8aa106e7cd admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:15.727960 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a58db7-ec54-4edc-a100-4d8aa106e7cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:15.730401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a58db7-ec54-4edc-a100-4d8aa106e7cd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:15.760076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 947/1873] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:15 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:07:15.763223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a58db7-ec54-4edc-a100-4d8aa106e7cd admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:15.778116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c3f3b088-3a81-4817-8539-ff31c7c68dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94330b2869ed47028eeee9e76ba8a4b1', 'request_id': 'req-c3f3b088-3a81-4817-8539-ff31c7c68dbf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:15.778234 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a58db7-ec54-4edc-a100-4d8aa106e7cd admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:15.786934 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c3f3b088-3a81-4817-8539-ff31c7c68dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94330b2869ed47028eeee9e76ba8a4b1', 'request_id': 'req-c3f3b088-3a81-4817-8539-ff31c7c68dbf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:15.793509 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c3f3b088-3a81-4817-8539-ff31c7c68dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94330b2869ed47028eeee9e76ba8a4b1', 'request_id': 'req-c3f3b088-3a81-4817-8539-ff31c7c68dbf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:15.805422 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c3f3b088-3a81-4817-8539-ff31c7c68dbf admin admin] The token cache is being invalidate because project 94330b2869ed47028eeee9e76ba8a4b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:15.805714 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c3f3b088-3a81-4817-8539-ff31c7c68dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:15.806370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c3f3b088-3a81-4817-8539-ff31c7c68dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:15.807963 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 927/1874] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:15 2022] DELETE /identity/v3/projects/94330b2869ed47028eeee9e76ba8a4b1 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:15.811725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3b088-3a81-4817-8539-ff31c7c68dbf admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:15.813066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c3f3b088-3a81-4817-8539-ff31c7c68dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:15.828321 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:15.843292 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c92ff-d90b-4e99-b43e-1567a96a5648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:15.843992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c92ff-d90b-4e99-b43e-1567a96a5648 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:15.844273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c92ff-d90b-4e99-b43e-1567a96a5648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:15.844548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c92ff-d90b-4e99-b43e-1567a96a5648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:15.845368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c92ff-d90b-4e99-b43e-1567a96a5648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:15.847880 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c92ff-d90b-4e99-b43e-1567a96a5648 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:15.858341 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 948/1875] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:07:15.863795 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c92ff-d90b-4e99-b43e-1567a96a5648 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:15.865669 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bd0c92ff-d90b-4e99-b43e-1567a96a5648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:15.878828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c92ff-d90b-4e99-b43e-1567a96a5648 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:15.881793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3b088-3a81-4817-8539-ff31c7c68dbf admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:15.883891 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7cb9d-59ba-4748-8495-bf455e1ee659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:15.885096 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7cb9d-59ba-4748-8495-bf455e1ee659 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:15.885551 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7cb9d-59ba-4748-8495-bf455e1ee659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:15.885982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7cb9d-59ba-4748-8495-bf455e1ee659 admin admin] PATH_INFO: `/v3/projects/dbcd8090194f4f639102f9d400d2ade8/users/815d2346e33d464790d4c1269a4378a7/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:15.886842 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e7504-e234-4e17-bea9-225137e0051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:15.887832 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e7504-e234-4e17-bea9-225137e0051d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:15.888127 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e7504-e234-4e17-bea9-225137e0051d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:15.888520 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e7504-e234-4e17-bea9-225137e0051d admin admin] PATH_INFO: `/v3/users/7c4e14fbb58e40169266e344fb06c000` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:15.890061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e7504-e234-4e17-bea9-225137e0051d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c4e14fbb58e40169266e344fb06c000)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:15.892359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e7504-e234-4e17-bea9-225137e0051d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:15.902428 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7cb9d-59ba-4748-8495-bf455e1ee659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbcd8090194f4f639102f9d400d2ade8, user_id=815d2346e33d464790d4c1269a4378a7, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:15.905164 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7cb9d-59ba-4748-8495-bf455e1ee659 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:15.922179 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 949/1876] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:15 2022] PUT /identity/v3/projects/dbcd8090194f4f639102f9d400d2ade8/users/815d2346e33d464790d4c1269a4378a7/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:15.927432 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:15.928323 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7cb9d-59ba-4748-8495-bf455e1ee659 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:15.954406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f75e7504-e234-4e17-bea9-225137e0051d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c4e14fbb58e40169266e344fb06c000'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:15.964213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f75e7504-e234-4e17-bea9-225137e0051d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c4e14fbb58e40169266e344fb06c000'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:15.980651 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f75e7504-e234-4e17-bea9-225137e0051d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c4e14fbb58e40169266e344fb06c000'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:15.981711 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f75e7504-e234-4e17-bea9-225137e0051d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c4e14fbb58e40169266e344fb06c000'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:15.982337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f75e7504-e234-4e17-bea9-225137e0051d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c4e14fbb58e40169266e344fb06c000'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:15.997313 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 928/1877] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:15 2022] DELETE /identity/v3/users/7c4e14fbb58e40169266e344fb06c000 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:16.005115 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7cb9d-59ba-4748-8495-bf455e1ee659 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:16.079902 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecbc5a-052a-4b30-a4aa-20ced30974ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:16.081124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecbc5a-052a-4b30-a4aa-20ced30974ec admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:16.081886 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecbc5a-052a-4b30-a4aa-20ced30974ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:16.081886 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecbc5a-052a-4b30-a4aa-20ced30974ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:16.082573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ecbc5a-052a-4b30-a4aa-20ced30974ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:16.084209 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ecbc5a-052a-4b30-a4aa-20ced30974ec admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:16.097953 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 950/1878] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:07:16.099158 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e7504-e234-4e17-bea9-225137e0051d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:16.100687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f75e7504-e234-4e17-bea9-225137e0051d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:16.116207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e7504-e234-4e17-bea9-225137e0051d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:16.120992 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62847b-3943-4cd8-a4fb-33a4062f3121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:16.121913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62847b-3943-4cd8-a4fb-33a4062f3121 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:16.122242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62847b-3943-4cd8-a4fb-33a4062f3121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:16.122521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62847b-3943-4cd8-a4fb-33a4062f3121 admin admin] PATH_INFO: `/v3/projects/dbcd8090194f4f639102f9d400d2ade8/users/815d2346e33d464790d4c1269a4378a7/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:16.124484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62847b-3943-4cd8-a4fb-33a4062f3121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbcd8090194f4f639102f9d400d2ade8, user_id=815d2346e33d464790d4c1269a4378a7, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:16.127108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62847b-3943-4cd8-a4fb-33a4062f3121 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:16.138907 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 929/1879] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:16 2022] PUT /identity/v3/projects/dbcd8090194f4f639102f9d400d2ade8/users/815d2346e33d464790d4c1269a4378a7/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:16.149708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20723d-7f9e-4b18-8782-11a9667a6eb6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:16.150014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20723d-7f9e-4b18-8782-11a9667a6eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:16.150303 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20723d-7f9e-4b18-8782-11a9667a6eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:16.178443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-df20723d-7f9e-4b18-8782-11a9667a6eb6 None None] MFA Rules not processed for user `815d2346e33d464790d4c1269a4378a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:16.179681 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-df20723d-7f9e-4b18-8782-11a9667a6eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:16.238262 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:16.263977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 951/1880] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:16.275146 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62847b-3943-4cd8-a4fb-33a4062f3121 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:16.277722 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ea62847b-3943-4cd8-a4fb-33a4062f3121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:16.304313 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20723d-7f9e-4b18-8782-11a9667a6eb6 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:16.305919 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-df20723d-7f9e-4b18-8782-11a9667a6eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:16.360218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62847b-3943-4cd8-a4fb-33a4062f3121 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:16.365259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9882cb-a9fb-48be-af92-180972ac07a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:16.366237 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9882cb-a9fb-48be-af92-180972ac07a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:16.366531 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9882cb-a9fb-48be-af92-180972ac07a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:16.367180 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9882cb-a9fb-48be-af92-180972ac07a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:16.369390 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1a9882cb-a9fb-48be-af92-180972ac07a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:16.401486 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20723d-7f9e-4b18-8782-11a9667a6eb6 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:16.406339 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7222dba-37f9-464e-be1e-86732c9c6a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:16.407207 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7222dba-37f9-464e-be1e-86732c9c6a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:16.407620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7222dba-37f9-464e-be1e-86732c9c6a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:16.407997 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7222dba-37f9-464e-be1e-86732c9c6a29 admin admin] PATH_INFO: `/v3/projects/495bfec33794499aa4a8d4b9c7e8f6be` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:16.409918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7222dba-37f9-464e-be1e-86732c9c6a29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=495bfec33794499aa4a8d4b9c7e8f6be)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:16.411886 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7222dba-37f9-464e-be1e-86732c9c6a29 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:16.439356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9882cb-a9fb-48be-af92-180972ac07a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:16.441396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9882cb-a9fb-48be-af92-180972ac07a2 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:16.450595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 930/1881] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:16.466630 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d7222dba-37f9-464e-be1e-86732c9c6a29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495bfec33794499aa4a8d4b9c7e8f6be', 'request_id': 'req-d7222dba-37f9-464e-be1e-86732c9c6a29'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:16.473613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d7222dba-37f9-464e-be1e-86732c9c6a29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495bfec33794499aa4a8d4b9c7e8f6be', 'request_id': 'req-d7222dba-37f9-464e-be1e-86732c9c6a29'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:16.481621 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d7222dba-37f9-464e-be1e-86732c9c6a29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495bfec33794499aa4a8d4b9c7e8f6be', 'request_id': 'req-d7222dba-37f9-464e-be1e-86732c9c6a29'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:16.493048 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d7222dba-37f9-464e-be1e-86732c9c6a29 admin admin] The token cache is being invalidate because project 495bfec33794499aa4a8d4b9c7e8f6be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:16.493343 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d7222dba-37f9-464e-be1e-86732c9c6a29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:16.494032 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d7222dba-37f9-464e-be1e-86732c9c6a29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:16.495607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 952/1882] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:16 2022] DELETE /identity/v3/projects/495bfec33794499aa4a8d4b9c7e8f6be => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:16.500877 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33af4a2-ee8e-4db9-a91c-4ebb8aeab7e7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:16.501169 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33af4a2-ee8e-4db9-a91c-4ebb8aeab7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:16.501458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33af4a2-ee8e-4db9-a91c-4ebb8aeab7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:16.519563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f33af4a2-ee8e-4db9-a91c-4ebb8aeab7e7 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:16.520733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f33af4a2-ee8e-4db9-a91c-4ebb8aeab7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:16.569127 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:16.604132 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 931/1883] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:07:16.605791 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd712589-1ef6-462c-a508-2604be9fcbe8 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:16.606076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd712589-1ef6-462c-a508-2604be9fcbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:16.606594 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd712589-1ef6-462c-a508-2604be9fcbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:16.627128 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-fd712589-1ef6-462c-a508-2604be9fcbe8 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:16.629236 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-fd712589-1ef6-462c-a508-2604be9fcbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:16.637837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 953/1884] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:16.642279 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33af4a2-ee8e-4db9-a91c-4ebb8aeab7e7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:16.653360 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33af4a2-ee8e-4db9-a91c-4ebb8aeab7e7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:16.658321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb75b9-c5b4-432d-a628-4ed42a2e180e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:16.659165 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb75b9-c5b4-432d-a628-4ed42a2e180e admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:16.659454 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb75b9-c5b4-432d-a628-4ed42a2e180e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:16.659741 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb75b9-c5b4-432d-a628-4ed42a2e180e admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:16.660518 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb75b9-c5b4-432d-a628-4ed42a2e180e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:07:16.660835 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb75b9-c5b4-432d-a628-4ed42a2e180e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:16.662515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb75b9-c5b4-432d-a628-4ed42a2e180e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:16.675777 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 932/1885] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:07:16.680305 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd712589-1ef6-462c-a508-2604be9fcbe8 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:16.691479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd712589-1ef6-462c-a508-2604be9fcbe8 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:16.698968 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e74cb3-764c-43ae-b594-b964a7ea424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:16.700915 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e74cb3-764c-43ae-b594-b964a7ea424e admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:16.701216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e74cb3-764c-43ae-b594-b964a7ea424e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:16.701534 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e74cb3-764c-43ae-b594-b964a7ea424e admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:16.702340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e74cb3-764c-43ae-b594-b964a7ea424e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:16.707265 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e74cb3-764c-43ae-b594-b964a7ea424e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:16.769183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 954/1886] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:16 2022] POST /identity/v3/projects => generated 401 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:16.770417 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb75b9-c5b4-432d-a628-4ed42a2e180e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:16.786242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb75b9-c5b4-432d-a628-4ed42a2e180e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:16.902807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab33107-1e58-4ab5-b975-6f79f2b4eb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:16.902807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab33107-1e58-4ab5-b975-6f79f2b4eb8d admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:16.902807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab33107-1e58-4ab5-b975-6f79f2b4eb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:16.902807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab33107-1e58-4ab5-b975-6f79f2b4eb8d admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:16.903215 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab33107-1e58-4ab5-b975-6f79f2b4eb8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:16.903215 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab33107-1e58-4ab5-b975-6f79f2b4eb8d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:16.930854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 933/1887] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:16 2022] POST /identity/v3/users => generated 301 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:16.932093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e74cb3-764c-43ae-b594-b964a7ea424e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:16.946270 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e74cb3-764c-43ae-b594-b964a7ea424e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:16.951550 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c866529-fe24-45a1-8b06-05c4c9b11f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:16.952562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c866529-fe24-45a1-8b06-05c4c9b11f19 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:16.952913 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c866529-fe24-45a1-8b06-05c4c9b11f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:16.953336 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c866529-fe24-45a1-8b06-05c4c9b11f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:16.954216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c866529-fe24-45a1-8b06-05c4c9b11f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:16.956430 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c866529-fe24-45a1-8b06-05c4c9b11f19 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:16.966980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 955/1888] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:16.971064 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab33107-1e58-4ab5-b975-6f79f2b4eb8d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:16.981737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab33107-1e58-4ab5-b975-6f79f2b4eb8d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:16.986639 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a349d8-f128-4873-b13e-2441c7109ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:16.987461 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a349d8-f128-4873-b13e-2441c7109ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:16.987612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a349d8-f128-4873-b13e-2441c7109ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:16.987930 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a349d8-f128-4873-b13e-2441c7109ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:16.988659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a349d8-f128-4873-b13e-2441c7109ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:16.990244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a349d8-f128-4873-b13e-2441c7109ad4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:17.000099 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 934/1889] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:17.005092 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c866529-fe24-45a1-8b06-05c4c9b11f19 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:17.015528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c866529-fe24-45a1-8b06-05c4c9b11f19 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:17.022042 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b2517-6cc1-48f8-8556-9ad708085936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:17.022937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b2517-6cc1-48f8-8556-9ad708085936 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:17.023230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b2517-6cc1-48f8-8556-9ad708085936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:17.023515 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b2517-6cc1-48f8-8556-9ad708085936 admin admin] PATH_INFO: `/v3/projects/a92fc1f457094964888a0fac313556d2/users/6e68bf9572214aea80fca10bc4cb0cdc/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:17.038796 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b2517-6cc1-48f8-8556-9ad708085936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92fc1f457094964888a0fac313556d2, user_id=6e68bf9572214aea80fca10bc4cb0cdc, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:17.041480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b2517-6cc1-48f8-8556-9ad708085936 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:17.054599 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 956/1890] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:17 2022] PUT /identity/v3/projects/a92fc1f457094964888a0fac313556d2/users/6e68bf9572214aea80fca10bc4cb0cdc/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:17.066275 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ca682-0ce2-4f7b-93b3-8fa0b6458c9d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:17.066568 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ca682-0ce2-4f7b-93b3-8fa0b6458c9d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:17.066892 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ca682-0ce2-4f7b-93b3-8fa0b6458c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:17.094425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d48ca682-0ce2-4f7b-93b3-8fa0b6458c9d None None] MFA Rules not processed for user `6e68bf9572214aea80fca10bc4cb0cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:17.095630 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d48ca682-0ce2-4f7b-93b3-8fa0b6458c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:17.162304 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 935/1891] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:17.166697 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b2517-6cc1-48f8-8556-9ad708085936 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:17.181028 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:17.233554 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b2517-6cc1-48f8-8556-9ad708085936 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:17.239829 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0601c8f-cd10-4db7-ae6c-eff9b7bfa205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:17.240515 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0601c8f-cd10-4db7-ae6c-eff9b7bfa205 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:17.240802 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0601c8f-cd10-4db7-ae6c-eff9b7bfa205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:17.241092 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0601c8f-cd10-4db7-ae6c-eff9b7bfa205 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:17.241784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0601c8f-cd10-4db7-ae6c-eff9b7bfa205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:17.243676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0601c8f-cd10-4db7-ae6c-eff9b7bfa205 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:17.268033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 957/1892] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:17 2022] POST /identity/v3/projects => generated 399 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:07:17.272824 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ca682-0ce2-4f7b-93b3-8fa0b6458c9d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:17.283286 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ca682-0ce2-4f7b-93b3-8fa0b6458c9d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:17.322768 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:17.340504 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9c5d3-023b-453f-9797-82f087522bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:17.341136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9c5d3-023b-453f-9797-82f087522bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:17.341418 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9c5d3-023b-453f-9797-82f087522bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:17.341690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9c5d3-023b-453f-9797-82f087522bf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:17.342516 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9c5d3-023b-453f-9797-82f087522bf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:17.344503 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9c5d3-023b-453f-9797-82f087522bf2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:17.369048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 936/1893] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:17 2022] POST /identity/v3/users => generated 306 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:17.373367 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0601c8f-cd10-4db7-ae6c-eff9b7bfa205 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:17.386216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0601c8f-cd10-4db7-ae6c-eff9b7bfa205 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:17.391139 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66691f-1321-41f8-92a4-c4832e1006a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:17.392231 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66691f-1321-41f8-92a4-c4832e1006a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:17.392231 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66691f-1321-41f8-92a4-c4832e1006a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:17.392502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66691f-1321-41f8-92a4-c4832e1006a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:17.393930 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66691f-1321-41f8-92a4-c4832e1006a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:17.395696 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66691f-1321-41f8-92a4-c4832e1006a2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:17.426226 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 958/1894] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:17.430228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9c5d3-023b-453f-9797-82f087522bf2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:17.440980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9c5d3-023b-453f-9797-82f087522bf2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:17.445959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a789c-9799-4645-9192-a2f4e704feee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:17.446849 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a789c-9799-4645-9192-a2f4e704feee admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:17.447134 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a789c-9799-4645-9192-a2f4e704feee admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:17.447419 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a789c-9799-4645-9192-a2f4e704feee admin admin] PATH_INFO: `/v3/projects/797427129f4a4b57950c7bafc3b7b24a/users/54bd54e9267c468894a892f48a8b30c3/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:17.464281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a789c-9799-4645-9192-a2f4e704feee admin admin] RBAC: Authorizing `identity:create_grant(project_id=797427129f4a4b57950c7bafc3b7b24a, user_id=54bd54e9267c468894a892f48a8b30c3, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:17.467077 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a789c-9799-4645-9192-a2f4e704feee admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:17.483021 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 937/1895] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:17 2022] PUT /identity/v3/projects/797427129f4a4b57950c7bafc3b7b24a/users/54bd54e9267c468894a892f48a8b30c3/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:17.487868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66691f-1321-41f8-92a4-c4832e1006a2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:17.498760 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66691f-1321-41f8-92a4-c4832e1006a2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:17.569312 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1a66a-060a-472a-9707-ccddcf1c0354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:17.569992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1a66a-060a-472a-9707-ccddcf1c0354 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:17.570275 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1a66a-060a-472a-9707-ccddcf1c0354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:17.570553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1a66a-060a-472a-9707-ccddcf1c0354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:17.571282 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1a66a-060a-472a-9707-ccddcf1c0354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:17.572910 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1a66a-060a-472a-9707-ccddcf1c0354 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:17.584672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 959/1896] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:17.588799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a789c-9799-4645-9192-a2f4e704feee admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:17.600095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a789c-9799-4645-9192-a2f4e704feee admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:17.604795 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed08571-a597-4da9-a60e-2994978bbcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:17.605681 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed08571-a597-4da9-a60e-2994978bbcbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:17.605975 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed08571-a597-4da9-a60e-2994978bbcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:17.606258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed08571-a597-4da9-a60e-2994978bbcbe admin admin] PATH_INFO: `/v3/projects/797427129f4a4b57950c7bafc3b7b24a/users/54bd54e9267c468894a892f48a8b30c3/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:17.608239 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed08571-a597-4da9-a60e-2994978bbcbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=797427129f4a4b57950c7bafc3b7b24a, user_id=54bd54e9267c468894a892f48a8b30c3, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:17.611224 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed08571-a597-4da9-a60e-2994978bbcbe admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:17.621419 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 938/1897] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:17 2022] PUT /identity/v3/projects/797427129f4a4b57950c7bafc3b7b24a/users/54bd54e9267c468894a892f48a8b30c3/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:17.631700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b17735-8287-4820-98ae-048e6a0ddf83 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:17.632066 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b17735-8287-4820-98ae-048e6a0ddf83 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:17.632353 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b17735-8287-4820-98ae-048e6a0ddf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:17.660490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-02b17735-8287-4820-98ae-048e6a0ddf83 None None] MFA Rules not processed for user `54bd54e9267c468894a892f48a8b30c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:17.661782 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-02b17735-8287-4820-98ae-048e6a0ddf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:17.731165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 960/1898] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:17 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:17.742757 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed08571-a597-4da9-a60e-2994978bbcbe admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:17.744528 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9ed08571-a597-4da9-a60e-2994978bbcbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:17.807451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed08571-a597-4da9-a60e-2994978bbcbe admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:17.811277 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6807e0-5caa-4670-a61a-106a6c606e94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:17.811999 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6807e0-5caa-4670-a61a-106a6c606e94 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:17.812294 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6807e0-5caa-4670-a61a-106a6c606e94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:17.812578 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6807e0-5caa-4670-a61a-106a6c606e94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:17.825635 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6807e0-5caa-4670-a61a-106a6c606e94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:17.827300 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6807e0-5caa-4670-a61a-106a6c606e94 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:17.840009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 939/1899] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:17 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:18.026034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b17735-8287-4820-98ae-048e6a0ddf83 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:18.028664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-02b17735-8287-4820-98ae-048e6a0ddf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:18.052788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b17735-8287-4820-98ae-048e6a0ddf83 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:18.063895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3404e-47a9-4c80-87d1-bef086397c35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:18.065096 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3404e-47a9-4c80-87d1-bef086397c35 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:18.066264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3404e-47a9-4c80-87d1-bef086397c35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:18.066786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3404e-47a9-4c80-87d1-bef086397c35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:18.075179 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:18.155878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3404e-47a9-4c80-87d1-bef086397c35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:18.158121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3404e-47a9-4c80-87d1-bef086397c35 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:18.172007 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 961/1900] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:22.347222 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6807e0-5caa-4670-a61a-106a6c606e94 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:22.355747 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6807e0-5caa-4670-a61a-106a6c606e94 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:22.360355 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d53e-595b-4e15-af25-d79a0dc60d2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:22.361464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d53e-595b-4e15-af25-d79a0dc60d2b service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:22.362343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d53e-595b-4e15-af25-d79a0dc60d2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:22.362635 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d53e-595b-4e15-af25-d79a0dc60d2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:22.364508 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-72d9d53e-595b-4e15-af25-d79a0dc60d2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:22.446774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9d53e-595b-4e15-af25-d79a0dc60d2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:22.448267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9d53e-595b-4e15-af25-d79a0dc60d2b service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:22.458513 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 940/1901] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:27.326540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3404e-47a9-4c80-87d1-bef086397c35 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:27.334974 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3404e-47a9-4c80-87d1-bef086397c35 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:27.338659 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61b536-6a62-439c-873c-4a30f54b056c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:27.339303 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61b536-6a62-439c-873c-4a30f54b056c service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:27.339591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61b536-6a62-439c-873c-4a30f54b056c service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:27.339916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61b536-6a62-439c-873c-4a30f54b056c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:27.341735 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ff61b536-6a62-439c-873c-4a30f54b056c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:27.412867 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61b536-6a62-439c-873c-4a30f54b056c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:27.414417 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61b536-6a62-439c-873c-4a30f54b056c service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:27.425163 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 962/1902] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:28.195792 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d53e-595b-4e15-af25-d79a0dc60d2b service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:28.231270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:28.272857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d53e-595b-4e15-af25-d79a0dc60d2b service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:28.281801 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101858c1-1563-4369-9097-4ec39b80db7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:28.283258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101858c1-1563-4369-9097-4ec39b80db7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:28.284205 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101858c1-1563-4369-9097-4ec39b80db7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:28.284688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101858c1-1563-4369-9097-4ec39b80db7c admin admin] PATH_INFO: `/v3/users/6e68bf9572214aea80fca10bc4cb0cdc` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:28.286307 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101858c1-1563-4369-9097-4ec39b80db7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e68bf9572214aea80fca10bc4cb0cdc)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:28.289177 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101858c1-1563-4369-9097-4ec39b80db7c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:28.359933 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-101858c1-1563-4369-9097-4ec39b80db7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e68bf9572214aea80fca10bc4cb0cdc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:28.370257 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-101858c1-1563-4369-9097-4ec39b80db7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e68bf9572214aea80fca10bc4cb0cdc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:28.391948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-101858c1-1563-4369-9097-4ec39b80db7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e68bf9572214aea80fca10bc4cb0cdc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:28.393144 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-101858c1-1563-4369-9097-4ec39b80db7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e68bf9572214aea80fca10bc4cb0cdc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:28.394102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-101858c1-1563-4369-9097-4ec39b80db7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e68bf9572214aea80fca10bc4cb0cdc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:28.411246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 941/1903] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:28 2022] DELETE /identity/v3/users/6e68bf9572214aea80fca10bc4cb0cdc => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:28.415857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41491fb-331e-4f15-b9c5-3513977c6679 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:28.416352 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41491fb-331e-4f15-b9c5-3513977c6679 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:28.416432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41491fb-331e-4f15-b9c5-3513977c6679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:28.437138 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e41491fb-331e-4f15-b9c5-3513977c6679 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:28.439024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e41491fb-331e-4f15-b9c5-3513977c6679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:28.512547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 963/1904] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:28.523847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101858c1-1563-4369-9097-4ec39b80db7c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:28.525514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-101858c1-1563-4369-9097-4ec39b80db7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:28.590323 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101858c1-1563-4369-9097-4ec39b80db7c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:28.593961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1db18-b0f1-4718-8124-05fbb8aacaaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:28.594616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1db18-b0f1-4718-8124-05fbb8aacaaf service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:28.594905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1db18-b0f1-4718-8124-05fbb8aacaaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:28.595184 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1db18-b0f1-4718-8124-05fbb8aacaaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:28.604486 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1db18-b0f1-4718-8124-05fbb8aacaaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:28.605942 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1db18-b0f1-4718-8124-05fbb8aacaaf service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:28.616206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 942/1905] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:28.950600 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41491fb-331e-4f15-b9c5-3513977c6679 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:28.954581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e41491fb-331e-4f15-b9c5-3513977c6679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:28.992037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41491fb-331e-4f15-b9c5-3513977c6679 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:29.006085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e08a6b-7828-4824-a10b-840d4d9f1086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:29.007041 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e08a6b-7828-4824-a10b-840d4d9f1086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:29.007654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e08a6b-7828-4824-a10b-840d4d9f1086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:29.008026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e08a6b-7828-4824-a10b-840d4d9f1086 admin admin] PATH_INFO: `/v3/projects/a92fc1f457094964888a0fac313556d2` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:29.015894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e08a6b-7828-4824-a10b-840d4d9f1086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92fc1f457094964888a0fac313556d2)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:29.017916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e08a6b-7828-4824-a10b-840d4d9f1086 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:29.077994 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:29.104728 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e9e08a6b-7828-4824-a10b-840d4d9f1086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92fc1f457094964888a0fac313556d2', 'request_id': 'req-e9e08a6b-7828-4824-a10b-840d4d9f1086'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:29.122842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e9e08a6b-7828-4824-a10b-840d4d9f1086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92fc1f457094964888a0fac313556d2', 'request_id': 'req-e9e08a6b-7828-4824-a10b-840d4d9f1086'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:29.132967 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e9e08a6b-7828-4824-a10b-840d4d9f1086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92fc1f457094964888a0fac313556d2', 'request_id': 'req-e9e08a6b-7828-4824-a10b-840d4d9f1086'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:29.146345 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e9e08a6b-7828-4824-a10b-840d4d9f1086 admin admin] The token cache is being invalidate because project a92fc1f457094964888a0fac313556d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:29.147074 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e9e08a6b-7828-4824-a10b-840d4d9f1086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:29.147950 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e9e08a6b-7828-4824-a10b-840d4d9f1086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:29.150180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 964/1906] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:28 2022] DELETE /identity/v3/projects/a92fc1f457094964888a0fac313556d2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:29.154637 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1db18-b0f1-4718-8124-05fbb8aacaaf service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:29.179980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1db18-b0f1-4718-8124-05fbb8aacaaf service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:29.235183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:29.251913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7916a71-88c1-4944-b784-8ebe7c87564e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:29.253479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7916a71-88c1-4944-b784-8ebe7c87564e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:29.253769 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7916a71-88c1-4944-b784-8ebe7c87564e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:29.254051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7916a71-88c1-4944-b784-8ebe7c87564e admin admin] PATH_INFO: `/v3/users/54bd54e9267c468894a892f48a8b30c3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:29.255273 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7916a71-88c1-4944-b784-8ebe7c87564e admin admin] RBAC: Authorizing `identity:delete_user(user_id=54bd54e9267c468894a892f48a8b30c3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:29.257239 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7916a71-88c1-4944-b784-8ebe7c87564e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:29.306955 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e7916a71-88c1-4944-b784-8ebe7c87564e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54bd54e9267c468894a892f48a8b30c3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:29.323077 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e7916a71-88c1-4944-b784-8ebe7c87564e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54bd54e9267c468894a892f48a8b30c3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:29.338460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e7916a71-88c1-4944-b784-8ebe7c87564e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54bd54e9267c468894a892f48a8b30c3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:29.339158 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e7916a71-88c1-4944-b784-8ebe7c87564e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54bd54e9267c468894a892f48a8b30c3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:29.339774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e7916a71-88c1-4944-b784-8ebe7c87564e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54bd54e9267c468894a892f48a8b30c3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:29.352537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 943/1907] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:29 2022] DELETE /identity/v3/users/54bd54e9267c468894a892f48a8b30c3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:29.772000 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e08a6b-7828-4824-a10b-840d4d9f1086 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:29.774074 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e9e08a6b-7828-4824-a10b-840d4d9f1086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:29.788881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e08a6b-7828-4824-a10b-840d4d9f1086 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:29.855596 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489fd81-41fd-4d7c-b9a2-590d4db7d81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:29.856700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489fd81-41fd-4d7c-b9a2-590d4db7d81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:29.857126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489fd81-41fd-4d7c-b9a2-590d4db7d81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:29.857557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489fd81-41fd-4d7c-b9a2-590d4db7d81c admin admin] PATH_INFO: `/v3/projects/797427129f4a4b57950c7bafc3b7b24a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:29.859285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489fd81-41fd-4d7c-b9a2-590d4db7d81c admin admin] RBAC: Authorizing `identity:delete_project(project_id=797427129f4a4b57950c7bafc3b7b24a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:29.863791 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489fd81-41fd-4d7c-b9a2-590d4db7d81c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:29.917931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6489fd81-41fd-4d7c-b9a2-590d4db7d81c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '797427129f4a4b57950c7bafc3b7b24a', 'request_id': 'req-6489fd81-41fd-4d7c-b9a2-590d4db7d81c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:29.924123 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6489fd81-41fd-4d7c-b9a2-590d4db7d81c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '797427129f4a4b57950c7bafc3b7b24a', 'request_id': 'req-6489fd81-41fd-4d7c-b9a2-590d4db7d81c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:29.932222 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6489fd81-41fd-4d7c-b9a2-590d4db7d81c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '797427129f4a4b57950c7bafc3b7b24a', 'request_id': 'req-6489fd81-41fd-4d7c-b9a2-590d4db7d81c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:29.943155 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6489fd81-41fd-4d7c-b9a2-590d4db7d81c admin admin] The token cache is being invalidate because project 797427129f4a4b57950c7bafc3b7b24a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:29.943446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6489fd81-41fd-4d7c-b9a2-590d4db7d81c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:29.944105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6489fd81-41fd-4d7c-b9a2-590d4db7d81c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:29.945666 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 965/1908] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:29 2022] DELETE /identity/v3/projects/797427129f4a4b57950c7bafc3b7b24a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:29.950618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a261f-d56b-49cd-967c-f27a75a58906 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:29.950913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a261f-d56b-49cd-967c-f27a75a58906 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:29.951224 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a261f-d56b-49cd-967c-f27a75a58906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:29.970330 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ca1a261f-d56b-49cd-967c-f27a75a58906 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:29.971722 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ca1a261f-d56b-49cd-967c-f27a75a58906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:30.035718 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 944/1909] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:07:30.043539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8e017-a987-4caf-8c6e-c111907430fc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:30.043842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8e017-a987-4caf-8c6e-c111907430fc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:30.044143 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8e017-a987-4caf-8c6e-c111907430fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:30.062781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-11d8e017-a987-4caf-8c6e-c111907430fc None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:30.063988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-11d8e017-a987-4caf-8c6e-c111907430fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:30.073318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 966/1910] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:30.077305 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a261f-d56b-49cd-967c-f27a75a58906 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:30.087719 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a261f-d56b-49cd-967c-f27a75a58906 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:30.092456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9326c0-70b0-4e62-af27-a97f2d6c9303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:30.093182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9326c0-70b0-4e62-af27-a97f2d6c9303 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:30.093484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9326c0-70b0-4e62-af27-a97f2d6c9303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:30.093755 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9326c0-70b0-4e62-af27-a97f2d6c9303 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:30.094495 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9326c0-70b0-4e62-af27-a97f2d6c9303 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:07:30.094809 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9326c0-70b0-4e62-af27-a97f2d6c9303 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:30.096505 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9326c0-70b0-4e62-af27-a97f2d6c9303 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:30.108345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 945/1911] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:07:30.113205 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8e017-a987-4caf-8c6e-c111907430fc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:30.122959 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8e017-a987-4caf-8c6e-c111907430fc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:30.128186 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649b586-cdfa-4174-bca4-ddf421d3b3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:30.128846 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649b586-cdfa-4174-bca4-ddf421d3b3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:30.129132 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649b586-cdfa-4174-bca4-ddf421d3b3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:30.129413 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649b586-cdfa-4174-bca4-ddf421d3b3d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:30.130151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649b586-cdfa-4174-bca4-ddf421d3b3d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:30.132107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649b586-cdfa-4174-bca4-ddf421d3b3d8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:30.158970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 967/1912] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:30 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:30.163443 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9326c0-70b0-4e62-af27-a97f2d6c9303 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:30.175876 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9326c0-70b0-4e62-af27-a97f2d6c9303 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:30.250895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd18a44-70a3-46cb-9e67-eb189a195b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:30.250895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd18a44-70a3-46cb-9e67-eb189a195b6d admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:30.250895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd18a44-70a3-46cb-9e67-eb189a195b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:30.250895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd18a44-70a3-46cb-9e67-eb189a195b6d admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:30.251729 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd18a44-70a3-46cb-9e67-eb189a195b6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:30.254881 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd18a44-70a3-46cb-9e67-eb189a195b6d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:30.261793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:30.285839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 946/1913] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:30 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:30.286943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649b586-cdfa-4174-bca4-ddf421d3b3d8 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:30.298175 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649b586-cdfa-4174-bca4-ddf421d3b3d8 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:30.309826 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1d2af-7d2d-4b69-8049-fea932194953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:30.310505 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1d2af-7d2d-4b69-8049-fea932194953 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:30.310792 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1d2af-7d2d-4b69-8049-fea932194953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:30.311069 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1d2af-7d2d-4b69-8049-fea932194953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:30.311828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1d2af-7d2d-4b69-8049-fea932194953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:30.313527 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1d2af-7d2d-4b69-8049-fea932194953 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:30.324903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 968/1914] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:30.328785 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd18a44-70a3-46cb-9e67-eb189a195b6d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:30.340220 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd18a44-70a3-46cb-9e67-eb189a195b6d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:30.346955 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885730b-6841-475f-ad1b-4745e2a84f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:30.347640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885730b-6841-475f-ad1b-4745e2a84f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:30.347978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885730b-6841-475f-ad1b-4745e2a84f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:30.348414 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885730b-6841-475f-ad1b-4745e2a84f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:30.349159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885730b-6841-475f-ad1b-4745e2a84f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:30.351016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885730b-6841-475f-ad1b-4745e2a84f3a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:30.363405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 947/1915] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:07:30.367238 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1d2af-7d2d-4b69-8049-fea932194953 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:30.377756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1d2af-7d2d-4b69-8049-fea932194953 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:30.384654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd010e-ad7e-43bf-bd64-8d5d4cafc995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:30.385631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd010e-ad7e-43bf-bd64-8d5d4cafc995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:30.385994 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd010e-ad7e-43bf-bd64-8d5d4cafc995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:30.386349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd010e-ad7e-43bf-bd64-8d5d4cafc995 admin admin] PATH_INFO: `/v3/projects/c706789797ad4a35addc7142f16ba36c/users/8d1fbe52d66b499dbe55764509607e4e/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:30.400357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:30.403754 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd010e-ad7e-43bf-bd64-8d5d4cafc995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c706789797ad4a35addc7142f16ba36c, user_id=8d1fbe52d66b499dbe55764509607e4e, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:30.406920 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd010e-ad7e-43bf-bd64-8d5d4cafc995 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:30.424459 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 969/1916] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:30 2022] PUT /identity/v3/projects/c706789797ad4a35addc7142f16ba36c/users/8d1fbe52d66b499dbe55764509607e4e/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:30.436516 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574a702-ac39-4c2a-9900-98289c1d1361 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:30.437052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574a702-ac39-4c2a-9900-98289c1d1361 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:30.437517 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574a702-ac39-4c2a-9900-98289c1d1361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:30.473607 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5574a702-ac39-4c2a-9900-98289c1d1361 None None] MFA Rules not processed for user `8d1fbe52d66b499dbe55764509607e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:30.474874 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5574a702-ac39-4c2a-9900-98289c1d1361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:30.563436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 948/1917] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:30.574797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd010e-ad7e-43bf-bd64-8d5d4cafc995 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:30.576630 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-47cd010e-ad7e-43bf-bd64-8d5d4cafc995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:30.640322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd010e-ad7e-43bf-bd64-8d5d4cafc995 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:30.644336 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5ecc1-3769-4e94-afd9-69da28b77522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:30.645008 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5ecc1-3769-4e94-afd9-69da28b77522 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:30.645299 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5ecc1-3769-4e94-afd9-69da28b77522 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:30.645583 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5ecc1-3769-4e94-afd9-69da28b77522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:30.655181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5ecc1-3769-4e94-afd9-69da28b77522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:30.656695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5ecc1-3769-4e94-afd9-69da28b77522 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:30.669054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 970/1918] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:30.697319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574a702-ac39-4c2a-9900-98289c1d1361 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:30.793774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574a702-ac39-4c2a-9900-98289c1d1361 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:30.799498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f9a77-8b3a-4be2-a0e2-4b32f1f1c86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:30.800830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f9a77-8b3a-4be2-a0e2-4b32f1f1c86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:30.801112 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f9a77-8b3a-4be2-a0e2-4b32f1f1c86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:30.801390 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f9a77-8b3a-4be2-a0e2-4b32f1f1c86b admin admin] PATH_INFO: `/v3/users/8d1fbe52d66b499dbe55764509607e4e` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:30.802617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f9a77-8b3a-4be2-a0e2-4b32f1f1c86b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d1fbe52d66b499dbe55764509607e4e)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:30.804601 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f9a77-8b3a-4be2-a0e2-4b32f1f1c86b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:30.862091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3f9f9a77-8b3a-4be2-a0e2-4b32f1f1c86b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1fbe52d66b499dbe55764509607e4e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:30.870897 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3f9f9a77-8b3a-4be2-a0e2-4b32f1f1c86b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1fbe52d66b499dbe55764509607e4e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:30.885726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:30.887063 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3f9f9a77-8b3a-4be2-a0e2-4b32f1f1c86b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1fbe52d66b499dbe55764509607e4e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:30.888162 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3f9f9a77-8b3a-4be2-a0e2-4b32f1f1c86b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1fbe52d66b499dbe55764509607e4e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:30.889122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3f9f9a77-8b3a-4be2-a0e2-4b32f1f1c86b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1fbe52d66b499dbe55764509607e4e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:30.905885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 949/1919] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:30 2022] DELETE /identity/v3/users/8d1fbe52d66b499dbe55764509607e4e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:30.911603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafe593-22b4-4a3d-868a-9065874dcf37 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:30.912097 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafe593-22b4-4a3d-868a-9065874dcf37 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:30.912378 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafe593-22b4-4a3d-868a-9065874dcf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:30.931638 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-4bafe593-22b4-4a3d-868a-9065874dcf37 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:30.932918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4bafe593-22b4-4a3d-868a-9065874dcf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:31.007599 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 971/1920] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:31.019469 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f9a77-8b3a-4be2-a0e2-4b32f1f1c86b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:31.021073 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3f9f9a77-8b3a-4be2-a0e2-4b32f1f1c86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:31.102067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f9a77-8b3a-4be2-a0e2-4b32f1f1c86b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:31.105892 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc52cce-2ea2-48f4-a426-bf7c101d7ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:31.106577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc52cce-2ea2-48f4-a426-bf7c101d7ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:31.106863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc52cce-2ea2-48f4-a426-bf7c101d7ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:31.107143 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc52cce-2ea2-48f4-a426-bf7c101d7ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:31.119125 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc52cce-2ea2-48f4-a426-bf7c101d7ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:31.120654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc52cce-2ea2-48f4-a426-bf7c101d7ab5 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:31.133392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 950/1921] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:31.456524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafe593-22b4-4a3d-868a-9065874dcf37 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:31.458108 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4bafe593-22b4-4a3d-868a-9065874dcf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:31.471695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafe593-22b4-4a3d-868a-9065874dcf37 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:31.476787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31e367-54af-48c5-8f58-86f1f0112823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:31.477878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31e367-54af-48c5-8f58-86f1f0112823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:31.478168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31e367-54af-48c5-8f58-86f1f0112823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:31.478508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31e367-54af-48c5-8f58-86f1f0112823 admin admin] PATH_INFO: `/v3/projects/c706789797ad4a35addc7142f16ba36c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:31.479888 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31e367-54af-48c5-8f58-86f1f0112823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c706789797ad4a35addc7142f16ba36c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:31.481829 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31e367-54af-48c5-8f58-86f1f0112823 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:31.530899 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8c31e367-54af-48c5-8f58-86f1f0112823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c706789797ad4a35addc7142f16ba36c', 'request_id': 'req-8c31e367-54af-48c5-8f58-86f1f0112823'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:31.537774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8c31e367-54af-48c5-8f58-86f1f0112823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c706789797ad4a35addc7142f16ba36c', 'request_id': 'req-8c31e367-54af-48c5-8f58-86f1f0112823'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:31.545426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8c31e367-54af-48c5-8f58-86f1f0112823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c706789797ad4a35addc7142f16ba36c', 'request_id': 'req-8c31e367-54af-48c5-8f58-86f1f0112823'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:31.556570 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8c31e367-54af-48c5-8f58-86f1f0112823 admin admin] The token cache is being invalidate because project c706789797ad4a35addc7142f16ba36c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:31.556937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8c31e367-54af-48c5-8f58-86f1f0112823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:31.557675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8c31e367-54af-48c5-8f58-86f1f0112823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:31.559651 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 972/1922] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:31 2022] DELETE /identity/v3/projects/c706789797ad4a35addc7142f16ba36c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:31.566310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11122327-f26c-49e5-91c1-4b11c3259210 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:31.566785 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11122327-f26c-49e5-91c1-4b11c3259210 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:31.567213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11122327-f26c-49e5-91c1-4b11c3259210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:31.591611 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-11122327-f26c-49e5-91c1-4b11c3259210 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:31.592900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-11122327-f26c-49e5-91c1-4b11c3259210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:31.653758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 951/1923] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:31.661537 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88bfc9-ffb2-43d9-8673-5fe7c1c68cc6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:31.661833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88bfc9-ffb2-43d9-8673-5fe7c1c68cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:31.662117 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88bfc9-ffb2-43d9-8673-5fe7c1c68cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:31.680593 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0d88bfc9-ffb2-43d9-8673-5fe7c1c68cc6 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:31.681853 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0d88bfc9-ffb2-43d9-8673-5fe7c1c68cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:31.691078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 973/1924] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:31.695511 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11122327-f26c-49e5-91c1-4b11c3259210 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:31.715842 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11122327-f26c-49e5-91c1-4b11c3259210 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:31.720647 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42793d-497f-41a8-bfa3-7c0e07c2bbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:31.721488 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42793d-497f-41a8-bfa3-7c0e07c2bbed admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:31.721781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42793d-497f-41a8-bfa3-7c0e07c2bbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:31.722066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42793d-497f-41a8-bfa3-7c0e07c2bbed admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:31.722805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42793d-497f-41a8-bfa3-7c0e07c2bbed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:07:31.723126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42793d-497f-41a8-bfa3-7c0e07c2bbed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:31.724813 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42793d-497f-41a8-bfa3-7c0e07c2bbed admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:31.738264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 952/1925] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:07:31.742854 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88bfc9-ffb2-43d9-8673-5fe7c1c68cc6 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:31.754049 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88bfc9-ffb2-43d9-8673-5fe7c1c68cc6 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:31.759153 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45acc9-231a-4d6f-9620-f4b8c55dfbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:31.759445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45acc9-231a-4d6f-9620-f4b8c55dfbc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:31.759731 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45acc9-231a-4d6f-9620-f4b8c55dfbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:31.760073 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45acc9-231a-4d6f-9620-f4b8c55dfbc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:31.760784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45acc9-231a-4d6f-9620-f4b8c55dfbc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:31.762680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45acc9-231a-4d6f-9620-f4b8c55dfbc2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:31.773610 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:31.793441 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 974/1926] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:31 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:07:31.797318 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42793d-497f-41a8-bfa3-7c0e07c2bbed admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:31.807360 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42793d-497f-41a8-bfa3-7c0e07c2bbed admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:31.867018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad039fc-1724-41d6-bcf6-1f16622a5ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:31.867847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad039fc-1724-41d6-bcf6-1f16622a5ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:31.868170 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad039fc-1724-41d6-bcf6-1f16622a5ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:31.868450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad039fc-1724-41d6-bcf6-1f16622a5ab3 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:31.869301 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad039fc-1724-41d6-bcf6-1f16622a5ab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:31.871247 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad039fc-1724-41d6-bcf6-1f16622a5ab3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:31.895116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 953/1927] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:31 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:31.896362 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45acc9-231a-4d6f-9620-f4b8c55dfbc2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:31.906853 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45acc9-231a-4d6f-9620-f4b8c55dfbc2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:31.912479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5b258-264a-4acc-831a-75e72ef3e773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:31.913139 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5b258-264a-4acc-831a-75e72ef3e773 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:31.913496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5b258-264a-4acc-831a-75e72ef3e773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:31.913820 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5b258-264a-4acc-831a-75e72ef3e773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:31.914557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5b258-264a-4acc-831a-75e72ef3e773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:31.916181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5b258-264a-4acc-831a-75e72ef3e773 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:31.927247 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 975/1928] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:07:31.931619 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad039fc-1724-41d6-bcf6-1f16622a5ab3 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:31.942044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad039fc-1724-41d6-bcf6-1f16622a5ab3 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:31.946667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220dcf2c-d65b-4e34-bb73-d6cb9dfbca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:31.947326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dcf2c-d65b-4e34-bb73-d6cb9dfbca4f admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:31.947615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dcf2c-d65b-4e34-bb73-d6cb9dfbca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:31.947932 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dcf2c-d65b-4e34-bb73-d6cb9dfbca4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:31.948685 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220dcf2c-d65b-4e34-bb73-d6cb9dfbca4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:31.950272 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220dcf2c-d65b-4e34-bb73-d6cb9dfbca4f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:31.951754 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:31.963908 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 954/1929] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:31.967613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5b258-264a-4acc-831a-75e72ef3e773 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:31.978618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5b258-264a-4acc-831a-75e72ef3e773 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:31.983447 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9508c-b8bd-4301-86a4-d13cb5822024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:31.984625 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9508c-b8bd-4301-86a4-d13cb5822024 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:31.984906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9508c-b8bd-4301-86a4-d13cb5822024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:31.985181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9508c-b8bd-4301-86a4-d13cb5822024 admin admin] PATH_INFO: `/v3/projects/461cf394f3194815a2ba072bacf1c78d/users/a9b62a8b4dfa4fc1a5ed4025df4f2200/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:32.002719 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9508c-b8bd-4301-86a4-d13cb5822024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=461cf394f3194815a2ba072bacf1c78d, user_id=a9b62a8b4dfa4fc1a5ed4025df4f2200, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:32.007151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9508c-b8bd-4301-86a4-d13cb5822024 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:32.024296 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 976/1930] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:31 2022] PUT /identity/v3/projects/461cf394f3194815a2ba072bacf1c78d/users/a9b62a8b4dfa4fc1a5ed4025df4f2200/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:32.035921 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a8beb-6047-4964-83b4-e23b10f5b990 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:32.036431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a8beb-6047-4964-83b4-e23b10f5b990 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:32.036737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a8beb-6047-4964-83b4-e23b10f5b990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:32.070678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b51a8beb-6047-4964-83b4-e23b10f5b990 None None] MFA Rules not processed for user `a9b62a8b4dfa4fc1a5ed4025df4f2200`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:32.072014 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b51a8beb-6047-4964-83b4-e23b10f5b990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:32.166739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 955/1931] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:07:32.180391 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9508c-b8bd-4301-86a4-d13cb5822024 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:32.182270 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-eaa9508c-b8bd-4301-86a4-d13cb5822024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:32.256202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9508c-b8bd-4301-86a4-d13cb5822024 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:32.260628 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25dade-2dcc-4686-b2cb-fd75226f0411 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:32.261420 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25dade-2dcc-4686-b2cb-fd75226f0411 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:32.261805 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25dade-2dcc-4686-b2cb-fd75226f0411 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:32.262180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25dade-2dcc-4686-b2cb-fd75226f0411 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:32.282110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25dade-2dcc-4686-b2cb-fd75226f0411 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:32.283917 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25dade-2dcc-4686-b2cb-fd75226f0411 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:32.294161 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 977/1932] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:32.554898 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a8beb-6047-4964-83b4-e23b10f5b990 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:32.557310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b51a8beb-6047-4964-83b4-e23b10f5b990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:32.638828 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a8beb-6047-4964-83b4-e23b10f5b990 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:32.644784 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30db15-6717-47c4-ac47-39314c112e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:32.645702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30db15-6717-47c4-ac47-39314c112e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:32.646058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30db15-6717-47c4-ac47-39314c112e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:32.646277 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30db15-6717-47c4-ac47-39314c112e52 admin admin] PATH_INFO: `/v3/users/46f28cea9e514313b6fe742c970b45fe` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:32.647677 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30db15-6717-47c4-ac47-39314c112e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f28cea9e514313b6fe742c970b45fe)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:32.649816 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30db15-6717-47c4-ac47-39314c112e52 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:32.733180 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8a30db15-6717-47c4-ac47-39314c112e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f28cea9e514313b6fe742c970b45fe'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:32.755095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8a30db15-6717-47c4-ac47-39314c112e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f28cea9e514313b6fe742c970b45fe'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:32.788980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8a30db15-6717-47c4-ac47-39314c112e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f28cea9e514313b6fe742c970b45fe'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:32.789826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8a30db15-6717-47c4-ac47-39314c112e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f28cea9e514313b6fe742c970b45fe'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:32.790448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8a30db15-6717-47c4-ac47-39314c112e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f28cea9e514313b6fe742c970b45fe'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:32.805281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 956/1933] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:32 2022] DELETE /identity/v3/users/46f28cea9e514313b6fe742c970b45fe => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:32.810336 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936a8dd-17f3-4882-85e1-eb4d98b4615a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:32.810639 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936a8dd-17f3-4882-85e1-eb4d98b4615a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:32.811106 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936a8dd-17f3-4882-85e1-eb4d98b4615a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:32.833077 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1936a8dd-17f3-4882-85e1-eb4d98b4615a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:32.834301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1936a8dd-17f3-4882-85e1-eb4d98b4615a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:32.909267 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 978/1934] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:32.919238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30db15-6717-47c4-ac47-39314c112e52 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:32.920725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8a30db15-6717-47c4-ac47-39314c112e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:32.928564 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:32.991622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30db15-6717-47c4-ac47-39314c112e52 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:32.996142 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abd377-167c-4334-a97b-4d4d45b0d071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:32.996812 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abd377-167c-4334-a97b-4d4d45b0d071 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:32.997099 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abd377-167c-4334-a97b-4d4d45b0d071 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:32.997382 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abd377-167c-4334-a97b-4d4d45b0d071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:33.009156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abd377-167c-4334-a97b-4d4d45b0d071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:33.011167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abd377-167c-4334-a97b-4d4d45b0d071 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:33.025560 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 957/1935] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:33.741268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936a8dd-17f3-4882-85e1-eb4d98b4615a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:33.743019 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1936a8dd-17f3-4882-85e1-eb4d98b4615a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:33.764253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936a8dd-17f3-4882-85e1-eb4d98b4615a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:33.776892 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8818ff-0223-4f6c-bbf3-e864a28438a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:33.777950 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8818ff-0223-4f6c-bbf3-e864a28438a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:33.778230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8818ff-0223-4f6c-bbf3-e864a28438a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:33.778713 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8818ff-0223-4f6c-bbf3-e864a28438a7 admin admin] PATH_INFO: `/v3/projects/b3ed7e75f2c046e68e295d9a207ce03d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:33.779966 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8818ff-0223-4f6c-bbf3-e864a28438a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ed7e75f2c046e68e295d9a207ce03d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:33.781874 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8818ff-0223-4f6c-bbf3-e864a28438a7 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:33.836554 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1f8818ff-0223-4f6c-bbf3-e864a28438a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ed7e75f2c046e68e295d9a207ce03d', 'request_id': 'req-1f8818ff-0223-4f6c-bbf3-e864a28438a7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:33.838449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:33.846456 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1f8818ff-0223-4f6c-bbf3-e864a28438a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ed7e75f2c046e68e295d9a207ce03d', 'request_id': 'req-1f8818ff-0223-4f6c-bbf3-e864a28438a7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:33.855687 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1f8818ff-0223-4f6c-bbf3-e864a28438a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ed7e75f2c046e68e295d9a207ce03d', 'request_id': 'req-1f8818ff-0223-4f6c-bbf3-e864a28438a7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:33.872088 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1f8818ff-0223-4f6c-bbf3-e864a28438a7 admin admin] The token cache is being invalidate because project b3ed7e75f2c046e68e295d9a207ce03d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:33.872344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1f8818ff-0223-4f6c-bbf3-e864a28438a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:33.873039 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1f8818ff-0223-4f6c-bbf3-e864a28438a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:33.874623 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 979/1936] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:33 2022] DELETE /identity/v3/projects/b3ed7e75f2c046e68e295d9a207ce03d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:33.879959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abd377-167c-4334-a97b-4d4d45b0d071 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:33.891990 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abd377-167c-4334-a97b-4d4d45b0d071 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:33.993833 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44344e74-9e36-474d-812a-8124adbcac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:33.994819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44344e74-9e36-474d-812a-8124adbcac58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:33.995457 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44344e74-9e36-474d-812a-8124adbcac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:33.995971 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44344e74-9e36-474d-812a-8124adbcac58 admin admin] PATH_INFO: `/v3/users/2697f350f3c944b29167d56007da5619` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:33.997464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44344e74-9e36-474d-812a-8124adbcac58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2697f350f3c944b29167d56007da5619)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:33.999620 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44344e74-9e36-474d-812a-8124adbcac58 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:34.074363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-44344e74-9e36-474d-812a-8124adbcac58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2697f350f3c944b29167d56007da5619'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:34.085469 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-44344e74-9e36-474d-812a-8124adbcac58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2697f350f3c944b29167d56007da5619'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:34.100739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-44344e74-9e36-474d-812a-8124adbcac58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2697f350f3c944b29167d56007da5619'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:34.101724 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-44344e74-9e36-474d-812a-8124adbcac58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2697f350f3c944b29167d56007da5619'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:34.102408 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-44344e74-9e36-474d-812a-8124adbcac58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2697f350f3c944b29167d56007da5619'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:34.118007 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 958/1937] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:33 2022] DELETE /identity/v3/users/2697f350f3c944b29167d56007da5619 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:34.417676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8818ff-0223-4f6c-bbf3-e864a28438a7 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:34.419618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1f8818ff-0223-4f6c-bbf3-e864a28438a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:34.435915 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8818ff-0223-4f6c-bbf3-e864a28438a7 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:34.494156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185c41d-a3dc-45b2-8f8f-3aa03ebd5f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:34.494981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185c41d-a3dc-45b2-8f8f-3aa03ebd5f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:34.495270 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185c41d-a3dc-45b2-8f8f-3aa03ebd5f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:34.495557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185c41d-a3dc-45b2-8f8f-3aa03ebd5f52 admin admin] PATH_INFO: `/v3/projects/7856477627fe4bca995218f78483d45d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:34.496793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185c41d-a3dc-45b2-8f8f-3aa03ebd5f52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7856477627fe4bca995218f78483d45d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:34.498696 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185c41d-a3dc-45b2-8f8f-3aa03ebd5f52 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:34.551009 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c185c41d-a3dc-45b2-8f8f-3aa03ebd5f52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7856477627fe4bca995218f78483d45d', 'request_id': 'req-c185c41d-a3dc-45b2-8f8f-3aa03ebd5f52'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:34.557213 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c185c41d-a3dc-45b2-8f8f-3aa03ebd5f52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7856477627fe4bca995218f78483d45d', 'request_id': 'req-c185c41d-a3dc-45b2-8f8f-3aa03ebd5f52'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:34.565636 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c185c41d-a3dc-45b2-8f8f-3aa03ebd5f52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7856477627fe4bca995218f78483d45d', 'request_id': 'req-c185c41d-a3dc-45b2-8f8f-3aa03ebd5f52'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:34.577039 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c185c41d-a3dc-45b2-8f8f-3aa03ebd5f52 admin admin] The token cache is being invalidate because project 7856477627fe4bca995218f78483d45d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:34.577327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c185c41d-a3dc-45b2-8f8f-3aa03ebd5f52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:34.577972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c185c41d-a3dc-45b2-8f8f-3aa03ebd5f52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:34.579537 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 980/1938] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:34 2022] DELETE /identity/v3/projects/7856477627fe4bca995218f78483d45d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:34.585577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213bc0b-f5d8-4e23-b584-4ae01b154ca6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:34.585965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213bc0b-f5d8-4e23-b584-4ae01b154ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:34.586317 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213bc0b-f5d8-4e23-b584-4ae01b154ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:34.612969 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1213bc0b-f5d8-4e23-b584-4ae01b154ca6 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:34.614208 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1213bc0b-f5d8-4e23-b584-4ae01b154ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:34.638884 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:34.706050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 959/1939] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:07:34.715156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37c448-a3b7-423e-91c4-62ccc3205dfc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:34.715565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37c448-a3b7-423e-91c4-62ccc3205dfc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:34.715988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37c448-a3b7-423e-91c4-62ccc3205dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:34.735671 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-bd37c448-a3b7-423e-91c4-62ccc3205dfc None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:34.737540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bd37c448-a3b7-423e-91c4-62ccc3205dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:34.745501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 981/1940] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:07:34.749620 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213bc0b-f5d8-4e23-b584-4ae01b154ca6 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:34.759613 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213bc0b-f5d8-4e23-b584-4ae01b154ca6 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:34.764119 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742c209-120d-4268-b661-5031ee7e85b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:34.764776 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742c209-120d-4268-b661-5031ee7e85b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:34.765058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742c209-120d-4268-b661-5031ee7e85b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:34.765332 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742c209-120d-4268-b661-5031ee7e85b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:34.766054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742c209-120d-4268-b661-5031ee7e85b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:07:34.766361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742c209-120d-4268-b661-5031ee7e85b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:34.768804 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742c209-120d-4268-b661-5031ee7e85b1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:34.780760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 960/1941] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:07:34.785608 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37c448-a3b7-423e-91c4-62ccc3205dfc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:34.794792 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37c448-a3b7-423e-91c4-62ccc3205dfc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:34.799554 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c1f17-60f6-4a54-b7af-f021a51bd03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:34.800243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c1f17-60f6-4a54-b7af-f021a51bd03c admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:34.800528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c1f17-60f6-4a54-b7af-f021a51bd03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:34.800805 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c1f17-60f6-4a54-b7af-f021a51bd03c admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:34.801516 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c1f17-60f6-4a54-b7af-f021a51bd03c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:34.803417 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c1f17-60f6-4a54-b7af-f021a51bd03c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:34.828214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 982/1942] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:34 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:34.832732 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742c209-120d-4268-b661-5031ee7e85b1 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:34.843982 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742c209-120d-4268-b661-5031ee7e85b1 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:34.906558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e802417-827d-4908-b149-e37fe5993294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:34.907262 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e802417-827d-4908-b149-e37fe5993294 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:34.907510 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e802417-827d-4908-b149-e37fe5993294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:34.907938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e802417-827d-4908-b149-e37fe5993294 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:34.909481 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e802417-827d-4908-b149-e37fe5993294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:34.911439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e802417-827d-4908-b149-e37fe5993294 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:34.935680 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 961/1943] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:34 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:34.936976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c1f17-60f6-4a54-b7af-f021a51bd03c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:34.947616 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c1f17-60f6-4a54-b7af-f021a51bd03c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:34.953146 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbb2f0-38c7-4aae-920a-5d5854322b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:34.953889 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbb2f0-38c7-4aae-920a-5d5854322b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:34.954247 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbb2f0-38c7-4aae-920a-5d5854322b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:34.954604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbb2f0-38c7-4aae-920a-5d5854322b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:34.955935 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbb2f0-38c7-4aae-920a-5d5854322b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:34.957772 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbb2f0-38c7-4aae-920a-5d5854322b05 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:34.968690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 983/1944] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:34.973406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e802417-827d-4908-b149-e37fe5993294 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:34.983500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e802417-827d-4908-b149-e37fe5993294 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:34.988823 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a40aee-81bf-4fdc-9ab8-9071e4a5915e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:34.989537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a40aee-81bf-4fdc-9ab8-9071e4a5915e admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:34.989894 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a40aee-81bf-4fdc-9ab8-9071e4a5915e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:34.990244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a40aee-81bf-4fdc-9ab8-9071e4a5915e admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:34.991054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a40aee-81bf-4fdc-9ab8-9071e4a5915e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:34.992799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a40aee-81bf-4fdc-9ab8-9071e4a5915e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:35.003830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 962/1945] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:07:35.008062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbb2f0-38c7-4aae-920a-5d5854322b05 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:35.018831 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbb2f0-38c7-4aae-920a-5d5854322b05 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:35.023450 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48863de5-8a24-4062-b4bd-dbf1bd36b4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:35.024354 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48863de5-8a24-4062-b4bd-dbf1bd36b4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:35.024638 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48863de5-8a24-4062-b4bd-dbf1bd36b4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:35.024922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48863de5-8a24-4062-b4bd-dbf1bd36b4f1 admin admin] PATH_INFO: `/v3/projects/790f920fe91545d3b419c1dbb42591ae/users/e8a3f98970a84a1389829c4ffbf09ee3/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:35.039508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48863de5-8a24-4062-b4bd-dbf1bd36b4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=790f920fe91545d3b419c1dbb42591ae, user_id=e8a3f98970a84a1389829c4ffbf09ee3, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:35.042240 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48863de5-8a24-4062-b4bd-dbf1bd36b4f1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:35.055864 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 984/1946] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:35 2022] PUT /identity/v3/projects/790f920fe91545d3b419c1dbb42591ae/users/e8a3f98970a84a1389829c4ffbf09ee3/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:35.067695 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c83e4-edcb-4f6a-8a10-2ffa1d977a3a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:35.068094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c83e4-edcb-4f6a-8a10-2ffa1d977a3a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:35.068381 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c83e4-edcb-4f6a-8a10-2ffa1d977a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:35.094618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f20c83e4-edcb-4f6a-8a10-2ffa1d977a3a None None] MFA Rules not processed for user `e8a3f98970a84a1389829c4ffbf09ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:35.096176 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f20c83e4-edcb-4f6a-8a10-2ffa1d977a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:35.159095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 963/1947] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:35.163621 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48863de5-8a24-4062-b4bd-dbf1bd36b4f1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:35.172505 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:35.226369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48863de5-8a24-4062-b4bd-dbf1bd36b4f1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:35.231015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0873da0-3970-49e4-b72b-3b0025547c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:35.231674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0873da0-3970-49e4-b72b-3b0025547c18 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:35.232011 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0873da0-3970-49e4-b72b-3b0025547c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:35.232292 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0873da0-3970-49e4-b72b-3b0025547c18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:35.232993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0873da0-3970-49e4-b72b-3b0025547c18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:35.235186 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0873da0-3970-49e4-b72b-3b0025547c18 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:35.263124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 985/1948] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:35 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:35.267592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c83e4-edcb-4f6a-8a10-2ffa1d977a3a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:35.278549 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c83e4-edcb-4f6a-8a10-2ffa1d977a3a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:35.297646 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:35.337104 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cef662-5e7b-482a-be20-aa53de89933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:35.337772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cef662-5e7b-482a-be20-aa53de89933c admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:35.338056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cef662-5e7b-482a-be20-aa53de89933c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:35.338332 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cef662-5e7b-482a-be20-aa53de89933c admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:35.339023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cef662-5e7b-482a-be20-aa53de89933c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:35.340974 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cef662-5e7b-482a-be20-aa53de89933c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:35.362692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 964/1949] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:35 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:07:35.366702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0873da0-3970-49e4-b72b-3b0025547c18 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:35.376883 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0873da0-3970-49e4-b72b-3b0025547c18 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:35.381636 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12652283-f3da-4ec9-8c66-f95a56ac5245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:35.382291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12652283-f3da-4ec9-8c66-f95a56ac5245 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:35.382579 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12652283-f3da-4ec9-8c66-f95a56ac5245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:35.382861 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12652283-f3da-4ec9-8c66-f95a56ac5245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:35.383623 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12652283-f3da-4ec9-8c66-f95a56ac5245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:35.385244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12652283-f3da-4ec9-8c66-f95a56ac5245 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:35.396070 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 986/1950] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:35.400201 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cef662-5e7b-482a-be20-aa53de89933c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:35.411184 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cef662-5e7b-482a-be20-aa53de89933c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:35.415780 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf604948-e8eb-4bae-a1a1-722589266d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:35.416697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf604948-e8eb-4bae-a1a1-722589266d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:35.416986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf604948-e8eb-4bae-a1a1-722589266d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:35.417269 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf604948-e8eb-4bae-a1a1-722589266d54 admin admin] PATH_INFO: `/v3/projects/b437f6aa75de4e6d8fb73035f0d677cb/users/902da8f2409c467dbb5aab11685e6f7a/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:35.432415 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf604948-e8eb-4bae-a1a1-722589266d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b437f6aa75de4e6d8fb73035f0d677cb, user_id=902da8f2409c467dbb5aab11685e6f7a, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:35.435084 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf604948-e8eb-4bae-a1a1-722589266d54 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:35.448691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 965/1951] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:35 2022] PUT /identity/v3/projects/b437f6aa75de4e6d8fb73035f0d677cb/users/902da8f2409c467dbb5aab11685e6f7a/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:35.452641 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12652283-f3da-4ec9-8c66-f95a56ac5245 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:35.463237 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12652283-f3da-4ec9-8c66-f95a56ac5245 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:35.520031 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768fa7c-3412-477d-a3bf-287569fdd781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:35.520620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768fa7c-3412-477d-a3bf-287569fdd781 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:35.520915 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768fa7c-3412-477d-a3bf-287569fdd781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:35.521198 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768fa7c-3412-477d-a3bf-287569fdd781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:35.521935 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768fa7c-3412-477d-a3bf-287569fdd781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:35.523530 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768fa7c-3412-477d-a3bf-287569fdd781 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:35.533232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 987/1952] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:07:35.538067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf604948-e8eb-4bae-a1a1-722589266d54 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:35.548679 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf604948-e8eb-4bae-a1a1-722589266d54 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:35.554104 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3e058-d5f8-4fea-a6b1-a2bed0ea6ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:35.554991 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3e058-d5f8-4fea-a6b1-a2bed0ea6ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:35.555276 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3e058-d5f8-4fea-a6b1-a2bed0ea6ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:35.555556 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3e058-d5f8-4fea-a6b1-a2bed0ea6ccb admin admin] PATH_INFO: `/v3/projects/b437f6aa75de4e6d8fb73035f0d677cb/users/902da8f2409c467dbb5aab11685e6f7a/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:35.557540 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3e058-d5f8-4fea-a6b1-a2bed0ea6ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b437f6aa75de4e6d8fb73035f0d677cb, user_id=902da8f2409c467dbb5aab11685e6f7a, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:35.560264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3e058-d5f8-4fea-a6b1-a2bed0ea6ccb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:35.571004 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 966/1953] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:35 2022] PUT /identity/v3/projects/b437f6aa75de4e6d8fb73035f0d677cb/users/902da8f2409c467dbb5aab11685e6f7a/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:35.581532 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2be93f-9d3e-4bfc-9429-9c89f08d6d87 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:35.581846 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2be93f-9d3e-4bfc-9429-9c89f08d6d87 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:35.582112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2be93f-9d3e-4bfc-9429-9c89f08d6d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:35.608590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3d2be93f-9d3e-4bfc-9429-9c89f08d6d87 None None] MFA Rules not processed for user `902da8f2409c467dbb5aab11685e6f7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:35.610037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3d2be93f-9d3e-4bfc-9429-9c89f08d6d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:35.678416 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 988/1954] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:07:35.688751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3e058-d5f8-4fea-a6b1-a2bed0ea6ccb admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:35.691260 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a1e3e058-d5f8-4fea-a6b1-a2bed0ea6ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:35.779083 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3e058-d5f8-4fea-a6b1-a2bed0ea6ccb admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:35.782771 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567455c-f40b-4f37-af7a-400b7b835cb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:35.784070 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567455c-f40b-4f37-af7a-400b7b835cb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:35.784361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567455c-f40b-4f37-af7a-400b7b835cb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:35.784641 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567455c-f40b-4f37-af7a-400b7b835cb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:35.794457 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567455c-f40b-4f37-af7a-400b7b835cb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:35.796039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567455c-f40b-4f37-af7a-400b7b835cb3 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:35.807334 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 967/1955] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:36.371996 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2be93f-9d3e-4bfc-9429-9c89f08d6d87 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:36.376201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:36.434188 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2be93f-9d3e-4bfc-9429-9c89f08d6d87 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:36.438647 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f9c5b-c68d-40eb-949b-5d08b831412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:36.440178 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f9c5b-c68d-40eb-949b-5d08b831412b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:36.440464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f9c5b-c68d-40eb-949b-5d08b831412b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:36.440738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f9c5b-c68d-40eb-949b-5d08b831412b admin admin] PATH_INFO: `/v3/users/e8a3f98970a84a1389829c4ffbf09ee3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:36.441932 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f9c5b-c68d-40eb-949b-5d08b831412b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a3f98970a84a1389829c4ffbf09ee3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:36.443893 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f9c5b-c68d-40eb-949b-5d08b831412b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:36.494060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ed8f9c5b-c68d-40eb-949b-5d08b831412b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a3f98970a84a1389829c4ffbf09ee3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:36.503619 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ed8f9c5b-c68d-40eb-949b-5d08b831412b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a3f98970a84a1389829c4ffbf09ee3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:36.515588 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ed8f9c5b-c68d-40eb-949b-5d08b831412b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a3f98970a84a1389829c4ffbf09ee3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:36.516255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ed8f9c5b-c68d-40eb-949b-5d08b831412b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a3f98970a84a1389829c4ffbf09ee3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:36.523120 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ed8f9c5b-c68d-40eb-949b-5d08b831412b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a3f98970a84a1389829c4ffbf09ee3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:36.529205 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 989/1956] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:36 2022] DELETE /identity/v3/users/e8a3f98970a84a1389829c4ffbf09ee3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:36.533971 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6d40e-3715-4f8d-81ce-e498c234b483 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:36.534430 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6d40e-3715-4f8d-81ce-e498c234b483 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:36.534534 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6d40e-3715-4f8d-81ce-e498c234b483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:36.552736 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8ac6d40e-3715-4f8d-81ce-e498c234b483 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:36.553932 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8ac6d40e-3715-4f8d-81ce-e498c234b483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:36.612705 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 968/1957] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:36.622255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f9c5b-c68d-40eb-949b-5d08b831412b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:36.623684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ed8f9c5b-c68d-40eb-949b-5d08b831412b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:36.680759 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f9c5b-c68d-40eb-949b-5d08b831412b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:36.684424 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe6c6f-eff3-4f6f-8c03-500ff1217137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:36.685072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe6c6f-eff3-4f6f-8c03-500ff1217137 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:36.685364 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe6c6f-eff3-4f6f-8c03-500ff1217137 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:36.685645 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe6c6f-eff3-4f6f-8c03-500ff1217137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:36.694523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe6c6f-eff3-4f6f-8c03-500ff1217137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:36.696067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe6c6f-eff3-4f6f-8c03-500ff1217137 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:36.705790 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 990/1958] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:37.038686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6d40e-3715-4f8d-81ce-e498c234b483 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:37.040257 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8ac6d40e-3715-4f8d-81ce-e498c234b483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:37.052726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6d40e-3715-4f8d-81ce-e498c234b483 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:37.058576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bbcb7-a001-4b66-9737-88f6d91f9d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:37.059666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bbcb7-a001-4b66-9737-88f6d91f9d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:37.060078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bbcb7-a001-4b66-9737-88f6d91f9d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:37.060531 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bbcb7-a001-4b66-9737-88f6d91f9d1b admin admin] PATH_INFO: `/v3/projects/790f920fe91545d3b419c1dbb42591ae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:37.068442 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bbcb7-a001-4b66-9737-88f6d91f9d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=790f920fe91545d3b419c1dbb42591ae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:37.071219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bbcb7-a001-4b66-9737-88f6d91f9d1b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:37.085016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:37.121649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f54bbcb7-a001-4b66-9737-88f6d91f9d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790f920fe91545d3b419c1dbb42591ae', 'request_id': 'req-f54bbcb7-a001-4b66-9737-88f6d91f9d1b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:37.128765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f54bbcb7-a001-4b66-9737-88f6d91f9d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790f920fe91545d3b419c1dbb42591ae', 'request_id': 'req-f54bbcb7-a001-4b66-9737-88f6d91f9d1b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:37.134945 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f54bbcb7-a001-4b66-9737-88f6d91f9d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790f920fe91545d3b419c1dbb42591ae', 'request_id': 'req-f54bbcb7-a001-4b66-9737-88f6d91f9d1b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:37.145724 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f54bbcb7-a001-4b66-9737-88f6d91f9d1b admin admin] The token cache is being invalidate because project 790f920fe91545d3b419c1dbb42591ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:37.145995 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f54bbcb7-a001-4b66-9737-88f6d91f9d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:37.146646 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f54bbcb7-a001-4b66-9737-88f6d91f9d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:37.148223 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 969/1959] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:37 2022] DELETE /identity/v3/projects/790f920fe91545d3b419c1dbb42591ae => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:37.152167 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe6c6f-eff3-4f6f-8c03-500ff1217137 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:37.162481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe6c6f-eff3-4f6f-8c03-500ff1217137 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:37.181876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:37.221512 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8a2ff-19f2-41fb-96f8-e04e2f69d077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:37.222387 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8a2ff-19f2-41fb-96f8-e04e2f69d077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:37.222672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8a2ff-19f2-41fb-96f8-e04e2f69d077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:37.222950 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8a2ff-19f2-41fb-96f8-e04e2f69d077 admin admin] PATH_INFO: `/v3/users/902da8f2409c467dbb5aab11685e6f7a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:37.224167 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8a2ff-19f2-41fb-96f8-e04e2f69d077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=902da8f2409c467dbb5aab11685e6f7a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:37.226076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8a2ff-19f2-41fb-96f8-e04e2f69d077 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:37.270751 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5aa8a2ff-19f2-41fb-96f8-e04e2f69d077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '902da8f2409c467dbb5aab11685e6f7a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:37.278071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5aa8a2ff-19f2-41fb-96f8-e04e2f69d077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '902da8f2409c467dbb5aab11685e6f7a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:37.291018 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5aa8a2ff-19f2-41fb-96f8-e04e2f69d077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '902da8f2409c467dbb5aab11685e6f7a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:37.291686 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5aa8a2ff-19f2-41fb-96f8-e04e2f69d077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '902da8f2409c467dbb5aab11685e6f7a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:37.298706 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5aa8a2ff-19f2-41fb-96f8-e04e2f69d077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '902da8f2409c467dbb5aab11685e6f7a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:37.304906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 991/1960] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:37 2022] DELETE /identity/v3/users/902da8f2409c467dbb5aab11685e6f7a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:37.578810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bbcb7-a001-4b66-9737-88f6d91f9d1b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:37.581205 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f54bbcb7-a001-4b66-9737-88f6d91f9d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:37.596814 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bbcb7-a001-4b66-9737-88f6d91f9d1b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:37.654043 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf20e47-2812-4ada-96e5-4a5bbd829f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:37.654902 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf20e47-2812-4ada-96e5-4a5bbd829f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:37.655192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf20e47-2812-4ada-96e5-4a5bbd829f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:37.655476 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf20e47-2812-4ada-96e5-4a5bbd829f13 admin admin] PATH_INFO: `/v3/projects/b437f6aa75de4e6d8fb73035f0d677cb` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:37.656701 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf20e47-2812-4ada-96e5-4a5bbd829f13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b437f6aa75de4e6d8fb73035f0d677cb)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:37.658919 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf20e47-2812-4ada-96e5-4a5bbd829f13 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:37.706302 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-fcf20e47-2812-4ada-96e5-4a5bbd829f13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b437f6aa75de4e6d8fb73035f0d677cb', 'request_id': 'req-fcf20e47-2812-4ada-96e5-4a5bbd829f13'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:37.714351 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-fcf20e47-2812-4ada-96e5-4a5bbd829f13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b437f6aa75de4e6d8fb73035f0d677cb', 'request_id': 'req-fcf20e47-2812-4ada-96e5-4a5bbd829f13'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:37.720552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-fcf20e47-2812-4ada-96e5-4a5bbd829f13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b437f6aa75de4e6d8fb73035f0d677cb', 'request_id': 'req-fcf20e47-2812-4ada-96e5-4a5bbd829f13'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:37.736712 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-fcf20e47-2812-4ada-96e5-4a5bbd829f13 admin admin] The token cache is being invalidate because project b437f6aa75de4e6d8fb73035f0d677cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:37.737163 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-fcf20e47-2812-4ada-96e5-4a5bbd829f13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:37.737791 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-fcf20e47-2812-4ada-96e5-4a5bbd829f13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:37.739331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 970/1961] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:37 2022] DELETE /identity/v3/projects/b437f6aa75de4e6d8fb73035f0d677cb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:37.744194 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0cc4f-6341-4a80-af62-26674ef9ac8a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:37.744695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0cc4f-6341-4a80-af62-26674ef9ac8a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:37.744793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0cc4f-6341-4a80-af62-26674ef9ac8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:37.763047 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-dda0cc4f-6341-4a80-af62-26674ef9ac8a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:37.764275 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dda0cc4f-6341-4a80-af62-26674ef9ac8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:37.824004 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 992/1962] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:37.831794 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf031858-1a9a-4bb8-a68a-9307d74aa3c5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:37.832120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf031858-1a9a-4bb8-a68a-9307d74aa3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:37.832409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf031858-1a9a-4bb8-a68a-9307d74aa3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:37.850607 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-bf031858-1a9a-4bb8-a68a-9307d74aa3c5 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:37.851835 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bf031858-1a9a-4bb8-a68a-9307d74aa3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:37.860887 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 971/1963] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:37.865920 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0cc4f-6341-4a80-af62-26674ef9ac8a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:37.884205 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0cc4f-6341-4a80-af62-26674ef9ac8a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:37.888907 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ead867-fe71-4b01-8dd6-b483d3425199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:37.889590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ead867-fe71-4b01-8dd6-b483d3425199 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:37.889991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ead867-fe71-4b01-8dd6-b483d3425199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:37.890282 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ead867-fe71-4b01-8dd6-b483d3425199 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:37.891026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ead867-fe71-4b01-8dd6-b483d3425199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:07:37.891339 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ead867-fe71-4b01-8dd6-b483d3425199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:37.893145 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ead867-fe71-4b01-8dd6-b483d3425199 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:37.904958 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 993/1964] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:07:37.909558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf031858-1a9a-4bb8-a68a-9307d74aa3c5 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:37.920262 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf031858-1a9a-4bb8-a68a-9307d74aa3c5 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:37.925629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7daaf-2a92-4563-8c41-7e611d17ebaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:37.926591 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7daaf-2a92-4563-8c41-7e611d17ebaf admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:37.926882 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7daaf-2a92-4563-8c41-7e611d17ebaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:37.927177 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7daaf-2a92-4563-8c41-7e611d17ebaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:37.928053 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7daaf-2a92-4563-8c41-7e611d17ebaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:37.930397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7daaf-2a92-4563-8c41-7e611d17ebaf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:37.960557 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 972/1965] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:37 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:07:37.964932 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ead867-fe71-4b01-8dd6-b483d3425199 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:37.977263 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ead867-fe71-4b01-8dd6-b483d3425199 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:38.009653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:38.039269 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e798b5a-931a-4042-b43c-fcb4609047ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:38.040038 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e798b5a-931a-4042-b43c-fcb4609047ad admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:38.040329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e798b5a-931a-4042-b43c-fcb4609047ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:38.040660 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e798b5a-931a-4042-b43c-fcb4609047ad admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:38.041361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e798b5a-931a-4042-b43c-fcb4609047ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:38.043709 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e798b5a-931a-4042-b43c-fcb4609047ad admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:38.064677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 994/1966] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:37 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:07:38.069372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7daaf-2a92-4563-8c41-7e611d17ebaf admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:38.074779 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:38.081048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7daaf-2a92-4563-8c41-7e611d17ebaf admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:38.086802 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa00de-8b28-4727-a062-8f032c69f09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:38.087980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa00de-8b28-4727-a062-8f032c69f09f admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:38.088240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa00de-8b28-4727-a062-8f032c69f09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:38.088523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa00de-8b28-4727-a062-8f032c69f09f admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:38.089583 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa00de-8b28-4727-a062-8f032c69f09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:38.091560 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa00de-8b28-4727-a062-8f032c69f09f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:38.103539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 973/1967] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:38.107473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e798b5a-931a-4042-b43c-fcb4609047ad admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:38.120707 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e798b5a-931a-4042-b43c-fcb4609047ad admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:38.125404 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d11be0-e0af-4e3f-ada7-e28b64c2e2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:38.126748 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d11be0-e0af-4e3f-ada7-e28b64c2e2cb admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:38.127045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d11be0-e0af-4e3f-ada7-e28b64c2e2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:38.127309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d11be0-e0af-4e3f-ada7-e28b64c2e2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:38.128907 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d11be0-e0af-4e3f-ada7-e28b64c2e2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:38.130531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d11be0-e0af-4e3f-ada7-e28b64c2e2cb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:38.142262 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 995/1968] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:07:38.146492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa00de-8b28-4727-a062-8f032c69f09f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:38.157049 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa00de-8b28-4727-a062-8f032c69f09f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:38.163674 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d5bae-b77b-4c49-91b1-830ab3bbd318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:38.165178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d5bae-b77b-4c49-91b1-830ab3bbd318 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:38.165562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d5bae-b77b-4c49-91b1-830ab3bbd318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:38.165923 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d5bae-b77b-4c49-91b1-830ab3bbd318 admin admin] PATH_INFO: `/v3/projects/1e6f3981452a4315be4a5589fcc30903/users/4caca671e9594d639793587d6d98d1f5/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:38.183889 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d5bae-b77b-4c49-91b1-830ab3bbd318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6f3981452a4315be4a5589fcc30903, user_id=4caca671e9594d639793587d6d98d1f5, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:38.186606 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d5bae-b77b-4c49-91b1-830ab3bbd318 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:38.201568 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 974/1969] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:38 2022] PUT /identity/v3/projects/1e6f3981452a4315be4a5589fcc30903/users/4caca671e9594d639793587d6d98d1f5/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:38.213176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44616fbc-83fd-4d09-bc06-1fe6a3fd3e43 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:38.213470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44616fbc-83fd-4d09-bc06-1fe6a3fd3e43 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:38.213753 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44616fbc-83fd-4d09-bc06-1fe6a3fd3e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:38.248122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-44616fbc-83fd-4d09-bc06-1fe6a3fd3e43 None None] MFA Rules not processed for user `4caca671e9594d639793587d6d98d1f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:38.249671 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-44616fbc-83fd-4d09-bc06-1fe6a3fd3e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:38.338170 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 996/1970] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:38.343021 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d5bae-b77b-4c49-91b1-830ab3bbd318 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:38.410386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d5bae-b77b-4c49-91b1-830ab3bbd318 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:38.414986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2c206-ca59-44c6-8705-c4e45548570d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:38.415645 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2c206-ca59-44c6-8705-c4e45548570d admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:38.415961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2c206-ca59-44c6-8705-c4e45548570d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:38.416238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2c206-ca59-44c6-8705-c4e45548570d admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:38.416925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2c206-ca59-44c6-8705-c4e45548570d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:38.418825 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2c206-ca59-44c6-8705-c4e45548570d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:38.444885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 975/1971] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:38 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:38.449180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44616fbc-83fd-4d09-bc06-1fe6a3fd3e43 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:38.460671 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44616fbc-83fd-4d09-bc06-1fe6a3fd3e43 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:38.521010 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6941447-c890-40ba-a36c-2ec7092bce72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:38.521681 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6941447-c890-40ba-a36c-2ec7092bce72 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:38.521963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6941447-c890-40ba-a36c-2ec7092bce72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:38.522230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6941447-c890-40ba-a36c-2ec7092bce72 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:38.522939 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6941447-c890-40ba-a36c-2ec7092bce72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:38.524899 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6941447-c890-40ba-a36c-2ec7092bce72 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:38.544874 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 997/1972] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:38 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:38.548785 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2c206-ca59-44c6-8705-c4e45548570d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:38.559702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2c206-ca59-44c6-8705-c4e45548570d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:38.564303 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adb14a-cd1b-4b6b-9ef3-818a5b8d6abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:38.564964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adb14a-cd1b-4b6b-9ef3-818a5b8d6abb admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:38.565249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adb14a-cd1b-4b6b-9ef3-818a5b8d6abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:38.566168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adb14a-cd1b-4b6b-9ef3-818a5b8d6abb admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:38.567038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27adb14a-cd1b-4b6b-9ef3-818a5b8d6abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:38.568668 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27adb14a-cd1b-4b6b-9ef3-818a5b8d6abb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:38.578979 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 976/1973] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:38.583530 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6941447-c890-40ba-a36c-2ec7092bce72 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:38.593502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6941447-c890-40ba-a36c-2ec7092bce72 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:38.598349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513a61c-a9ac-4152-b176-6a7cd44afda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:38.599222 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513a61c-a9ac-4152-b176-6a7cd44afda6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:38.599504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513a61c-a9ac-4152-b176-6a7cd44afda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:38.599777 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513a61c-a9ac-4152-b176-6a7cd44afda6 admin admin] PATH_INFO: `/v3/projects/3144e6236cce4f7983539c852caed636/users/10b78f5e1bcf42fda840a585939d81c1/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:38.615449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513a61c-a9ac-4152-b176-6a7cd44afda6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3144e6236cce4f7983539c852caed636, user_id=10b78f5e1bcf42fda840a585939d81c1, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:38.618116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513a61c-a9ac-4152-b176-6a7cd44afda6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:38.632842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 998/1974] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:38 2022] PUT /identity/v3/projects/3144e6236cce4f7983539c852caed636/users/10b78f5e1bcf42fda840a585939d81c1/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:38.636936 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adb14a-cd1b-4b6b-9ef3-818a5b8d6abb admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:38.646819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adb14a-cd1b-4b6b-9ef3-818a5b8d6abb admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:38.702365 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efa878-234f-4ff3-ba24-947142024c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:38.703313 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efa878-234f-4ff3-ba24-947142024c78 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:38.703604 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efa878-234f-4ff3-ba24-947142024c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:38.703914 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efa878-234f-4ff3-ba24-947142024c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:38.704648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efa878-234f-4ff3-ba24-947142024c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:38.706271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efa878-234f-4ff3-ba24-947142024c78 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:38.716102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 977/1975] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:07:38.720232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513a61c-a9ac-4152-b176-6a7cd44afda6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:38.727080 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:38.730758 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513a61c-a9ac-4152-b176-6a7cd44afda6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:38.736765 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86e5b1-9696-46eb-812d-a89728305899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:38.738289 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86e5b1-9696-46eb-812d-a89728305899 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:38.738580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86e5b1-9696-46eb-812d-a89728305899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:38.738849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86e5b1-9696-46eb-812d-a89728305899 admin admin] PATH_INFO: `/v3/projects/3144e6236cce4f7983539c852caed636/users/10b78f5e1bcf42fda840a585939d81c1/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:38.740883 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86e5b1-9696-46eb-812d-a89728305899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3144e6236cce4f7983539c852caed636, user_id=10b78f5e1bcf42fda840a585939d81c1, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:38.743501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86e5b1-9696-46eb-812d-a89728305899 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:38.755985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 999/1976] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:38 2022] PUT /identity/v3/projects/3144e6236cce4f7983539c852caed636/users/10b78f5e1bcf42fda840a585939d81c1/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:38.766160 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691b3a6-2976-40bf-a174-05909f33e515 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:38.766461 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691b3a6-2976-40bf-a174-05909f33e515 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:38.766748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691b3a6-2976-40bf-a174-05909f33e515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:38.792880 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7691b3a6-2976-40bf-a174-05909f33e515 None None] MFA Rules not processed for user `10b78f5e1bcf42fda840a585939d81c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:38.794089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7691b3a6-2976-40bf-a174-05909f33e515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:38.820981 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:38.864315 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 978/1977] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:38.874908 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86e5b1-9696-46eb-812d-a89728305899 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:38.876628 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7e86e5b1-9696-46eb-812d-a89728305899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:38.942182 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86e5b1-9696-46eb-812d-a89728305899 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:38.945904 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b769d65-ac31-48c1-ae6b-d8b3958c0609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:38.946557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b769d65-ac31-48c1-ae6b-d8b3958c0609 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:38.946844 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b769d65-ac31-48c1-ae6b-d8b3958c0609 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:38.947134 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b769d65-ac31-48c1-ae6b-d8b3958c0609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:38.957704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b769d65-ac31-48c1-ae6b-d8b3958c0609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:38.959221 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b769d65-ac31-48c1-ae6b-d8b3958c0609 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:38.969359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1000/1978] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:39.343270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691b3a6-2976-40bf-a174-05909f33e515 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:39.424235 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691b3a6-2976-40bf-a174-05909f33e515 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:39.428904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9af21-f462-4717-9799-1ea5255a5800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:39.429789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9af21-f462-4717-9799-1ea5255a5800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:39.430067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9af21-f462-4717-9799-1ea5255a5800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:39.430342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9af21-f462-4717-9799-1ea5255a5800 admin admin] PATH_INFO: `/v3/users/4caca671e9594d639793587d6d98d1f5` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:39.431542 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9af21-f462-4717-9799-1ea5255a5800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4caca671e9594d639793587d6d98d1f5)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:39.433495 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9af21-f462-4717-9799-1ea5255a5800 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:39.480773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c3b9af21-f462-4717-9799-1ea5255a5800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4caca671e9594d639793587d6d98d1f5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:39.489142 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c3b9af21-f462-4717-9799-1ea5255a5800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4caca671e9594d639793587d6d98d1f5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:39.500940 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c3b9af21-f462-4717-9799-1ea5255a5800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4caca671e9594d639793587d6d98d1f5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:39.501567 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c3b9af21-f462-4717-9799-1ea5255a5800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4caca671e9594d639793587d6d98d1f5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:39.502160 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c3b9af21-f462-4717-9799-1ea5255a5800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4caca671e9594d639793587d6d98d1f5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:39.513977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 979/1979] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:39 2022] DELETE /identity/v3/users/4caca671e9594d639793587d6d98d1f5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:39.519159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27bc6-029b-4fec-9232-f6cf7ba08c88 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:39.519610 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27bc6-029b-4fec-9232-f6cf7ba08c88 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:39.519912 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27bc6-029b-4fec-9232-f6cf7ba08c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:39.537622 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-04b27bc6-029b-4fec-9232-f6cf7ba08c88 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:39.538840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-04b27bc6-029b-4fec-9232-f6cf7ba08c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:39.596334 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1001/1980] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:39.606631 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9af21-f462-4717-9799-1ea5255a5800 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:39.608204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c3b9af21-f462-4717-9799-1ea5255a5800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:39.654814 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:39.669707 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9af21-f462-4717-9799-1ea5255a5800 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:39.673329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd224915-05a9-4bcb-85d9-e0edcd2b726a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:39.673980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd224915-05a9-4bcb-85d9-e0edcd2b726a service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:39.674270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd224915-05a9-4bcb-85d9-e0edcd2b726a service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:39.674551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd224915-05a9-4bcb-85d9-e0edcd2b726a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:39.685036 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd224915-05a9-4bcb-85d9-e0edcd2b726a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:39.686488 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd224915-05a9-4bcb-85d9-e0edcd2b726a service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:39.696556 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 980/1981] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:39.967940 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b27bc6-029b-4fec-9232-f6cf7ba08c88 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:39.969702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-04b27bc6-029b-4fec-9232-f6cf7ba08c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:39.983642 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b27bc6-029b-4fec-9232-f6cf7ba08c88 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:40.001965 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6cd93-56c3-4966-9808-aaa98dd74720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:40.001965 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6cd93-56c3-4966-9808-aaa98dd74720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:40.001965 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6cd93-56c3-4966-9808-aaa98dd74720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:40.001965 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6cd93-56c3-4966-9808-aaa98dd74720 admin admin] PATH_INFO: `/v3/projects/1e6f3981452a4315be4a5589fcc30903` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:40.003065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6cd93-56c3-4966-9808-aaa98dd74720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e6f3981452a4315be4a5589fcc30903)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:40.003065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6cd93-56c3-4966-9808-aaa98dd74720 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:40.050559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d8d6cd93-56c3-4966-9808-aaa98dd74720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e6f3981452a4315be4a5589fcc30903', 'request_id': 'req-d8d6cd93-56c3-4966-9808-aaa98dd74720'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:40.056890 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d8d6cd93-56c3-4966-9808-aaa98dd74720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e6f3981452a4315be4a5589fcc30903', 'request_id': 'req-d8d6cd93-56c3-4966-9808-aaa98dd74720'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:40.064188 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d8d6cd93-56c3-4966-9808-aaa98dd74720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e6f3981452a4315be4a5589fcc30903', 'request_id': 'req-d8d6cd93-56c3-4966-9808-aaa98dd74720'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:40.074644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d8d6cd93-56c3-4966-9808-aaa98dd74720 admin admin] The token cache is being invalidate because project 1e6f3981452a4315be4a5589fcc30903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:40.074934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d8d6cd93-56c3-4966-9808-aaa98dd74720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:40.075567 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d8d6cd93-56c3-4966-9808-aaa98dd74720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:40.077165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1002/1982] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:39 2022] DELETE /identity/v3/projects/1e6f3981452a4315be4a5589fcc30903 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:40.081891 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd224915-05a9-4bcb-85d9-e0edcd2b726a service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:40.091403 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd224915-05a9-4bcb-85d9-e0edcd2b726a service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:40.149795 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901cce2-a7e7-4716-b2d1-f8ea64238875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:40.150685 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901cce2-a7e7-4716-b2d1-f8ea64238875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:40.150972 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901cce2-a7e7-4716-b2d1-f8ea64238875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:40.151257 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901cce2-a7e7-4716-b2d1-f8ea64238875 admin admin] PATH_INFO: `/v3/users/10b78f5e1bcf42fda840a585939d81c1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:40.152542 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901cce2-a7e7-4716-b2d1-f8ea64238875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b78f5e1bcf42fda840a585939d81c1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:40.154466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901cce2-a7e7-4716-b2d1-f8ea64238875 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:40.200214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2901cce2-a7e7-4716-b2d1-f8ea64238875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b78f5e1bcf42fda840a585939d81c1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:40.207933 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2901cce2-a7e7-4716-b2d1-f8ea64238875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b78f5e1bcf42fda840a585939d81c1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:40.219691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2901cce2-a7e7-4716-b2d1-f8ea64238875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b78f5e1bcf42fda840a585939d81c1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:40.220354 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2901cce2-a7e7-4716-b2d1-f8ea64238875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b78f5e1bcf42fda840a585939d81c1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:40.220962 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2901cce2-a7e7-4716-b2d1-f8ea64238875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b78f5e1bcf42fda840a585939d81c1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:40.233806 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 981/1983] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:40 2022] DELETE /identity/v3/users/10b78f5e1bcf42fda840a585939d81c1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:40.544894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6cd93-56c3-4966-9808-aaa98dd74720 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:40.546359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d8d6cd93-56c3-4966-9808-aaa98dd74720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:40.559501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6cd93-56c3-4966-9808-aaa98dd74720 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:40.573969 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:40.628499 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce846c8-4b8b-4579-9658-b3e54f28e993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:40.630028 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce846c8-4b8b-4579-9658-b3e54f28e993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:40.630311 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce846c8-4b8b-4579-9658-b3e54f28e993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:40.630588 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce846c8-4b8b-4579-9658-b3e54f28e993 admin admin] PATH_INFO: `/v3/projects/3144e6236cce4f7983539c852caed636` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:40.631776 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce846c8-4b8b-4579-9658-b3e54f28e993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3144e6236cce4f7983539c852caed636)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:40.633817 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce846c8-4b8b-4579-9658-b3e54f28e993 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:40.681523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cce846c8-4b8b-4579-9658-b3e54f28e993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3144e6236cce4f7983539c852caed636', 'request_id': 'req-cce846c8-4b8b-4579-9658-b3e54f28e993'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:40.687673 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cce846c8-4b8b-4579-9658-b3e54f28e993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3144e6236cce4f7983539c852caed636', 'request_id': 'req-cce846c8-4b8b-4579-9658-b3e54f28e993'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:40.694994 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cce846c8-4b8b-4579-9658-b3e54f28e993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3144e6236cce4f7983539c852caed636', 'request_id': 'req-cce846c8-4b8b-4579-9658-b3e54f28e993'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:40.705215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cce846c8-4b8b-4579-9658-b3e54f28e993 admin admin] The token cache is being invalidate because project 3144e6236cce4f7983539c852caed636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:40.705504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cce846c8-4b8b-4579-9658-b3e54f28e993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:40.706639 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cce846c8-4b8b-4579-9658-b3e54f28e993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:40.708281 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1003/1984] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:40 2022] DELETE /identity/v3/projects/3144e6236cce4f7983539c852caed636 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:40.713263 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56eff30-0a74-4962-b23c-581ea7becfee None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:40.713746 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56eff30-0a74-4962-b23c-581ea7becfee None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:40.713746 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56eff30-0a74-4962-b23c-581ea7becfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:40.731628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c56eff30-0a74-4962-b23c-581ea7becfee None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:40.732901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c56eff30-0a74-4962-b23c-581ea7becfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:40.794706 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 982/1985] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:07:40.804859 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c80362-4b5c-4815-85bb-3d0501861bd5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:40.805158 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c80362-4b5c-4815-85bb-3d0501861bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:40.805471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c80362-4b5c-4815-85bb-3d0501861bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:40.824700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c2c80362-4b5c-4815-85bb-3d0501861bd5 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:40.825890 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c2c80362-4b5c-4815-85bb-3d0501861bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:40.834778 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1004/1986] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:40.838860 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56eff30-0a74-4962-b23c-581ea7becfee None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:40.844795 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:40.849539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56eff30-0a74-4962-b23c-581ea7becfee None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:40.855412 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e65dc8-29f5-4f43-aed8-d8a2dce82620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:40.856261 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e65dc8-29f5-4f43-aed8-d8a2dce82620 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:40.856751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e65dc8-29f5-4f43-aed8-d8a2dce82620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:40.857204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e65dc8-29f5-4f43-aed8-d8a2dce82620 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:40.858040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e65dc8-29f5-4f43-aed8-d8a2dce82620 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:07:40.858508 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e65dc8-29f5-4f43-aed8-d8a2dce82620 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:40.860440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e65dc8-29f5-4f43-aed8-d8a2dce82620 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:40.872249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 983/1987] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:07:40.876531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c80362-4b5c-4815-85bb-3d0501861bd5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:40.886590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c80362-4b5c-4815-85bb-3d0501861bd5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:40.891256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854fb3b-bc85-4c33-8c63-3a7f7ad431c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:40.891938 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854fb3b-bc85-4c33-8c63-3a7f7ad431c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:40.892230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854fb3b-bc85-4c33-8c63-3a7f7ad431c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:40.892509 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854fb3b-bc85-4c33-8c63-3a7f7ad431c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:40.893272 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854fb3b-bc85-4c33-8c63-3a7f7ad431c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:40.895774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854fb3b-bc85-4c33-8c63-3a7f7ad431c1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:40.922420 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1005/1988] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:40 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:40.926905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e65dc8-29f5-4f43-aed8-d8a2dce82620 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:40.936867 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e65dc8-29f5-4f43-aed8-d8a2dce82620 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:40.994022 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5918b2-e63d-4922-be39-dcda2a5e68fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:40.994597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5918b2-e63d-4922-be39-dcda2a5e68fb admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:40.994880 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5918b2-e63d-4922-be39-dcda2a5e68fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:40.995159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5918b2-e63d-4922-be39-dcda2a5e68fb admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:40.995892 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5918b2-e63d-4922-be39-dcda2a5e68fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:40.997826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5918b2-e63d-4922-be39-dcda2a5e68fb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:41.020580 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 984/1989] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:40 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:41.024747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854fb3b-bc85-4c33-8c63-3a7f7ad431c1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:41.035925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854fb3b-bc85-4c33-8c63-3a7f7ad431c1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:41.041049 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfad16-4911-484a-9b77-2d2c8a891b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:41.041715 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfad16-4911-484a-9b77-2d2c8a891b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:41.042005 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfad16-4911-484a-9b77-2d2c8a891b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:41.042290 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfad16-4911-484a-9b77-2d2c8a891b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:41.043025 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfad16-4911-484a-9b77-2d2c8a891b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:41.046194 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfad16-4911-484a-9b77-2d2c8a891b41 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:41.057462 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1006/1990] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:41.061403 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5918b2-e63d-4922-be39-dcda2a5e68fb admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:41.071320 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5918b2-e63d-4922-be39-dcda2a5e68fb admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:41.076322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44daec3d-07c1-49f7-92d6-4609c4afd75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:41.077280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daec3d-07c1-49f7-92d6-4609c4afd75a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:41.077570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daec3d-07c1-49f7-92d6-4609c4afd75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:41.078205 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daec3d-07c1-49f7-92d6-4609c4afd75a admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:41.079101 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44daec3d-07c1-49f7-92d6-4609c4afd75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:41.080813 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44daec3d-07c1-49f7-92d6-4609c4afd75a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:41.098516 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 985/1991] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:41.098620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfad16-4911-484a-9b77-2d2c8a891b41 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:41.107139 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfad16-4911-484a-9b77-2d2c8a891b41 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:41.112164 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539ce49-21d0-4050-9c4a-7f6521b8f69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:41.113050 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539ce49-21d0-4050-9c4a-7f6521b8f69b admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:41.113340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539ce49-21d0-4050-9c4a-7f6521b8f69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:41.113624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539ce49-21d0-4050-9c4a-7f6521b8f69b admin admin] PATH_INFO: `/v3/projects/7a60e982fc8b4bb588bfe671a1855be8/users/0e922b6c1252465aaaab3437e2f57282/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:41.127841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539ce49-21d0-4050-9c4a-7f6521b8f69b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a60e982fc8b4bb588bfe671a1855be8, user_id=0e922b6c1252465aaaab3437e2f57282, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:41.131089 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539ce49-21d0-4050-9c4a-7f6521b8f69b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:41.144627 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1007/1992] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:41 2022] PUT /identity/v3/projects/7a60e982fc8b4bb588bfe671a1855be8/users/0e922b6c1252465aaaab3437e2f57282/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:41.154866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fc663-968b-4c13-a0d8-d0b46c7c35bf None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:41.155163 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fc663-968b-4c13-a0d8-d0b46c7c35bf None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:41.155440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fc663-968b-4c13-a0d8-d0b46c7c35bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:41.182053 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-921fc663-968b-4c13-a0d8-d0b46c7c35bf None None] MFA Rules not processed for user `0e922b6c1252465aaaab3437e2f57282`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:41.183244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-921fc663-968b-4c13-a0d8-d0b46c7c35bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:41.247622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 986/1993] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:41.259219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539ce49-21d0-4050-9c4a-7f6521b8f69b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:41.260943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f539ce49-21d0-4050-9c4a-7f6521b8f69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:41.309311 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:41.321931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539ce49-21d0-4050-9c4a-7f6521b8f69b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:41.325927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78c83e-5ae8-49b9-b9ea-45a15756cc31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:41.326723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78c83e-5ae8-49b9-b9ea-45a15756cc31 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:41.327016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78c83e-5ae8-49b9-b9ea-45a15756cc31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:41.327297 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78c83e-5ae8-49b9-b9ea-45a15756cc31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:41.336392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78c83e-5ae8-49b9-b9ea-45a15756cc31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:41.337834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78c83e-5ae8-49b9-b9ea-45a15756cc31 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:41.346576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1008/1994] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:41.366490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fc663-968b-4c13-a0d8-d0b46c7c35bf None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:41.437773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fc663-968b-4c13-a0d8-d0b46c7c35bf None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:41.443141 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da643a-2f51-4740-88ae-88be92f826de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:41.444056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da643a-2f51-4740-88ae-88be92f826de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:41.444335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da643a-2f51-4740-88ae-88be92f826de admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:41.444615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da643a-2f51-4740-88ae-88be92f826de admin admin] PATH_INFO: `/v3/users/0e922b6c1252465aaaab3437e2f57282` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:41.445826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da643a-2f51-4740-88ae-88be92f826de admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e922b6c1252465aaaab3437e2f57282)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:41.447753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da643a-2f51-4740-88ae-88be92f826de admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:41.449265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:41.500916 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-14da643a-2f51-4740-88ae-88be92f826de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e922b6c1252465aaaab3437e2f57282'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:41.508831 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-14da643a-2f51-4740-88ae-88be92f826de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e922b6c1252465aaaab3437e2f57282'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:41.521934 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-14da643a-2f51-4740-88ae-88be92f826de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e922b6c1252465aaaab3437e2f57282'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:41.522636 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-14da643a-2f51-4740-88ae-88be92f826de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e922b6c1252465aaaab3437e2f57282'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:41.523270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-14da643a-2f51-4740-88ae-88be92f826de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e922b6c1252465aaaab3437e2f57282'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:41.537062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 987/1995] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:41 2022] DELETE /identity/v3/users/0e922b6c1252465aaaab3437e2f57282 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:41.542171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b871-51f3-4d51-99d6-03a491d340cf None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:41.542472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b871-51f3-4d51-99d6-03a491d340cf None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:41.542878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b871-51f3-4d51-99d6-03a491d340cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:41.561173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8a69b871-51f3-4d51-99d6-03a491d340cf None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:41.562379 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8a69b871-51f3-4d51-99d6-03a491d340cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:41.627041 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1009/1996] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:41.639070 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da643a-2f51-4740-88ae-88be92f826de admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:41.640659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-14da643a-2f51-4740-88ae-88be92f826de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:41.706721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da643a-2f51-4740-88ae-88be92f826de admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:41.709537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929046b-8e6c-4111-b9dd-a5545f3a5ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:41.710213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929046b-8e6c-4111-b9dd-a5545f3a5ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:41.710500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929046b-8e6c-4111-b9dd-a5545f3a5ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:41.710777 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929046b-8e6c-4111-b9dd-a5545f3a5ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:41.720800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929046b-8e6c-4111-b9dd-a5545f3a5ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:41.722295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929046b-8e6c-4111-b9dd-a5545f3a5ce6 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:41.732255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 988/1997] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:42.029696 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69b871-51f3-4d51-99d6-03a491d340cf None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:42.031889 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8a69b871-51f3-4d51-99d6-03a491d340cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:42.055113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69b871-51f3-4d51-99d6-03a491d340cf None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:42.060724 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198816c-2489-4047-9442-6db4a4d6566f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:42.061823 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198816c-2489-4047-9442-6db4a4d6566f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:42.062193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198816c-2489-4047-9442-6db4a4d6566f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:42.062519 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198816c-2489-4047-9442-6db4a4d6566f admin admin] PATH_INFO: `/v3/projects/7a60e982fc8b4bb588bfe671a1855be8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:42.064019 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198816c-2489-4047-9442-6db4a4d6566f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a60e982fc8b4bb588bfe671a1855be8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:42.066857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198816c-2489-4047-9442-6db4a4d6566f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:42.123854 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d198816c-2489-4047-9442-6db4a4d6566f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a60e982fc8b4bb588bfe671a1855be8', 'request_id': 'req-d198816c-2489-4047-9442-6db4a4d6566f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:42.130373 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d198816c-2489-4047-9442-6db4a4d6566f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a60e982fc8b4bb588bfe671a1855be8', 'request_id': 'req-d198816c-2489-4047-9442-6db4a4d6566f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:42.139013 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d198816c-2489-4047-9442-6db4a4d6566f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a60e982fc8b4bb588bfe671a1855be8', 'request_id': 'req-d198816c-2489-4047-9442-6db4a4d6566f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:42.153597 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d198816c-2489-4047-9442-6db4a4d6566f admin admin] The token cache is being invalidate because project 7a60e982fc8b4bb588bfe671a1855be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:42.153597 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d198816c-2489-4047-9442-6db4a4d6566f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:42.154110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d198816c-2489-4047-9442-6db4a4d6566f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:42.156136 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1010/1998] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:42 2022] DELETE /identity/v3/projects/7a60e982fc8b4bb588bfe671a1855be8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:42.160958 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb684570-0b77-44d7-93fc-df7a974875d3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:42.161254 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb684570-0b77-44d7-93fc-df7a974875d3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:42.161540 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb684570-0b77-44d7-93fc-df7a974875d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:42.179033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-cb684570-0b77-44d7-93fc-df7a974875d3 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:42.180368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cb684570-0b77-44d7-93fc-df7a974875d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:42.245230 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 989/1999] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:42.253704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52edfa4-7b41-46e3-ba87-b47dc2c11233 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:42.254325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52edfa4-7b41-46e3-ba87-b47dc2c11233 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:42.254422 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52edfa4-7b41-46e3-ba87-b47dc2c11233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:42.273092 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f52edfa4-7b41-46e3-ba87-b47dc2c11233 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:42.274303 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f52edfa4-7b41-46e3-ba87-b47dc2c11233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:42.282420 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1011/2000] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:07:42.286770 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb684570-0b77-44d7-93fc-df7a974875d3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:42.296336 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb684570-0b77-44d7-93fc-df7a974875d3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:42.301468 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1e146-8c19-4c40-a12b-70b6a918f5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:42.302134 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1e146-8c19-4c40-a12b-70b6a918f5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:42.302417 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1e146-8c19-4c40-a12b-70b6a918f5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:42.302696 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1e146-8c19-4c40-a12b-70b6a918f5c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:42.303432 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1e146-8c19-4c40-a12b-70b6a918f5c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:07:42.303747 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1e146-8c19-4c40-a12b-70b6a918f5c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:42.305419 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1e146-8c19-4c40-a12b-70b6a918f5c1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:42.317765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 990/2001] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:07:42.322187 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52edfa4-7b41-46e3-ba87-b47dc2c11233 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:42.331603 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52edfa4-7b41-46e3-ba87-b47dc2c11233 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:42.336444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03680a8f-17b1-486e-84c9-ac2d14334d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:42.337103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03680a8f-17b1-486e-84c9-ac2d14334d1f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:42.337395 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03680a8f-17b1-486e-84c9-ac2d14334d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:42.337684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03680a8f-17b1-486e-84c9-ac2d14334d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:42.338400 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03680a8f-17b1-486e-84c9-ac2d14334d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:42.340337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03680a8f-17b1-486e-84c9-ac2d14334d1f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:42.366636 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1012/2002] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:42 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:42.370943 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1e146-8c19-4c40-a12b-70b6a918f5c1 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:42.383512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1e146-8c19-4c40-a12b-70b6a918f5c1 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:42.389172 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:42.461646 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacf854-8357-4ecd-9613-198143d41a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:42.462509 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacf854-8357-4ecd-9613-198143d41a13 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:42.462944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacf854-8357-4ecd-9613-198143d41a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:42.463402 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacf854-8357-4ecd-9613-198143d41a13 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:42.464314 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baacf854-8357-4ecd-9613-198143d41a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:42.468994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baacf854-8357-4ecd-9613-198143d41a13 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:42.492570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 991/2003] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:42 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:42.498675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03680a8f-17b1-486e-84c9-ac2d14334d1f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:42.511295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03680a8f-17b1-486e-84c9-ac2d14334d1f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:42.516045 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f8ce1-ae78-4bea-8938-964aa252b6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:42.516828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f8ce1-ae78-4bea-8938-964aa252b6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:42.517114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f8ce1-ae78-4bea-8938-964aa252b6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:42.517392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f8ce1-ae78-4bea-8938-964aa252b6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:42.522771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f8ce1-ae78-4bea-8938-964aa252b6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:42.524397 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f8ce1-ae78-4bea-8938-964aa252b6c1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:42.539730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1013/2004] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:42.541488 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacf854-8357-4ecd-9613-198143d41a13 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:42.553240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacf854-8357-4ecd-9613-198143d41a13 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:42.559798 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a0908-765a-4c96-a6dd-5b2a2a1d998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:42.560566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a0908-765a-4c96-a6dd-5b2a2a1d998e admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:42.560951 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a0908-765a-4c96-a6dd-5b2a2a1d998e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:42.561477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a0908-765a-4c96-a6dd-5b2a2a1d998e admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:42.562299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a0908-765a-4c96-a6dd-5b2a2a1d998e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:42.564930 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a0908-765a-4c96-a6dd-5b2a2a1d998e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:42.578838 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 992/2005] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:42.580119 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f8ce1-ae78-4bea-8938-964aa252b6c1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:42.591658 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f8ce1-ae78-4bea-8938-964aa252b6c1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:42.597568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e315b77-56c8-48bf-96ad-0cafd6ae4f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:42.598818 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e315b77-56c8-48bf-96ad-0cafd6ae4f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:42.599103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e315b77-56c8-48bf-96ad-0cafd6ae4f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:42.599376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e315b77-56c8-48bf-96ad-0cafd6ae4f43 admin admin] PATH_INFO: `/v3/projects/e267d51106cf45759215c3738f8397c0/users/9b0718f6c53446488bde77512cff6e77/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:42.622479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e315b77-56c8-48bf-96ad-0cafd6ae4f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e267d51106cf45759215c3738f8397c0, user_id=9b0718f6c53446488bde77512cff6e77, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:42.625364 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e315b77-56c8-48bf-96ad-0cafd6ae4f43 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:42.641452 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1014/2006] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:42 2022] PUT /identity/v3/projects/e267d51106cf45759215c3738f8397c0/users/9b0718f6c53446488bde77512cff6e77/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:42.653036 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbb19f-aab4-49bd-afe8-e56dc12ef19a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:42.653396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbb19f-aab4-49bd-afe8-e56dc12ef19a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:42.653793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbb19f-aab4-49bd-afe8-e56dc12ef19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:42.684341 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-98dbb19f-aab4-49bd-afe8-e56dc12ef19a None None] MFA Rules not processed for user `9b0718f6c53446488bde77512cff6e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:42.685809 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-98dbb19f-aab4-49bd-afe8-e56dc12ef19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:42.758171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 993/2007] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:42.770730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e315b77-56c8-48bf-96ad-0cafd6ae4f43 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:42.774722 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5e315b77-56c8-48bf-96ad-0cafd6ae4f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:42.788566 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:42.842300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e315b77-56c8-48bf-96ad-0cafd6ae4f43 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:42.846273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6122e4-b48c-4cc3-a375-45b328f84435 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:42.846455 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6122e4-b48c-4cc3-a375-45b328f84435 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:42.847254 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6122e4-b48c-4cc3-a375-45b328f84435 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:42.848109 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6122e4-b48c-4cc3-a375-45b328f84435 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:42.857044 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6122e4-b48c-4cc3-a375-45b328f84435 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:42.858503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6122e4-b48c-4cc3-a375-45b328f84435 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:42.868790 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1015/2008] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:46.370689 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbb19f-aab4-49bd-afe8-e56dc12ef19a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:46.372184 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-98dbb19f-aab4-49bd-afe8-e56dc12ef19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:46.437486 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbb19f-aab4-49bd-afe8-e56dc12ef19a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:46.447246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aff48-3fe9-4e1e-a7c2-f7001fc355e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:46.447246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aff48-3fe9-4e1e-a7c2-f7001fc355e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:46.447246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aff48-3fe9-4e1e-a7c2-f7001fc355e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:46.447246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aff48-3fe9-4e1e-a7c2-f7001fc355e8 admin admin] PATH_INFO: `/v3/users/bdd162bec27047929e11a6683d0ce775` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:46.447563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4aff48-3fe9-4e1e-a7c2-f7001fc355e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd162bec27047929e11a6683d0ce775)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:46.447563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4aff48-3fe9-4e1e-a7c2-f7001fc355e8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:46.468635 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:46.497227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cc4aff48-3fe9-4e1e-a7c2-f7001fc355e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd162bec27047929e11a6683d0ce775'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:46.504275 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cc4aff48-3fe9-4e1e-a7c2-f7001fc355e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd162bec27047929e11a6683d0ce775'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:46.517540 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cc4aff48-3fe9-4e1e-a7c2-f7001fc355e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd162bec27047929e11a6683d0ce775'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:46.519574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cc4aff48-3fe9-4e1e-a7c2-f7001fc355e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd162bec27047929e11a6683d0ce775'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:46.520750 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cc4aff48-3fe9-4e1e-a7c2-f7001fc355e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd162bec27047929e11a6683d0ce775'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:46.533011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 994/2009] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:46 2022] DELETE /identity/v3/users/bdd162bec27047929e11a6683d0ce775 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:46.538284 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67f134-930f-43ca-88e9-a41ef22ff6af None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:46.538720 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67f134-930f-43ca-88e9-a41ef22ff6af None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:46.539067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67f134-930f-43ca-88e9-a41ef22ff6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:46.557394 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-bb67f134-930f-43ca-88e9-a41ef22ff6af None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:46.558585 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bb67f134-930f-43ca-88e9-a41ef22ff6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:46.616302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1016/2010] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:46.625748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aff48-3fe9-4e1e-a7c2-f7001fc355e8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:46.627334 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cc4aff48-3fe9-4e1e-a7c2-f7001fc355e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:46.685130 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aff48-3fe9-4e1e-a7c2-f7001fc355e8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:46.688751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f473ab-e9f2-4364-beac-da08d48d3613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:46.689405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f473ab-e9f2-4364-beac-da08d48d3613 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:46.689690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f473ab-e9f2-4364-beac-da08d48d3613 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:46.689969 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f473ab-e9f2-4364-beac-da08d48d3613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:46.698918 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f473ab-e9f2-4364-beac-da08d48d3613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:46.700384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f473ab-e9f2-4364-beac-da08d48d3613 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:46.710687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 995/2011] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:46.986120 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67f134-930f-43ca-88e9-a41ef22ff6af None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:46.986120 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bb67f134-930f-43ca-88e9-a41ef22ff6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:46.998737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67f134-930f-43ca-88e9-a41ef22ff6af None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:47.004787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72f997-e575-4ad7-8aa5-41d2f55871bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:47.005872 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f997-e575-4ad7-8aa5-41d2f55871bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:47.006311 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f997-e575-4ad7-8aa5-41d2f55871bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:47.006697 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f997-e575-4ad7-8aa5-41d2f55871bb admin admin] PATH_INFO: `/v3/projects/ccf82c5c75854c13a447055c96c8f62c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:47.008052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72f997-e575-4ad7-8aa5-41d2f55871bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf82c5c75854c13a447055c96c8f62c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:47.010620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72f997-e575-4ad7-8aa5-41d2f55871bb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:47.059728 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ee72f997-e575-4ad7-8aa5-41d2f55871bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf82c5c75854c13a447055c96c8f62c', 'request_id': 'req-ee72f997-e575-4ad7-8aa5-41d2f55871bb'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:47.065816 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ee72f997-e575-4ad7-8aa5-41d2f55871bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf82c5c75854c13a447055c96c8f62c', 'request_id': 'req-ee72f997-e575-4ad7-8aa5-41d2f55871bb'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:47.074143 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ee72f997-e575-4ad7-8aa5-41d2f55871bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf82c5c75854c13a447055c96c8f62c', 'request_id': 'req-ee72f997-e575-4ad7-8aa5-41d2f55871bb'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:47.084828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ee72f997-e575-4ad7-8aa5-41d2f55871bb admin admin] The token cache is being invalidate because project ccf82c5c75854c13a447055c96c8f62c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:47.085117 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ee72f997-e575-4ad7-8aa5-41d2f55871bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:47.085744 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ee72f997-e575-4ad7-8aa5-41d2f55871bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:47.087278 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1017/2012] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:46 2022] DELETE /identity/v3/projects/ccf82c5c75854c13a447055c96c8f62c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:47.091235 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f473ab-e9f2-4364-beac-da08d48d3613 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:47.101380 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f473ab-e9f2-4364-beac-da08d48d3613 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:47.157977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233248b-2f9f-44cf-b8b7-039a5b053b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:47.158777 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233248b-2f9f-44cf-b8b7-039a5b053b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:47.159072 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233248b-2f9f-44cf-b8b7-039a5b053b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:47.159358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233248b-2f9f-44cf-b8b7-039a5b053b15 admin admin] PATH_INFO: `/v3/users/815d2346e33d464790d4c1269a4378a7` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:47.160653 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233248b-2f9f-44cf-b8b7-039a5b053b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=815d2346e33d464790d4c1269a4378a7)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:47.163116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233248b-2f9f-44cf-b8b7-039a5b053b15 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:47.203446 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:47.209604 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8233248b-2f9f-44cf-b8b7-039a5b053b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '815d2346e33d464790d4c1269a4378a7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:47.217068 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8233248b-2f9f-44cf-b8b7-039a5b053b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '815d2346e33d464790d4c1269a4378a7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:47.230478 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8233248b-2f9f-44cf-b8b7-039a5b053b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '815d2346e33d464790d4c1269a4378a7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:47.231107 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8233248b-2f9f-44cf-b8b7-039a5b053b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '815d2346e33d464790d4c1269a4378a7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:47.231716 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8233248b-2f9f-44cf-b8b7-039a5b053b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '815d2346e33d464790d4c1269a4378a7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:47.244016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 996/2013] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:47 2022] DELETE /identity/v3/users/815d2346e33d464790d4c1269a4378a7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:47.518180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72f997-e575-4ad7-8aa5-41d2f55871bb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:47.519735 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ee72f997-e575-4ad7-8aa5-41d2f55871bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:47.533407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72f997-e575-4ad7-8aa5-41d2f55871bb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:47.568648 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:47.598042 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdca6a5-ba3f-438a-b9a1-06e1f4b25b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:47.599074 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdca6a5-ba3f-438a-b9a1-06e1f4b25b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:47.599367 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdca6a5-ba3f-438a-b9a1-06e1f4b25b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:47.599722 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdca6a5-ba3f-438a-b9a1-06e1f4b25b8a admin admin] PATH_INFO: `/v3/projects/dbcd8090194f4f639102f9d400d2ade8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:47.600980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdca6a5-ba3f-438a-b9a1-06e1f4b25b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbcd8090194f4f639102f9d400d2ade8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:47.602928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdca6a5-ba3f-438a-b9a1-06e1f4b25b8a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:47.650187 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bcdca6a5-ba3f-438a-b9a1-06e1f4b25b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbcd8090194f4f639102f9d400d2ade8', 'request_id': 'req-bcdca6a5-ba3f-438a-b9a1-06e1f4b25b8a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:47.656251 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bcdca6a5-ba3f-438a-b9a1-06e1f4b25b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbcd8090194f4f639102f9d400d2ade8', 'request_id': 'req-bcdca6a5-ba3f-438a-b9a1-06e1f4b25b8a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:47.664223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bcdca6a5-ba3f-438a-b9a1-06e1f4b25b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbcd8090194f4f639102f9d400d2ade8', 'request_id': 'req-bcdca6a5-ba3f-438a-b9a1-06e1f4b25b8a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:47.674577 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bcdca6a5-ba3f-438a-b9a1-06e1f4b25b8a admin admin] The token cache is being invalidate because project dbcd8090194f4f639102f9d400d2ade8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:47.674941 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bcdca6a5-ba3f-438a-b9a1-06e1f4b25b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:47.675640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bcdca6a5-ba3f-438a-b9a1-06e1f4b25b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:47.677873 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1018/2014] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:47 2022] DELETE /identity/v3/projects/dbcd8090194f4f639102f9d400d2ade8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:47.685279 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afe912-68b2-4dcb-b276-127ddc6da795 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:47.685741 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afe912-68b2-4dcb-b276-127ddc6da795 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:47.685848 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afe912-68b2-4dcb-b276-127ddc6da795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:47.704583 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-34afe912-68b2-4dcb-b276-127ddc6da795 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:47.705787 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-34afe912-68b2-4dcb-b276-127ddc6da795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:47.765092 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 997/2015] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:47.773391 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e1ee1-2b2b-43b8-93c7-999662dd4942 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:47.773690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e1ee1-2b2b-43b8-93c7-999662dd4942 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:47.773976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e1ee1-2b2b-43b8-93c7-999662dd4942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:47.792549 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a38e1ee1-2b2b-43b8-93c7-999662dd4942 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:47.793741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a38e1ee1-2b2b-43b8-93c7-999662dd4942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:47.802400 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1019/2016] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:47.806518 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afe912-68b2-4dcb-b276-127ddc6da795 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:47.816227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afe912-68b2-4dcb-b276-127ddc6da795 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:47.820849 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f30cb-8d4b-41f6-a39c-fb20dcefa0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:47.821529 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f30cb-8d4b-41f6-a39c-fb20dcefa0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:47.821817 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f30cb-8d4b-41f6-a39c-fb20dcefa0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:47.822094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f30cb-8d4b-41f6-a39c-fb20dcefa0c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:47.822816 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f30cb-8d4b-41f6-a39c-fb20dcefa0c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:07:47.823155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f30cb-8d4b-41f6-a39c-fb20dcefa0c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:47.824786 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f30cb-8d4b-41f6-a39c-fb20dcefa0c7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:47.836256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 998/2017] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:07:47.840365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e1ee1-2b2b-43b8-93c7-999662dd4942 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:47.850091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e1ee1-2b2b-43b8-93c7-999662dd4942 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:47.854706 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592608ed-6c39-43ed-86f8-b9cfcc441b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:47.855352 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592608ed-6c39-43ed-86f8-b9cfcc441b70 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:47.855636 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592608ed-6c39-43ed-86f8-b9cfcc441b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:47.855952 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592608ed-6c39-43ed-86f8-b9cfcc441b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:47.856651 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592608ed-6c39-43ed-86f8-b9cfcc441b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:47.858541 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592608ed-6c39-43ed-86f8-b9cfcc441b70 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:47.884548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1020/2018] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:47 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:47.888615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f30cb-8d4b-41f6-a39c-fb20dcefa0c7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:47.898683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f30cb-8d4b-41f6-a39c-fb20dcefa0c7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:47.957332 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ae699-3961-4772-a2d8-6de25ce4453f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:47.958545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ae699-3961-4772-a2d8-6de25ce4453f admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:47.958833 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ae699-3961-4772-a2d8-6de25ce4453f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:47.959114 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ae699-3961-4772-a2d8-6de25ce4453f admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:47.959805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ae699-3961-4772-a2d8-6de25ce4453f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:47.961814 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ae699-3961-4772-a2d8-6de25ce4453f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:47.981810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 999/2019] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:47 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:47.986200 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592608ed-6c39-43ed-86f8-b9cfcc441b70 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:47.996991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592608ed-6c39-43ed-86f8-b9cfcc441b70 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:48.003915 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2326405-1a23-488b-86e6-0a6b64283b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:48.005418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2326405-1a23-488b-86e6-0a6b64283b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:48.005710 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2326405-1a23-488b-86e6-0a6b64283b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:48.005991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2326405-1a23-488b-86e6-0a6b64283b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:48.006736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2326405-1a23-488b-86e6-0a6b64283b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:48.008755 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2326405-1a23-488b-86e6-0a6b64283b2b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:48.020758 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1021/2020] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:48.024724 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ae699-3961-4772-a2d8-6de25ce4453f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:48.034722 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ae699-3961-4772-a2d8-6de25ce4453f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:48.039737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac0790-b1e8-480e-b903-7f9b778f4e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:48.040430 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac0790-b1e8-480e-b903-7f9b778f4e19 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:48.040719 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac0790-b1e8-480e-b903-7f9b778f4e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:48.041000 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac0790-b1e8-480e-b903-7f9b778f4e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:48.041733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac0790-b1e8-480e-b903-7f9b778f4e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:48.043351 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac0790-b1e8-480e-b903-7f9b778f4e19 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:48.053341 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1000/2021] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:48.057244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2326405-1a23-488b-86e6-0a6b64283b2b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:48.067615 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2326405-1a23-488b-86e6-0a6b64283b2b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:48.072218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42175eeb-9121-4762-a669-f7e70b4f3e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:48.073094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42175eeb-9121-4762-a669-f7e70b4f3e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:48.073380 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42175eeb-9121-4762-a669-f7e70b4f3e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:48.073658 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42175eeb-9121-4762-a669-f7e70b4f3e07 admin admin] PATH_INFO: `/v3/projects/5b34010e61224cc59315623b24952357/users/a4fe6095a6a5498fbcab04dbfbeff944/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:48.089707 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42175eeb-9121-4762-a669-f7e70b4f3e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b34010e61224cc59315623b24952357, user_id=a4fe6095a6a5498fbcab04dbfbeff944, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:48.092384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42175eeb-9121-4762-a669-f7e70b4f3e07 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:48.105047 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1022/2022] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:48 2022] PUT /identity/v3/projects/5b34010e61224cc59315623b24952357/users/a4fe6095a6a5498fbcab04dbfbeff944/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:48.117286 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdaad1-4bde-492f-a975-73f05895690e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:48.117585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdaad1-4bde-492f-a975-73f05895690e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:48.117866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdaad1-4bde-492f-a975-73f05895690e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:48.145956 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3dcdaad1-4bde-492f-a975-73f05895690e None None] MFA Rules not processed for user `a4fe6095a6a5498fbcab04dbfbeff944`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:48.147243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3dcdaad1-4bde-492f-a975-73f05895690e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:48.158944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:48.213859 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1001/2023] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:48.218413 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42175eeb-9121-4762-a669-f7e70b4f3e07 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:48.280661 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42175eeb-9121-4762-a669-f7e70b4f3e07 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:48.285310 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f31b9-8d38-4212-a32e-18fa3513b4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:48.285993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f31b9-8d38-4212-a32e-18fa3513b4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:48.286281 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f31b9-8d38-4212-a32e-18fa3513b4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:48.286568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f31b9-8d38-4212-a32e-18fa3513b4b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:48.287268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f31b9-8d38-4212-a32e-18fa3513b4b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:48.289211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f31b9-8d38-4212-a32e-18fa3513b4b4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:48.292446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:48.318205 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1023/2024] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:48 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:48.322441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdaad1-4bde-492f-a975-73f05895690e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:48.333479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdaad1-4bde-492f-a975-73f05895690e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:48.389784 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fa990-194f-413e-aab3-fcad257fb962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:48.390456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fa990-194f-413e-aab3-fcad257fb962 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:48.390742 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fa990-194f-413e-aab3-fcad257fb962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:48.391021 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fa990-194f-413e-aab3-fcad257fb962 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:48.391731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fa990-194f-413e-aab3-fcad257fb962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:48.393730 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fa990-194f-413e-aab3-fcad257fb962 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:48.413940 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1002/2025] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:48 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:48.418068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f31b9-8d38-4212-a32e-18fa3513b4b4 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:48.429727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f31b9-8d38-4212-a32e-18fa3513b4b4 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:48.434375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36882635-2b76-4c15-808c-ef9e58c3bbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:48.435071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36882635-2b76-4c15-808c-ef9e58c3bbfb admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:48.435384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36882635-2b76-4c15-808c-ef9e58c3bbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:48.435657 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36882635-2b76-4c15-808c-ef9e58c3bbfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:48.436415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36882635-2b76-4c15-808c-ef9e58c3bbfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:48.437991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36882635-2b76-4c15-808c-ef9e58c3bbfb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:48.453162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1024/2026] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:48.454395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fa990-194f-413e-aab3-fcad257fb962 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:48.464743 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fa990-194f-413e-aab3-fcad257fb962 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:48.469489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18334502-ec9a-4e83-874f-b37aab8c32d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:48.470160 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18334502-ec9a-4e83-874f-b37aab8c32d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:48.470448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18334502-ec9a-4e83-874f-b37aab8c32d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:48.470725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18334502-ec9a-4e83-874f-b37aab8c32d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:48.471483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18334502-ec9a-4e83-874f-b37aab8c32d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:48.473333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18334502-ec9a-4e83-874f-b37aab8c32d0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:48.483497 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1003/2027] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:48.487811 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36882635-2b76-4c15-808c-ef9e58c3bbfb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:48.498608 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36882635-2b76-4c15-808c-ef9e58c3bbfb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:48.503496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a74bd5-d5ec-4f69-ab93-c33166b3a72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:48.505106 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a74bd5-d5ec-4f69-ab93-c33166b3a72c admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:48.505395 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a74bd5-d5ec-4f69-ab93-c33166b3a72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:48.505676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a74bd5-d5ec-4f69-ab93-c33166b3a72c admin admin] PATH_INFO: `/v3/projects/c47bdfdf98bb4300a1ebbbb2f084216c/users/4aadd20d16b944078df237209c87ceda/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:48.520184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a74bd5-d5ec-4f69-ab93-c33166b3a72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47bdfdf98bb4300a1ebbbb2f084216c, user_id=4aadd20d16b944078df237209c87ceda, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:48.522829 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a74bd5-d5ec-4f69-ab93-c33166b3a72c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:48.535267 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1025/2028] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:48 2022] PUT /identity/v3/projects/c47bdfdf98bb4300a1ebbbb2f084216c/users/4aadd20d16b944078df237209c87ceda/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:48.546720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2df0bd-0906-4d1f-8e24-9400ae0d0138 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:48.547016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2df0bd-0906-4d1f-8e24-9400ae0d0138 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:48.547324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2df0bd-0906-4d1f-8e24-9400ae0d0138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:48.573725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3f2df0bd-0906-4d1f-8e24-9400ae0d0138 None None] MFA Rules not processed for user `4aadd20d16b944078df237209c87ceda`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:48.574935 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3f2df0bd-0906-4d1f-8e24-9400ae0d0138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:48.645568 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1004/2029] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:48.650093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a74bd5-d5ec-4f69-ab93-c33166b3a72c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:48.711384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a74bd5-d5ec-4f69-ab93-c33166b3a72c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:48.716042 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6d39d-3880-489b-9771-ffb9d19d4dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:48.716632 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6d39d-3880-489b-9771-ffb9d19d4dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:48.716913 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6d39d-3880-489b-9771-ffb9d19d4dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:48.717188 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6d39d-3880-489b-9771-ffb9d19d4dd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:48.717879 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6d39d-3880-489b-9771-ffb9d19d4dd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:48.719752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6d39d-3880-489b-9771-ffb9d19d4dd7 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:48.747423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1026/2030] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:48 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:48.752075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2df0bd-0906-4d1f-8e24-9400ae0d0138 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:48.763528 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2df0bd-0906-4d1f-8e24-9400ae0d0138 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:48.788181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:48.827223 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d097d-3da9-4f25-8f4c-5965a14c6c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:48.827927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d097d-3da9-4f25-8f4c-5965a14c6c5c admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:48.828217 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d097d-3da9-4f25-8f4c-5965a14c6c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:48.828502 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d097d-3da9-4f25-8f4c-5965a14c6c5c admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:48.829194 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d097d-3da9-4f25-8f4c-5965a14c6c5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:48.831120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d097d-3da9-4f25-8f4c-5965a14c6c5c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:48.850147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1005/2031] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:48 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:07:48.854229 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6d39d-3880-489b-9771-ffb9d19d4dd7 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:48.865692 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6d39d-3880-489b-9771-ffb9d19d4dd7 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:48.870374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e730cf-1bca-45e1-959a-c2cceb81ab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:48.871023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e730cf-1bca-45e1-959a-c2cceb81ab2e admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:48.871312 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e730cf-1bca-45e1-959a-c2cceb81ab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:48.871595 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e730cf-1bca-45e1-959a-c2cceb81ab2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:48.872365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e730cf-1bca-45e1-959a-c2cceb81ab2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:48.873957 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e730cf-1bca-45e1-959a-c2cceb81ab2e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:48.884720 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1027/2032] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:48.888745 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d097d-3da9-4f25-8f4c-5965a14c6c5c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:48.898429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d097d-3da9-4f25-8f4c-5965a14c6c5c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:48.902970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ad454-7fcb-4243-9033-c0eacaf0f03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:48.903868 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ad454-7fcb-4243-9033-c0eacaf0f03c admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:48.904155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ad454-7fcb-4243-9033-c0eacaf0f03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:48.904434 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ad454-7fcb-4243-9033-c0eacaf0f03c admin admin] PATH_INFO: `/v3/projects/f0bec297917e4843a8ac851e04a58e5e/users/c4d899baed70477dbaf481bb28c7b496/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:48.919276 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ad454-7fcb-4243-9033-c0eacaf0f03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0bec297917e4843a8ac851e04a58e5e, user_id=c4d899baed70477dbaf481bb28c7b496, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:48.921961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ad454-7fcb-4243-9033-c0eacaf0f03c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:48.935173 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1006/2033] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:48 2022] PUT /identity/v3/projects/f0bec297917e4843a8ac851e04a58e5e/users/c4d899baed70477dbaf481bb28c7b496/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:48.939053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e730cf-1bca-45e1-959a-c2cceb81ab2e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:48.948867 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e730cf-1bca-45e1-959a-c2cceb81ab2e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:49.005268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47370842-96b8-4105-a19f-38674cff21e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:49.005962 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47370842-96b8-4105-a19f-38674cff21e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:49.006448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47370842-96b8-4105-a19f-38674cff21e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:49.006865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47370842-96b8-4105-a19f-38674cff21e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:49.007608 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47370842-96b8-4105-a19f-38674cff21e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:49.009245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47370842-96b8-4105-a19f-38674cff21e8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:49.019230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1028/2034] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:49.023531 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ad454-7fcb-4243-9033-c0eacaf0f03c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:49.034023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ad454-7fcb-4243-9033-c0eacaf0f03c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:49.038958 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f57824-d725-44be-a94e-1ece0889eeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:49.040096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f57824-d725-44be-a94e-1ece0889eeae admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:49.040387 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f57824-d725-44be-a94e-1ece0889eeae admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:49.040668 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f57824-d725-44be-a94e-1ece0889eeae admin admin] PATH_INFO: `/v3/projects/f0bec297917e4843a8ac851e04a58e5e/users/c4d899baed70477dbaf481bb28c7b496/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:49.042669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f57824-d725-44be-a94e-1ece0889eeae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0bec297917e4843a8ac851e04a58e5e, user_id=c4d899baed70477dbaf481bb28c7b496, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:49.045418 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f57824-d725-44be-a94e-1ece0889eeae admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:49.056668 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1007/2035] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:49 2022] PUT /identity/v3/projects/f0bec297917e4843a8ac851e04a58e5e/users/c4d899baed70477dbaf481bb28c7b496/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:49.068457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195775f-3346-4c95-85c9-3bf67206fbc2 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:49.068754 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195775f-3346-4c95-85c9-3bf67206fbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:49.069041 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195775f-3346-4c95-85c9-3bf67206fbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:49.094964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-4195775f-3346-4c95-85c9-3bf67206fbc2 None None] MFA Rules not processed for user `c4d899baed70477dbaf481bb28c7b496`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:49.096212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4195775f-3346-4c95-85c9-3bf67206fbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:49.104182 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:49.166483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1029/2036] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:49.178333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f57824-d725-44be-a94e-1ece0889eeae admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:49.180077 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c6f57824-d725-44be-a94e-1ece0889eeae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:49.237183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f57824-d725-44be-a94e-1ece0889eeae admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:49.240920 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f5d12-a6ff-43bd-9288-203484035061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:49.241561 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f5d12-a6ff-43bd-9288-203484035061 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:49.241852 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f5d12-a6ff-43bd-9288-203484035061 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:49.242128 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f5d12-a6ff-43bd-9288-203484035061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:49.297989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f5d12-a6ff-43bd-9288-203484035061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:49.299361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f5d12-a6ff-43bd-9288-203484035061 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:49.308384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1008/2037] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:50.853414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195775f-3346-4c95-85c9-3bf67206fbc2 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:50.865979 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195775f-3346-4c95-85c9-3bf67206fbc2 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:50.873292 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e11a5-6284-4522-8a0d-5936207b051b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:50.873957 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e11a5-6284-4522-8a0d-5936207b051b service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:50.874254 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e11a5-6284-4522-8a0d-5936207b051b service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:50.874535 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e11a5-6284-4522-8a0d-5936207b051b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:50.952407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e11a5-6284-4522-8a0d-5936207b051b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:50.954130 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e11a5-6284-4522-8a0d-5936207b051b service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:50.965033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1030/2038] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:51.639016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f5d12-a6ff-43bd-9288-203484035061 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:51.648252 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f5d12-a6ff-43bd-9288-203484035061 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:51.653167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db584d-c271-4003-a0e8-76135a6803c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:51.653821 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db584d-c271-4003-a0e8-76135a6803c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:51.654108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db584d-c271-4003-a0e8-76135a6803c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:51.654390 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db584d-c271-4003-a0e8-76135a6803c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:51.664672 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db584d-c271-4003-a0e8-76135a6803c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:51.666110 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db584d-c271-4003-a0e8-76135a6803c4 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:51.675856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1009/2039] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:51.829088 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e11a5-6284-4522-8a0d-5936207b051b service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:51.830522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-142e11a5-6284-4522-8a0d-5936207b051b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:51.903857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e11a5-6284-4522-8a0d-5936207b051b service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:51.909062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d5111-670c-4045-a335-a1f8454e5621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:51.909941 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d5111-670c-4045-a335-a1f8454e5621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:51.910466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d5111-670c-4045-a335-a1f8454e5621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:51.910754 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d5111-670c-4045-a335-a1f8454e5621 admin admin] PATH_INFO: `/v3/users/9b0718f6c53446488bde77512cff6e77` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:51.912013 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d5111-670c-4045-a335-a1f8454e5621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b0718f6c53446488bde77512cff6e77)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:51.913993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d5111-670c-4045-a335-a1f8454e5621 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:51.982835 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:51.984378 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-736d5111-670c-4045-a335-a1f8454e5621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b0718f6c53446488bde77512cff6e77'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:51.994268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-736d5111-670c-4045-a335-a1f8454e5621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b0718f6c53446488bde77512cff6e77'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:52.010602 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-736d5111-670c-4045-a335-a1f8454e5621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b0718f6c53446488bde77512cff6e77'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:52.011473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-736d5111-670c-4045-a335-a1f8454e5621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b0718f6c53446488bde77512cff6e77'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:52.019436 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-736d5111-670c-4045-a335-a1f8454e5621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b0718f6c53446488bde77512cff6e77'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:52.029810 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1031/2040] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:51 2022] DELETE /identity/v3/users/9b0718f6c53446488bde77512cff6e77 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:52.034074 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9096a-6e21-4b37-94d1-31480e1d005b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:52.034511 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9096a-6e21-4b37-94d1-31480e1d005b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:52.034861 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9096a-6e21-4b37-94d1-31480e1d005b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:52.055696 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-52e9096a-6e21-4b37-94d1-31480e1d005b None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:52.067755 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-52e9096a-6e21-4b37-94d1-31480e1d005b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:52.081826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:52.138630 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1010/2041] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:52.149284 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d5111-670c-4045-a335-a1f8454e5621 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:52.151239 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-736d5111-670c-4045-a335-a1f8454e5621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:52.221991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d5111-670c-4045-a335-a1f8454e5621 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:52.227149 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55f9cb-7194-4329-b030-eb47dbd39d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:52.227932 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55f9cb-7194-4329-b030-eb47dbd39d67 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:52.228343 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55f9cb-7194-4329-b030-eb47dbd39d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:52.228694 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55f9cb-7194-4329-b030-eb47dbd39d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:52.241061 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55f9cb-7194-4329-b030-eb47dbd39d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:52.242664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55f9cb-7194-4329-b030-eb47dbd39d67 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:52.255529 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1032/2042] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:52.540917 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9096a-6e21-4b37-94d1-31480e1d005b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:52.542648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-52e9096a-6e21-4b37-94d1-31480e1d005b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:52.555434 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9096a-6e21-4b37-94d1-31480e1d005b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:52.560466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff25a5-542d-4147-bafa-abebc37e2cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:52.561395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff25a5-542d-4147-bafa-abebc37e2cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:52.561782 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff25a5-542d-4147-bafa-abebc37e2cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:52.562169 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff25a5-542d-4147-bafa-abebc37e2cae admin admin] PATH_INFO: `/v3/projects/e267d51106cf45759215c3738f8397c0` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:52.563618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff25a5-542d-4147-bafa-abebc37e2cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=e267d51106cf45759215c3738f8397c0)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:52.565651 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff25a5-542d-4147-bafa-abebc37e2cae admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:52.616295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-52ff25a5-542d-4147-bafa-abebc37e2cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e267d51106cf45759215c3738f8397c0', 'request_id': 'req-52ff25a5-542d-4147-bafa-abebc37e2cae'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:52.623468 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-52ff25a5-542d-4147-bafa-abebc37e2cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e267d51106cf45759215c3738f8397c0', 'request_id': 'req-52ff25a5-542d-4147-bafa-abebc37e2cae'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:52.630674 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-52ff25a5-542d-4147-bafa-abebc37e2cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e267d51106cf45759215c3738f8397c0', 'request_id': 'req-52ff25a5-542d-4147-bafa-abebc37e2cae'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:52.640765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-52ff25a5-542d-4147-bafa-abebc37e2cae admin admin] The token cache is being invalidate because project e267d51106cf45759215c3738f8397c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:52.641317 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-52ff25a5-542d-4147-bafa-abebc37e2cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:52.641817 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-52ff25a5-542d-4147-bafa-abebc37e2cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:52.643338 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1011/2043] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:52 2022] DELETE /identity/v3/projects/e267d51106cf45759215c3738f8397c0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:53.996351 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55f9cb-7194-4329-b030-eb47dbd39d67 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:53.997767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6f55f9cb-7194-4329-b030-eb47dbd39d67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:54.011274 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55f9cb-7194-4329-b030-eb47dbd39d67 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:54.066239 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbdb1c-c89d-461e-8f73-6bbf191ed139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:54.068125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbdb1c-c89d-461e-8f73-6bbf191ed139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:54.068408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbdb1c-c89d-461e-8f73-6bbf191ed139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:54.068682 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbdb1c-c89d-461e-8f73-6bbf191ed139 admin admin] PATH_INFO: `/v3/users/fa213a37bea24cd481f628b25fe09b31` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:54.069854 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbdb1c-c89d-461e-8f73-6bbf191ed139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa213a37bea24cd481f628b25fe09b31)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:54.071800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbdb1c-c89d-461e-8f73-6bbf191ed139 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:54.117526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9ebbdb1c-c89d-461e-8f73-6bbf191ed139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa213a37bea24cd481f628b25fe09b31'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:54.124504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9ebbdb1c-c89d-461e-8f73-6bbf191ed139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa213a37bea24cd481f628b25fe09b31'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:54.137480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:54.140233 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9ebbdb1c-c89d-461e-8f73-6bbf191ed139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa213a37bea24cd481f628b25fe09b31'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:54.141383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9ebbdb1c-c89d-461e-8f73-6bbf191ed139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa213a37bea24cd481f628b25fe09b31'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:54.150555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9ebbdb1c-c89d-461e-8f73-6bbf191ed139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa213a37bea24cd481f628b25fe09b31'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:54.156890 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1033/2044] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:53 2022] DELETE /identity/v3/users/fa213a37bea24cd481f628b25fe09b31 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:54.161343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e023f0-6245-44d0-aeac-6703997f4ad0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:54.161839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e023f0-6245-44d0-aeac-6703997f4ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:54.161938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e023f0-6245-44d0-aeac-6703997f4ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:54.179810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c3e023f0-6245-44d0-aeac-6703997f4ad0 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:54.181042 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c3e023f0-6245-44d0-aeac-6703997f4ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:54.248042 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1012/2045] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:54.258478 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbdb1c-c89d-461e-8f73-6bbf191ed139 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:54.260075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9ebbdb1c-c89d-461e-8f73-6bbf191ed139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:54.329374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbdb1c-c89d-461e-8f73-6bbf191ed139 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:54.335919 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44537680-1589-41a5-9b4b-6aee33fb5a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:54.337164 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44537680-1589-41a5-9b4b-6aee33fb5a96 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:54.337164 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44537680-1589-41a5-9b4b-6aee33fb5a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:54.337164 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44537680-1589-41a5-9b4b-6aee33fb5a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:54.347470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44537680-1589-41a5-9b4b-6aee33fb5a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:54.348999 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44537680-1589-41a5-9b4b-6aee33fb5a96 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:54.359597 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1034/2046] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:54.655548 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e023f0-6245-44d0-aeac-6703997f4ad0 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:54.657045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c3e023f0-6245-44d0-aeac-6703997f4ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:54.671180 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e023f0-6245-44d0-aeac-6703997f4ad0 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:54.675726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d898b87-b8cf-4b10-8cda-bac056a6d348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:54.678488 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d898b87-b8cf-4b10-8cda-bac056a6d348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:54.678920 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d898b87-b8cf-4b10-8cda-bac056a6d348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:54.679205 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d898b87-b8cf-4b10-8cda-bac056a6d348 admin admin] PATH_INFO: `/v3/projects/f74aa5ae098f4d77b00cf56858ee3491` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:54.680500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d898b87-b8cf-4b10-8cda-bac056a6d348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f74aa5ae098f4d77b00cf56858ee3491)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:54.682520 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d898b87-b8cf-4b10-8cda-bac056a6d348 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:54.719756 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:54.732245 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6d898b87-b8cf-4b10-8cda-bac056a6d348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f74aa5ae098f4d77b00cf56858ee3491', 'request_id': 'req-6d898b87-b8cf-4b10-8cda-bac056a6d348'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:54.740384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6d898b87-b8cf-4b10-8cda-bac056a6d348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f74aa5ae098f4d77b00cf56858ee3491', 'request_id': 'req-6d898b87-b8cf-4b10-8cda-bac056a6d348'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:54.746608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6d898b87-b8cf-4b10-8cda-bac056a6d348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f74aa5ae098f4d77b00cf56858ee3491', 'request_id': 'req-6d898b87-b8cf-4b10-8cda-bac056a6d348'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:54.757200 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6d898b87-b8cf-4b10-8cda-bac056a6d348 admin admin] The token cache is being invalidate because project f74aa5ae098f4d77b00cf56858ee3491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:54.757429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6d898b87-b8cf-4b10-8cda-bac056a6d348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:54.758070 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6d898b87-b8cf-4b10-8cda-bac056a6d348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:54.759649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1013/2047] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:54 2022] DELETE /identity/v3/projects/f74aa5ae098f4d77b00cf56858ee3491 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:54.763550 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44537680-1589-41a5-9b4b-6aee33fb5a96 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:54.773548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44537680-1589-41a5-9b4b-6aee33fb5a96 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:54.831003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bfeac-c738-4311-8089-10a6f2f0acbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:54.831914 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bfeac-c738-4311-8089-10a6f2f0acbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:54.832226 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bfeac-c738-4311-8089-10a6f2f0acbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:54.832511 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bfeac-c738-4311-8089-10a6f2f0acbf admin admin] PATH_INFO: `/v3/users/4fbe8413705c4f8fbadc1d115e1cb174` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:54.833914 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bfeac-c738-4311-8089-10a6f2f0acbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fbe8413705c4f8fbadc1d115e1cb174)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:54.835841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bfeac-c738-4311-8089-10a6f2f0acbf admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:54.883262 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e18bfeac-c738-4311-8089-10a6f2f0acbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fbe8413705c4f8fbadc1d115e1cb174'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:54.890304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e18bfeac-c738-4311-8089-10a6f2f0acbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fbe8413705c4f8fbadc1d115e1cb174'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:54.902019 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e18bfeac-c738-4311-8089-10a6f2f0acbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fbe8413705c4f8fbadc1d115e1cb174'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:54.902740 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e18bfeac-c738-4311-8089-10a6f2f0acbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fbe8413705c4f8fbadc1d115e1cb174'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:54.909719 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e18bfeac-c738-4311-8089-10a6f2f0acbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fbe8413705c4f8fbadc1d115e1cb174'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:54.916181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1035/2048] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:54 2022] DELETE /identity/v3/users/4fbe8413705c4f8fbadc1d115e1cb174 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:55.195133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d898b87-b8cf-4b10-8cda-bac056a6d348 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:55.196652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6d898b87-b8cf-4b10-8cda-bac056a6d348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:55.214345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d898b87-b8cf-4b10-8cda-bac056a6d348 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:55.273082 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769497f4-edbe-48ca-9874-02da3277f7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:55.274261 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769497f4-edbe-48ca-9874-02da3277f7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:55.274636 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769497f4-edbe-48ca-9874-02da3277f7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:55.275002 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769497f4-edbe-48ca-9874-02da3277f7f9 admin admin] PATH_INFO: `/v3/projects/d0a94ea3db2840c895287dbdb50d1453` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:55.276355 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769497f4-edbe-48ca-9874-02da3277f7f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a94ea3db2840c895287dbdb50d1453)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:55.278359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769497f4-edbe-48ca-9874-02da3277f7f9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:55.324892 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-769497f4-edbe-48ca-9874-02da3277f7f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a94ea3db2840c895287dbdb50d1453', 'request_id': 'req-769497f4-edbe-48ca-9874-02da3277f7f9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:55.333806 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-769497f4-edbe-48ca-9874-02da3277f7f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a94ea3db2840c895287dbdb50d1453', 'request_id': 'req-769497f4-edbe-48ca-9874-02da3277f7f9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:55.339947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-769497f4-edbe-48ca-9874-02da3277f7f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a94ea3db2840c895287dbdb50d1453', 'request_id': 'req-769497f4-edbe-48ca-9874-02da3277f7f9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:55.350410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-769497f4-edbe-48ca-9874-02da3277f7f9 admin admin] The token cache is being invalidate because project d0a94ea3db2840c895287dbdb50d1453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:55.350696 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-769497f4-edbe-48ca-9874-02da3277f7f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:55.351320 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-769497f4-edbe-48ca-9874-02da3277f7f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:55.352856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1014/2049] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:55 2022] DELETE /identity/v3/projects/d0a94ea3db2840c895287dbdb50d1453 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:55.357681 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ed22f-4be5-4952-947c-a890288fe5b4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:55.358127 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ed22f-4be5-4952-947c-a890288fe5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:55.358257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ed22f-4be5-4952-947c-a890288fe5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:55.371007 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:55.377836 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c72ed22f-4be5-4952-947c-a890288fe5b4 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:55.380441 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c72ed22f-4be5-4952-947c-a890288fe5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:55.439055 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1036/2050] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:55.448350 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b77d8-80cb-41d2-9582-6933898d45a6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:55.448644 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b77d8-80cb-41d2-9582-6933898d45a6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:55.448919 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b77d8-80cb-41d2-9582-6933898d45a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:55.470200 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5c2b77d8-80cb-41d2-9582-6933898d45a6 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:55.471498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5c2b77d8-80cb-41d2-9582-6933898d45a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:55.479892 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1015/2051] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:55.484567 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ed22f-4be5-4952-947c-a890288fe5b4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:55.495090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ed22f-4be5-4952-947c-a890288fe5b4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:55.499856 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128c9f6-19da-4686-b72f-adf4fd1cf32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:55.500532 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128c9f6-19da-4686-b72f-adf4fd1cf32e admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:55.500821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128c9f6-19da-4686-b72f-adf4fd1cf32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:55.501103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128c9f6-19da-4686-b72f-adf4fd1cf32e admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:55.501846 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128c9f6-19da-4686-b72f-adf4fd1cf32e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:07:55.502194 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128c9f6-19da-4686-b72f-adf4fd1cf32e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:55.503787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128c9f6-19da-4686-b72f-adf4fd1cf32e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:55.516776 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1037/2052] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:07:55.521954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b77d8-80cb-41d2-9582-6933898d45a6 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:55.531394 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b77d8-80cb-41d2-9582-6933898d45a6 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:55.536113 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3010d-71ba-4389-b579-79dbe32d3a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:55.536828 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3010d-71ba-4389-b579-79dbe32d3a66 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:55.537185 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3010d-71ba-4389-b579-79dbe32d3a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:55.537384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3010d-71ba-4389-b579-79dbe32d3a66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:55.538155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3010d-71ba-4389-b579-79dbe32d3a66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:55.540623 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3010d-71ba-4389-b579-79dbe32d3a66 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:55.580948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1016/2053] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:55 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:55.586077 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128c9f6-19da-4686-b72f-adf4fd1cf32e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:55.601861 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128c9f6-19da-4686-b72f-adf4fd1cf32e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:55.662637 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335c18a-8d9e-447e-9a8f-ece4f0f57308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:55.663306 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335c18a-8d9e-447e-9a8f-ece4f0f57308 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:55.663590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335c18a-8d9e-447e-9a8f-ece4f0f57308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:55.663899 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335c18a-8d9e-447e-9a8f-ece4f0f57308 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:55.664596 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335c18a-8d9e-447e-9a8f-ece4f0f57308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:55.666501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335c18a-8d9e-447e-9a8f-ece4f0f57308 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:55.686701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1038/2054] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:55 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:55.690752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3010d-71ba-4389-b579-79dbe32d3a66 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:55.701590 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3010d-71ba-4389-b579-79dbe32d3a66 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:55.706155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b240a-e3a0-40e1-a34f-afe1bf6b568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:55.706808 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b240a-e3a0-40e1-a34f-afe1bf6b568a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:55.707087 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b240a-e3a0-40e1-a34f-afe1bf6b568a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:55.708055 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b240a-e3a0-40e1-a34f-afe1bf6b568a admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:55.708897 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b240a-e3a0-40e1-a34f-afe1bf6b568a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:55.710483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b240a-e3a0-40e1-a34f-afe1bf6b568a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:55.721093 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1017/2055] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:55.726065 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335c18a-8d9e-447e-9a8f-ece4f0f57308 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:55.736201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335c18a-8d9e-447e-9a8f-ece4f0f57308 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:55.741329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45634e8d-46d2-4227-805b-0e6550625722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:55.741988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45634e8d-46d2-4227-805b-0e6550625722 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:55.742276 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45634e8d-46d2-4227-805b-0e6550625722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:55.742555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45634e8d-46d2-4227-805b-0e6550625722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:55.743290 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45634e8d-46d2-4227-805b-0e6550625722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:55.744923 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45634e8d-46d2-4227-805b-0e6550625722 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:55.754923 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1039/2056] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:55.758921 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b240a-e3a0-40e1-a34f-afe1bf6b568a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:55.769000 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b240a-e3a0-40e1-a34f-afe1bf6b568a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:55.774263 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cd4bb-d556-4c1a-aca8-3f3feea21758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:55.775152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cd4bb-d556-4c1a-aca8-3f3feea21758 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:55.775435 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cd4bb-d556-4c1a-aca8-3f3feea21758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:55.775715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cd4bb-d556-4c1a-aca8-3f3feea21758 admin admin] PATH_INFO: `/v3/projects/13ff483069464ee490a8ea84008acfb6/users/7cbd6d1328fd496a804cf6aa666257f9/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:55.787787 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:55.792245 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1cd4bb-d556-4c1a-aca8-3f3feea21758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ff483069464ee490a8ea84008acfb6, user_id=7cbd6d1328fd496a804cf6aa666257f9, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:55.795027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1cd4bb-d556-4c1a-aca8-3f3feea21758 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:55.808649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1018/2057] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:55 2022] PUT /identity/v3/projects/13ff483069464ee490a8ea84008acfb6/users/7cbd6d1328fd496a804cf6aa666257f9/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:55.819037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61d021-a6a9-4464-b8d9-47ffdc0ec3b3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:55.819338 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61d021-a6a9-4464-b8d9-47ffdc0ec3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:55.819626 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61d021-a6a9-4464-b8d9-47ffdc0ec3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:55.845838 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-bf61d021-a6a9-4464-b8d9-47ffdc0ec3b3 None None] MFA Rules not processed for user `7cbd6d1328fd496a804cf6aa666257f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:55.847036 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bf61d021-a6a9-4464-b8d9-47ffdc0ec3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:55.911270 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1040/2058] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:55.916023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cd4bb-d556-4c1a-aca8-3f3feea21758 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:55.976997 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cd4bb-d556-4c1a-aca8-3f3feea21758 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:55.981589 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417a15e-4f7b-41b2-9a27-2e3accea3177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:55.982248 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417a15e-4f7b-41b2-9a27-2e3accea3177 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:55.982540 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417a15e-4f7b-41b2-9a27-2e3accea3177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:55.982821 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417a15e-4f7b-41b2-9a27-2e3accea3177 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:55.983522 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417a15e-4f7b-41b2-9a27-2e3accea3177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:55.985738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417a15e-4f7b-41b2-9a27-2e3accea3177 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:56.011081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1019/2059] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:55 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:56.015201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61d021-a6a9-4464-b8d9-47ffdc0ec3b3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:56.021232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:56.028331 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61d021-a6a9-4464-b8d9-47ffdc0ec3b3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:56.084473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5b758-f758-4343-9d72-162343954229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:56.085067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b758-f758-4343-9d72-162343954229 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:56.085354 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b758-f758-4343-9d72-162343954229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:56.085640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b758-f758-4343-9d72-162343954229 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:56.086330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5b758-f758-4343-9d72-162343954229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:56.088270 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5b758-f758-4343-9d72-162343954229 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:56.107601 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1041/2060] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:56 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:56.111935 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417a15e-4f7b-41b2-9a27-2e3accea3177 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:56.122721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417a15e-4f7b-41b2-9a27-2e3accea3177 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:56.127340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a09ae7-eaa7-49ac-a364-fb3239e25d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:56.128029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a09ae7-eaa7-49ac-a364-fb3239e25d37 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:56.128319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a09ae7-eaa7-49ac-a364-fb3239e25d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:56.128626 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a09ae7-eaa7-49ac-a364-fb3239e25d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:56.129880 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a09ae7-eaa7-49ac-a364-fb3239e25d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:56.131486 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a09ae7-eaa7-49ac-a364-fb3239e25d37 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:56.141940 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1020/2061] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:56.146587 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5b758-f758-4343-9d72-162343954229 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:56.156351 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5b758-f758-4343-9d72-162343954229 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:56.160962 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe4a27-b1b8-43bf-8287-5100122266d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:56.161829 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe4a27-b1b8-43bf-8287-5100122266d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:56.162117 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe4a27-b1b8-43bf-8287-5100122266d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:56.162392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe4a27-b1b8-43bf-8287-5100122266d3 admin admin] PATH_INFO: `/v3/projects/f39f07844d184167850d529535180b2d/users/d4f7b3ad5db74c6ba89ed72d1793206b/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:56.177731 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe4a27-b1b8-43bf-8287-5100122266d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39f07844d184167850d529535180b2d, user_id=d4f7b3ad5db74c6ba89ed72d1793206b, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:56.180403 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe4a27-b1b8-43bf-8287-5100122266d3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:56.193352 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1042/2062] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:56 2022] PUT /identity/v3/projects/f39f07844d184167850d529535180b2d/users/d4f7b3ad5db74c6ba89ed72d1793206b/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:56.197377 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a09ae7-eaa7-49ac-a364-fb3239e25d37 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:56.207888 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a09ae7-eaa7-49ac-a364-fb3239e25d37 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:56.264069 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e193b1-2357-4e12-a1d2-90b1a37f06a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:56.264738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e193b1-2357-4e12-a1d2-90b1a37f06a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:56.265028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e193b1-2357-4e12-a1d2-90b1a37f06a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:56.265310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e193b1-2357-4e12-a1d2-90b1a37f06a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:56.266031 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e193b1-2357-4e12-a1d2-90b1a37f06a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:56.267637 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e193b1-2357-4e12-a1d2-90b1a37f06a3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:56.277810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1021/2063] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:56.282039 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe4a27-b1b8-43bf-8287-5100122266d3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:56.292174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe4a27-b1b8-43bf-8287-5100122266d3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:56.296732 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2298a7-63b7-406b-bcb6-e2c38b3fc226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:56.297638 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2298a7-63b7-406b-bcb6-e2c38b3fc226 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:56.297919 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2298a7-63b7-406b-bcb6-e2c38b3fc226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:56.298197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2298a7-63b7-406b-bcb6-e2c38b3fc226 admin admin] PATH_INFO: `/v3/projects/f39f07844d184167850d529535180b2d/users/d4f7b3ad5db74c6ba89ed72d1793206b/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:56.300177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2298a7-63b7-406b-bcb6-e2c38b3fc226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39f07844d184167850d529535180b2d, user_id=d4f7b3ad5db74c6ba89ed72d1793206b, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:56.302840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2298a7-63b7-406b-bcb6-e2c38b3fc226 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:56.312941 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1043/2064] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:56 2022] PUT /identity/v3/projects/f39f07844d184167850d529535180b2d/users/d4f7b3ad5db74c6ba89ed72d1793206b/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:56.324541 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03b645-2106-4bda-92d4-e1713c59a5f3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:56.324832 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03b645-2106-4bda-92d4-e1713c59a5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:56.325111 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03b645-2106-4bda-92d4-e1713c59a5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:56.351695 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7f03b645-2106-4bda-92d4-e1713c59a5f3 None None] MFA Rules not processed for user `d4f7b3ad5db74c6ba89ed72d1793206b`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:56.352854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7f03b645-2106-4bda-92d4-e1713c59a5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:56.400172 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:56.421802 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1022/2065] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:56.433807 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2298a7-63b7-406b-bcb6-e2c38b3fc226 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:56.435614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5b2298a7-63b7-406b-bcb6-e2c38b3fc226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:56.493038 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2298a7-63b7-406b-bcb6-e2c38b3fc226 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:56.496636 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcd215-59d5-4e91-aaf2-88aeae22e221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:56.497271 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcd215-59d5-4e91-aaf2-88aeae22e221 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:56.497554 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcd215-59d5-4e91-aaf2-88aeae22e221 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:56.497830 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcd215-59d5-4e91-aaf2-88aeae22e221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:56.507517 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcd215-59d5-4e91-aaf2-88aeae22e221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:56.508998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcd215-59d5-4e91-aaf2-88aeae22e221 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:56.518402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1044/2066] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:56.582882 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03b645-2106-4bda-92d4-e1713c59a5f3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:56.652162 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03b645-2106-4bda-92d4-e1713c59a5f3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:56.656775 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0ecd0-72cb-4515-afad-5202e549ee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:56.657653 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0ecd0-72cb-4515-afad-5202e549ee2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:56.657937 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0ecd0-72cb-4515-afad-5202e549ee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:56.658211 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0ecd0-72cb-4515-afad-5202e549ee2d admin admin] PATH_INFO: `/v3/users/7cbd6d1328fd496a804cf6aa666257f9` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:56.659418 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0ecd0-72cb-4515-afad-5202e549ee2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cbd6d1328fd496a804cf6aa666257f9)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:56.662672 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0ecd0-72cb-4515-afad-5202e549ee2d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:56.720937 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-29c0ecd0-72cb-4515-afad-5202e549ee2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cbd6d1328fd496a804cf6aa666257f9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:56.732088 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-29c0ecd0-72cb-4515-afad-5202e549ee2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cbd6d1328fd496a804cf6aa666257f9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:56.749663 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-29c0ecd0-72cb-4515-afad-5202e549ee2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cbd6d1328fd496a804cf6aa666257f9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:56.750616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-29c0ecd0-72cb-4515-afad-5202e549ee2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cbd6d1328fd496a804cf6aa666257f9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:56.751293 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-29c0ecd0-72cb-4515-afad-5202e549ee2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cbd6d1328fd496a804cf6aa666257f9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:56.763903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1023/2067] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:56 2022] DELETE /identity/v3/users/7cbd6d1328fd496a804cf6aa666257f9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:56.768449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8397b-e3de-45a5-bdb9-6d64687f5670 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:56.768752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8397b-e3de-45a5-bdb9-6d64687f5670 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:56.769046 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8397b-e3de-45a5-bdb9-6d64687f5670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:56.788681 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ece8397b-e3de-45a5-bdb9-6d64687f5670 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:56.789900 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ece8397b-e3de-45a5-bdb9-6d64687f5670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:56.841435 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:56.852007 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1045/2068] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:56.861764 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0ecd0-72cb-4515-afad-5202e549ee2d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:56.863167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-29c0ecd0-72cb-4515-afad-5202e549ee2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:56.920350 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0ecd0-72cb-4515-afad-5202e549ee2d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:56.924026 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465e256-8010-4fa4-be12-f4ad089b87bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:56.924692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465e256-8010-4fa4-be12-f4ad089b87bc service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:56.924980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465e256-8010-4fa4-be12-f4ad089b87bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:56.925261 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465e256-8010-4fa4-be12-f4ad089b87bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:56.935666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465e256-8010-4fa4-be12-f4ad089b87bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:56.937212 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465e256-8010-4fa4-be12-f4ad089b87bc service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:56.946999 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1024/2069] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:57.225485 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8397b-e3de-45a5-bdb9-6d64687f5670 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:57.226988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ece8397b-e3de-45a5-bdb9-6d64687f5670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:57.241863 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8397b-e3de-45a5-bdb9-6d64687f5670 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:57.247018 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3cb8b-ccc1-41a4-9aae-791c5be8f9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:57.247910 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3cb8b-ccc1-41a4-9aae-791c5be8f9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:57.248210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3cb8b-ccc1-41a4-9aae-791c5be8f9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:57.248474 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3cb8b-ccc1-41a4-9aae-791c5be8f9a9 admin admin] PATH_INFO: `/v3/projects/13ff483069464ee490a8ea84008acfb6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:57.249863 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3cb8b-ccc1-41a4-9aae-791c5be8f9a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ff483069464ee490a8ea84008acfb6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:57.252031 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3cb8b-ccc1-41a4-9aae-791c5be8f9a9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:57.298352 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b1d3cb8b-ccc1-41a4-9aae-791c5be8f9a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ff483069464ee490a8ea84008acfb6', 'request_id': 'req-b1d3cb8b-ccc1-41a4-9aae-791c5be8f9a9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:57.304429 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b1d3cb8b-ccc1-41a4-9aae-791c5be8f9a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ff483069464ee490a8ea84008acfb6', 'request_id': 'req-b1d3cb8b-ccc1-41a4-9aae-791c5be8f9a9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:57.311857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b1d3cb8b-ccc1-41a4-9aae-791c5be8f9a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ff483069464ee490a8ea84008acfb6', 'request_id': 'req-b1d3cb8b-ccc1-41a4-9aae-791c5be8f9a9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:57.322648 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b1d3cb8b-ccc1-41a4-9aae-791c5be8f9a9 admin admin] The token cache is being invalidate because project 13ff483069464ee490a8ea84008acfb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:57.322937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b1d3cb8b-ccc1-41a4-9aae-791c5be8f9a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:57.323590 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b1d3cb8b-ccc1-41a4-9aae-791c5be8f9a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:57.325131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1046/2070] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:57 2022] DELETE /identity/v3/projects/13ff483069464ee490a8ea84008acfb6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:57.329084 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465e256-8010-4fa4-be12-f4ad089b87bc service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:57.339239 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465e256-8010-4fa4-be12-f4ad089b87bc service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:57.342808 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:57.399266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c0933-578a-4e7a-94df-7ab782b5603d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:57.400172 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c0933-578a-4e7a-94df-7ab782b5603d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:57.400458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c0933-578a-4e7a-94df-7ab782b5603d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:57.400738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c0933-578a-4e7a-94df-7ab782b5603d admin admin] PATH_INFO: `/v3/users/d4f7b3ad5db74c6ba89ed72d1793206b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:57.401925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c0933-578a-4e7a-94df-7ab782b5603d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4f7b3ad5db74c6ba89ed72d1793206b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:57.403902 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c0933-578a-4e7a-94df-7ab782b5603d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:57.451472 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-484c0933-578a-4e7a-94df-7ab782b5603d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4f7b3ad5db74c6ba89ed72d1793206b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:57.459694 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-484c0933-578a-4e7a-94df-7ab782b5603d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4f7b3ad5db74c6ba89ed72d1793206b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:57.472169 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-484c0933-578a-4e7a-94df-7ab782b5603d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4f7b3ad5db74c6ba89ed72d1793206b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:57.473489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-484c0933-578a-4e7a-94df-7ab782b5603d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4f7b3ad5db74c6ba89ed72d1793206b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:57.474212 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-484c0933-578a-4e7a-94df-7ab782b5603d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4f7b3ad5db74c6ba89ed72d1793206b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:57.486724 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1025/2071] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:57 2022] DELETE /identity/v3/users/d4f7b3ad5db74c6ba89ed72d1793206b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:57.753394 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3cb8b-ccc1-41a4-9aae-791c5be8f9a9 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:57.755790 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b1d3cb8b-ccc1-41a4-9aae-791c5be8f9a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:57.775225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3cb8b-ccc1-41a4-9aae-791c5be8f9a9 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:57.776468 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c0933-578a-4e7a-94df-7ab782b5603d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:57.777928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-484c0933-578a-4e7a-94df-7ab782b5603d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:57.900608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c0933-578a-4e7a-94df-7ab782b5603d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:57.900792 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955a2cb-2500-4439-81c3-cb8ebd9e07c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:57.901905 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955a2cb-2500-4439-81c3-cb8ebd9e07c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:57.902310 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955a2cb-2500-4439-81c3-cb8ebd9e07c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:57.902706 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955a2cb-2500-4439-81c3-cb8ebd9e07c4 admin admin] PATH_INFO: `/v3/users/a4fe6095a6a5498fbcab04dbfbeff944` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:57.904067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955a2cb-2500-4439-81c3-cb8ebd9e07c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4fe6095a6a5498fbcab04dbfbeff944)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:57.906808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955a2cb-2500-4439-81c3-cb8ebd9e07c4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:57.909701 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56652513-bdb1-4d3c-a811-3ae38da234af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:57.911668 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56652513-bdb1-4d3c-a811-3ae38da234af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:57.911668 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56652513-bdb1-4d3c-a811-3ae38da234af admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:57.911909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56652513-bdb1-4d3c-a811-3ae38da234af admin admin] PATH_INFO: `/v3/projects/f39f07844d184167850d529535180b2d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:57.913166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56652513-bdb1-4d3c-a811-3ae38da234af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f39f07844d184167850d529535180b2d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:57.915111 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56652513-bdb1-4d3c-a811-3ae38da234af admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:57.960328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:57.986005 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-56652513-bdb1-4d3c-a811-3ae38da234af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f39f07844d184167850d529535180b2d', 'request_id': 'req-56652513-bdb1-4d3c-a811-3ae38da234af'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:57.997384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-56652513-bdb1-4d3c-a811-3ae38da234af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f39f07844d184167850d529535180b2d', 'request_id': 'req-56652513-bdb1-4d3c-a811-3ae38da234af'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:58.007514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-56652513-bdb1-4d3c-a811-3ae38da234af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f39f07844d184167850d529535180b2d', 'request_id': 'req-56652513-bdb1-4d3c-a811-3ae38da234af'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:58.014478 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6955a2cb-2500-4439-81c3-cb8ebd9e07c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4fe6095a6a5498fbcab04dbfbeff944'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:58.026480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-56652513-bdb1-4d3c-a811-3ae38da234af admin admin] The token cache is being invalidate because project f39f07844d184167850d529535180b2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:58.026641 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6955a2cb-2500-4439-81c3-cb8ebd9e07c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4fe6095a6a5498fbcab04dbfbeff944'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:58.027117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-56652513-bdb1-4d3c-a811-3ae38da234af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:58.028277 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-56652513-bdb1-4d3c-a811-3ae38da234af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:58.031189 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1026/2072] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:57 2022] DELETE /identity/v3/projects/f39f07844d184167850d529535180b2d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:58.037054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921f542-3aa6-49a9-bcd7-ef1b6e4f44b7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:58.037808 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921f542-3aa6-49a9-bcd7-ef1b6e4f44b7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:58.038281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921f542-3aa6-49a9-bcd7-ef1b6e4f44b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:58.046807 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6955a2cb-2500-4439-81c3-cb8ebd9e07c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4fe6095a6a5498fbcab04dbfbeff944'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:58.047608 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6955a2cb-2500-4439-81c3-cb8ebd9e07c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4fe6095a6a5498fbcab04dbfbeff944'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:58.056105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6955a2cb-2500-4439-81c3-cb8ebd9e07c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4fe6095a6a5498fbcab04dbfbeff944'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:58.059253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:58.065222 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1047/2073] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:57 2022] DELETE /identity/v3/users/a4fe6095a6a5498fbcab04dbfbeff944 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:58.075460 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dada3a-c070-4d7a-b95b-749387eaf1d8 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:58.076033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dada3a-c070-4d7a-b95b-749387eaf1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:58.077061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2921f542-3aa6-49a9-bcd7-ef1b6e4f44b7 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:58.077676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dada3a-c070-4d7a-b95b-749387eaf1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:58.082003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2921f542-3aa6-49a9-bcd7-ef1b6e4f44b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:58.127933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-54dada3a-c070-4d7a-b95b-749387eaf1d8 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:58.129779 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-54dada3a-c070-4d7a-b95b-749387eaf1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:58.189368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1027/2074] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:07:58.198571 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f410d-ebcd-481c-9870-18c5201b5c80 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:58.199263 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f410d-ebcd-481c-9870-18c5201b5c80 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:58.199640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f410d-ebcd-481c-9870-18c5201b5c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:58.221510 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-914f410d-ebcd-481c-9870-18c5201b5c80 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:58.223435 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-914f410d-ebcd-481c-9870-18c5201b5c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:58.224681 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1048/2075] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:07:58.232416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1028/2076] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:07:58.234858 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dada3a-c070-4d7a-b95b-749387eaf1d8 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:58.236447 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f410d-ebcd-481c-9870-18c5201b5c80 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:58.237118 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-54dada3a-c070-4d7a-b95b-749387eaf1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:58.246897 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f410d-ebcd-481c-9870-18c5201b5c80 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:58.251379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc61f53-ece1-4ac5-b9a4-1fbf793e17fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:58.252070 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc61f53-ece1-4ac5-b9a4-1fbf793e17fc admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:58.252353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc61f53-ece1-4ac5-b9a4-1fbf793e17fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:58.252629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc61f53-ece1-4ac5-b9a4-1fbf793e17fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:58.253379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc61f53-ece1-4ac5-b9a4-1fbf793e17fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:07:58.253688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc61f53-ece1-4ac5-b9a4-1fbf793e17fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:58.256681 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc61f53-ece1-4ac5-b9a4-1fbf793e17fc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:58.272742 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1029/2077] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:07:58.273696 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc61f53-ece1-4ac5-b9a4-1fbf793e17fc admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:58.284287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc61f53-ece1-4ac5-b9a4-1fbf793e17fc admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:58.290551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d038d13-c9fe-4fa7-91b8-6f497d091aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:58.291362 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d038d13-c9fe-4fa7-91b8-6f497d091aca admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:58.291650 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d038d13-c9fe-4fa7-91b8-6f497d091aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:58.292092 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d038d13-c9fe-4fa7-91b8-6f497d091aca admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:58.292841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d038d13-c9fe-4fa7-91b8-6f497d091aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:58.295019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d038d13-c9fe-4fa7-91b8-6f497d091aca admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:58.306851 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dada3a-c070-4d7a-b95b-749387eaf1d8 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:58.310799 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126e643-1683-4457-bc26-f533ee0dd74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:58.311556 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126e643-1683-4457-bc26-f533ee0dd74c service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:58.311944 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126e643-1683-4457-bc26-f533ee0dd74c service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:58.312304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126e643-1683-4457-bc26-f533ee0dd74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:58.324251 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126e643-1683-4457-bc26-f533ee0dd74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:58.325712 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126e643-1683-4457-bc26-f533ee0dd74c service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:58.327246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1030/2078] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:58 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:58.332357 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d038d13-c9fe-4fa7-91b8-6f497d091aca admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:58.340034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1049/2079] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:58.409173 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d038d13-c9fe-4fa7-91b8-6f497d091aca admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:58.416638 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394957e-6ba5-4bd8-9b63-ce43d9000d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:58.417419 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394957e-6ba5-4bd8-9b63-ce43d9000d4b admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:58.417705 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394957e-6ba5-4bd8-9b63-ce43d9000d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:58.418036 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394957e-6ba5-4bd8-9b63-ce43d9000d4b admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:58.418746 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394957e-6ba5-4bd8-9b63-ce43d9000d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:58.420800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394957e-6ba5-4bd8-9b63-ce43d9000d4b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:58.444957 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1031/2080] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:58 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:58.449579 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126e643-1683-4457-bc26-f533ee0dd74c service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:58.462210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126e643-1683-4457-bc26-f533ee0dd74c service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:58.467385 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ce104-35f7-47e5-92d9-d67ca5ce9347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:58.468088 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ce104-35f7-47e5-92d9-d67ca5ce9347 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:58.468427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ce104-35f7-47e5-92d9-d67ca5ce9347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:58.468712 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ce104-35f7-47e5-92d9-d67ca5ce9347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:58.469460 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ce104-35f7-47e5-92d9-d67ca5ce9347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:58.471258 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ce104-35f7-47e5-92d9-d67ca5ce9347 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:58.483899 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1050/2081] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:58.489374 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394957e-6ba5-4bd8-9b63-ce43d9000d4b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:58.496888 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:58.501344 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394957e-6ba5-4bd8-9b63-ce43d9000d4b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:58.510921 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253ff70-5233-43ac-8b92-61d4b36bfcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:58.511712 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253ff70-5233-43ac-8b92-61d4b36bfcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:58.512505 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253ff70-5233-43ac-8b92-61d4b36bfcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:58.513209 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253ff70-5233-43ac-8b92-61d4b36bfcb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:58.514319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253ff70-5233-43ac-8b92-61d4b36bfcb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:58.516323 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253ff70-5233-43ac-8b92-61d4b36bfcb4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:58.528038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1032/2082] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:58.532465 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ce104-35f7-47e5-92d9-d67ca5ce9347 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:58.545474 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ce104-35f7-47e5-92d9-d67ca5ce9347 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:58.553496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbfe5f-d903-48c3-aa22-245b5d742a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:58.554432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbfe5f-d903-48c3-aa22-245b5d742a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:58.554724 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbfe5f-d903-48c3-aa22-245b5d742a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:58.554998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbfe5f-d903-48c3-aa22-245b5d742a01 admin admin] PATH_INFO: `/v3/projects/c13bcb875aca48759e7fff01818de9cc/users/36816a0cbbe6479eaf519f996969839c/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:58.570898 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbfe5f-d903-48c3-aa22-245b5d742a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13bcb875aca48759e7fff01818de9cc, user_id=36816a0cbbe6479eaf519f996969839c, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:58.573629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbfe5f-d903-48c3-aa22-245b5d742a01 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:58.588303 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1051/2083] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:58 2022] PUT /identity/v3/projects/c13bcb875aca48759e7fff01818de9cc/users/36816a0cbbe6479eaf519f996969839c/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:58.598829 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98de4fc-9161-4d3c-9350-c0eed59ecff3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:58.599205 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98de4fc-9161-4d3c-9350-c0eed59ecff3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:58.599930 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98de4fc-9161-4d3c-9350-c0eed59ecff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:58.629495 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e98de4fc-9161-4d3c-9350-c0eed59ecff3 None None] MFA Rules not processed for user `36816a0cbbe6479eaf519f996969839c`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:58.631172 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e98de4fc-9161-4d3c-9350-c0eed59ecff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:58.704008 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1033/2084] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:58.708941 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbfe5f-d903-48c3-aa22-245b5d742a01 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:58.793841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbfe5f-d903-48c3-aa22-245b5d742a01 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:58.796811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98de4fc-9161-4d3c-9350-c0eed59ecff3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:58.799004 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e98de4fc-9161-4d3c-9350-c0eed59ecff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:58.801380 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d5208-6fe9-428b-879f-6712beb2b55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:58.802074 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d5208-6fe9-428b-879f-6712beb2b55c admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:58.802361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d5208-6fe9-428b-879f-6712beb2b55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:58.802642 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d5208-6fe9-428b-879f-6712beb2b55c admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:58.803467 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d5208-6fe9-428b-879f-6712beb2b55c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:58.805476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d5208-6fe9-428b-879f-6712beb2b55c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:58.832697 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:58.837841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98de4fc-9161-4d3c-9350-c0eed59ecff3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:58.843180 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15f676-d470-49d7-b2bf-d0d808d73566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:58.844114 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15f676-d470-49d7-b2bf-d0d808d73566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:58.844419 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15f676-d470-49d7-b2bf-d0d808d73566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:58.844687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15f676-d470-49d7-b2bf-d0d808d73566 admin admin] PATH_INFO: `/v3/projects/5b34010e61224cc59315623b24952357` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:58.845882 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15f676-d470-49d7-b2bf-d0d808d73566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b34010e61224cc59315623b24952357)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:58.847850 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15f676-d470-49d7-b2bf-d0d808d73566 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:58.848990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1052/2085] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:07:58 2022] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:07:58.852847 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d5208-6fe9-428b-879f-6712beb2b55c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:58.915326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ef15f676-d470-49d7-b2bf-d0d808d73566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b34010e61224cc59315623b24952357', 'request_id': 'req-ef15f676-d470-49d7-b2bf-d0d808d73566'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:58.922893 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ef15f676-d470-49d7-b2bf-d0d808d73566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b34010e61224cc59315623b24952357', 'request_id': 'req-ef15f676-d470-49d7-b2bf-d0d808d73566'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:58.924755 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d5208-6fe9-428b-879f-6712beb2b55c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:58.930814 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ef15f676-d470-49d7-b2bf-d0d808d73566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b34010e61224cc59315623b24952357', 'request_id': 'req-ef15f676-d470-49d7-b2bf-d0d808d73566'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:58.943732 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ef15f676-d470-49d7-b2bf-d0d808d73566 admin admin] The token cache is being invalidate because project 5b34010e61224cc59315623b24952357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:58.944130 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ef15f676-d470-49d7-b2bf-d0d808d73566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:58.944912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ef15f676-d470-49d7-b2bf-d0d808d73566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:58.947197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1034/2086] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:58 2022] DELETE /identity/v3/projects/5b34010e61224cc59315623b24952357 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:58.952063 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15f676-d470-49d7-b2bf-d0d808d73566 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:58.953741 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ef15f676-d470-49d7-b2bf-d0d808d73566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:58.989174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba207f70-4902-4245-b9c6-14f12a3ef2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:58.990128 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba207f70-4902-4245-b9c6-14f12a3ef2ab admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:58.990595 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba207f70-4902-4245-b9c6-14f12a3ef2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:58.991066 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba207f70-4902-4245-b9c6-14f12a3ef2ab admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:58.991791 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba207f70-4902-4245-b9c6-14f12a3ef2ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:58.993747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba207f70-4902-4245-b9c6-14f12a3ef2ab admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:59.018994 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1053/2087] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:07:58 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:07:59.020254 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba207f70-4902-4245-b9c6-14f12a3ef2ab admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:59.022013 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ba207f70-4902-4245-b9c6-14f12a3ef2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:59.026212 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15f676-d470-49d7-b2bf-d0d808d73566 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:59.030955 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ee026-01ce-4400-8575-62b7be9e49c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:59.031840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ee026-01ce-4400-8575-62b7be9e49c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:59.032153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ee026-01ce-4400-8575-62b7be9e49c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:59.032434 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ee026-01ce-4400-8575-62b7be9e49c5 admin admin] PATH_INFO: `/v3/users/4aadd20d16b944078df237209c87ceda` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:59.033406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba207f70-4902-4245-b9c6-14f12a3ef2ab admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:59.033641 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ee026-01ce-4400-8575-62b7be9e49c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aadd20d16b944078df237209c87ceda)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:59.036287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ee026-01ce-4400-8575-62b7be9e49c5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:59.038912 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9ed7a-d8f7-48a8-bd38-5183e31d191a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:59.039566 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9ed7a-d8f7-48a8-bd38-5183e31d191a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:59.039895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9ed7a-d8f7-48a8-bd38-5183e31d191a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:59.040179 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9ed7a-d8f7-48a8-bd38-5183e31d191a admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:59.040911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9ed7a-d8f7-48a8-bd38-5183e31d191a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:59.042433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:59.042648 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9ed7a-d8f7-48a8-bd38-5183e31d191a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:59.055374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1054/2088] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:59.059557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9ed7a-d8f7-48a8-bd38-5183e31d191a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:59.069748 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9ed7a-d8f7-48a8-bd38-5183e31d191a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:59.075347 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4bfc6-17ca-4464-87f3-818349b1b55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:59.076291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4bfc6-17ca-4464-87f3-818349b1b55f admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:59.076760 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4bfc6-17ca-4464-87f3-818349b1b55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:59.076990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4bfc6-17ca-4464-87f3-818349b1b55f admin admin] PATH_INFO: `/v3/projects/a31eb01068b549108ccdbfc55001f1e0/users/8fa3a6509c7f485f8e19ad54eaae85d1/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:59.094646 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4bfc6-17ca-4464-87f3-818349b1b55f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31eb01068b549108ccdbfc55001f1e0, user_id=8fa3a6509c7f485f8e19ad54eaae85d1, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:59.096618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-703ee026-01ce-4400-8575-62b7be9e49c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aadd20d16b944078df237209c87ceda'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:59.098368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4bfc6-17ca-4464-87f3-818349b1b55f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:59.105511 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-703ee026-01ce-4400-8575-62b7be9e49c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aadd20d16b944078df237209c87ceda'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:59.112704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1055/2089] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:59 2022] PUT /identity/v3/projects/a31eb01068b549108ccdbfc55001f1e0/users/8fa3a6509c7f485f8e19ad54eaae85d1/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:59.117841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4bfc6-17ca-4464-87f3-818349b1b55f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:59.124483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-703ee026-01ce-4400-8575-62b7be9e49c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aadd20d16b944078df237209c87ceda'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:59.125585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-703ee026-01ce-4400-8575-62b7be9e49c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aadd20d16b944078df237209c87ceda'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:59.126261 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-703ee026-01ce-4400-8575-62b7be9e49c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aadd20d16b944078df237209c87ceda'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:59.141245 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1035/2090] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:58 2022] DELETE /identity/v3/users/4aadd20d16b944078df237209c87ceda => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:07:59.189407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:59.199685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4bfc6-17ca-4464-87f3-818349b1b55f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:59.280406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bae066-d973-41e8-86a9-d8e4e89e73ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:59.281314 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bae066-d973-41e8-86a9-d8e4e89e73ef admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:59.281764 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bae066-d973-41e8-86a9-d8e4e89e73ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:59.282692 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bae066-d973-41e8-86a9-d8e4e89e73ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:59.293783 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bae066-d973-41e8-86a9-d8e4e89e73ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:59.293783 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bae066-d973-41e8-86a9-d8e4e89e73ef admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:59.306995 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1056/2091] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:07:59.310232 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ee026-01ce-4400-8575-62b7be9e49c5 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:59.311726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-703ee026-01ce-4400-8575-62b7be9e49c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:59.330594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ee026-01ce-4400-8575-62b7be9e49c5 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:59.337258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee012e8b-6c74-4e54-8f84-21e9c33dba7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:59.340133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee012e8b-6c74-4e54-8f84-21e9c33dba7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:59.340991 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee012e8b-6c74-4e54-8f84-21e9c33dba7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:59.341149 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee012e8b-6c74-4e54-8f84-21e9c33dba7d admin admin] PATH_INFO: `/v3/projects/a31eb01068b549108ccdbfc55001f1e0/users/8fa3a6509c7f485f8e19ad54eaae85d1/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:59.343598 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee012e8b-6c74-4e54-8f84-21e9c33dba7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31eb01068b549108ccdbfc55001f1e0, user_id=8fa3a6509c7f485f8e19ad54eaae85d1, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:59.349577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee012e8b-6c74-4e54-8f84-21e9c33dba7d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:59.372399 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1036/2092] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:07:59 2022] PUT /identity/v3/projects/a31eb01068b549108ccdbfc55001f1e0/users/8fa3a6509c7f485f8e19ad54eaae85d1/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:59.383979 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f4e52-4c95-4675-929e-f8e5df4e91a4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:59.384673 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f4e52-4c95-4675-929e-f8e5df4e91a4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:59.384942 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f4e52-4c95-4675-929e-f8e5df4e91a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:59.437266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-821f4e52-4c95-4675-929e-f8e5df4e91a4 None None] MFA Rules not processed for user `8fa3a6509c7f485f8e19ad54eaae85d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:59.438407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-821f4e52-4c95-4675-929e-f8e5df4e91a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:59.488453 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee012e8b-6c74-4e54-8f84-21e9c33dba7d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:59.490391 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ee012e8b-6c74-4e54-8f84-21e9c33dba7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:59.529914 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1057/2093] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:07:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:59.543796 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f4e52-4c95-4675-929e-f8e5df4e91a4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:59.545236 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-821f4e52-4c95-4675-929e-f8e5df4e91a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:59.574311 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee012e8b-6c74-4e54-8f84-21e9c33dba7d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:59.579114 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57aa9b8-d6c8-45e9-84f8-33d986c99a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:59.580015 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aa9b8-d6c8-45e9-84f8-33d986c99a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:59.580300 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aa9b8-d6c8-45e9-84f8-33d986c99a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:59.580607 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aa9b8-d6c8-45e9-84f8-33d986c99a22 admin admin] PATH_INFO: `/v3/projects/c47bdfdf98bb4300a1ebbbb2f084216c` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:59.581946 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57aa9b8-d6c8-45e9-84f8-33d986c99a22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c47bdfdf98bb4300a1ebbbb2f084216c)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:59.584654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57aa9b8-d6c8-45e9-84f8-33d986c99a22 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:59.605339 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f4e52-4c95-4675-929e-f8e5df4e91a4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:59.609775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0746b3d-a16d-43ad-bdf9-73c6aff35f4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:59.610426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0746b3d-a16d-43ad-bdf9-73c6aff35f4c service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:59.610715 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0746b3d-a16d-43ad-bdf9-73c6aff35f4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:59.610993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0746b3d-a16d-43ad-bdf9-73c6aff35f4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:59.622469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0746b3d-a16d-43ad-bdf9-73c6aff35f4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:59.624075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0746b3d-a16d-43ad-bdf9-73c6aff35f4c service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:59.633703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1058/2094] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:07:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:59.633940 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c57aa9b8-d6c8-45e9-84f8-33d986c99a22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c47bdfdf98bb4300a1ebbbb2f084216c', 'request_id': 'req-c57aa9b8-d6c8-45e9-84f8-33d986c99a22'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:59.642518 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c57aa9b8-d6c8-45e9-84f8-33d986c99a22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c47bdfdf98bb4300a1ebbbb2f084216c', 'request_id': 'req-c57aa9b8-d6c8-45e9-84f8-33d986c99a22'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:59.649971 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c57aa9b8-d6c8-45e9-84f8-33d986c99a22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c47bdfdf98bb4300a1ebbbb2f084216c', 'request_id': 'req-c57aa9b8-d6c8-45e9-84f8-33d986c99a22'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:59.662103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c57aa9b8-d6c8-45e9-84f8-33d986c99a22 admin admin] The token cache is being invalidate because project c47bdfdf98bb4300a1ebbbb2f084216c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:07:59.662395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c57aa9b8-d6c8-45e9-84f8-33d986c99a22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:59.663065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c57aa9b8-d6c8-45e9-84f8-33d986c99a22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:59.664708 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1037/2095] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:07:59 2022] DELETE /identity/v3/projects/c47bdfdf98bb4300a1ebbbb2f084216c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:59.668749 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0746b3d-a16d-43ad-bdf9-73c6aff35f4c service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:59.679962 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0746b3d-a16d-43ad-bdf9-73c6aff35f4c service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:59.703937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:59.739471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e358d-d776-4def-94f3-deab649e278d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:59.740396 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e358d-d776-4def-94f3-deab649e278d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:59.740686 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e358d-d776-4def-94f3-deab649e278d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:59.740966 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e358d-d776-4def-94f3-deab649e278d admin admin] PATH_INFO: `/v3/users/c4d899baed70477dbaf481bb28c7b496` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:59.747392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e358d-d776-4def-94f3-deab649e278d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d899baed70477dbaf481bb28c7b496)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:59.747392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e358d-d776-4def-94f3-deab649e278d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:59.804609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-712e358d-d776-4def-94f3-deab649e278d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d899baed70477dbaf481bb28c7b496'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:59.816144 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-712e358d-d776-4def-94f3-deab649e278d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d899baed70477dbaf481bb28c7b496'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:59.833684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-712e358d-d776-4def-94f3-deab649e278d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d899baed70477dbaf481bb28c7b496'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:59.834619 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-712e358d-d776-4def-94f3-deab649e278d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d899baed70477dbaf481bb28c7b496'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:59.845362 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-712e358d-d776-4def-94f3-deab649e278d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d899baed70477dbaf481bb28c7b496'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:07:59.854319 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1059/2096] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:07:59 2022] DELETE /identity/v3/users/c4d899baed70477dbaf481bb28c7b496 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:07:59.982400 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57aa9b8-d6c8-45e9-84f8-33d986c99a22 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:59.984150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c57aa9b8-d6c8-45e9-84f8-33d986c99a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:59.990597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:00.079961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57aa9b8-d6c8-45e9-84f8-33d986c99a22 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:00.160037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c67a6-f5b0-4f2c-a5c4-44cc57cefa7f tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fa3a6509c7f485f8e19ad54eaae85d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31eb01068b549108ccdbfc55001f1e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:00.160878 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c67a6-f5b0-4f2c-a5c4-44cc57cefa7f tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:00.161336 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c67a6-f5b0-4f2c-a5c4-44cc57cefa7f tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:00.161628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c67a6-f5b0-4f2c-a5c4-44cc57cefa7f tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:00.162382 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c67a6-f5b0-4f2c-a5c4-44cc57cefa7f tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:08:00.162703 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c67a6-f5b0-4f2c-a5c4-44cc57cefa7f tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:00.165049 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c67a6-f5b0-4f2c-a5c4-44cc57cefa7f tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:00.179279 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1038/2097] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:08:00.185529 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e358d-d776-4def-94f3-deab649e278d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:00.187384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-712e358d-d776-4def-94f3-deab649e278d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:00.226387 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e358d-d776-4def-94f3-deab649e278d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:00.233315 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9fccf-1e05-4b81-aadd-c902684fe06f tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fa3a6509c7f485f8e19ad54eaae85d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31eb01068b549108ccdbfc55001f1e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:00.234312 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9fccf-1e05-4b81-aadd-c902684fe06f tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:00.234614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9fccf-1e05-4b81-aadd-c902684fe06f tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:00.234952 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9fccf-1e05-4b81-aadd-c902684fe06f tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:00.236787 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c67a6-f5b0-4f2c-a5c4-44cc57cefa7f tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:00.237426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9fccf-1e05-4b81-aadd-c902684fe06f tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:00.239744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-995c67a6-f5b0-4f2c-a5c4-44cc57cefa7f tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:00.241450 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9fccf-1e05-4b81-aadd-c902684fe06f tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:00.304129 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1060/2098] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:08:00 2022] POST /identity/v3/projects => generated 355 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:08:00.305561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9fccf-1e05-4b81-aadd-c902684fe06f tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:00.338371 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c67a6-f5b0-4f2c-a5c4-44cc57cefa7f tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:00.372565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9fccf-1e05-4b81-aadd-c902684fe06f tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:00.377365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ca3fe-b61a-4ae5-8965-ee2a91a29aa3 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fa3a6509c7f485f8e19ad54eaae85d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31eb01068b549108ccdbfc55001f1e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:00.378034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ca3fe-b61a-4ae5-8965-ee2a91a29aa3 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:00.378326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ca3fe-b61a-4ae5-8965-ee2a91a29aa3 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:00.378611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ca3fe-b61a-4ae5-8965-ee2a91a29aa3 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:00.380038 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ca3fe-b61a-4ae5-8965-ee2a91a29aa3 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:08:00.380361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ca3fe-b61a-4ae5-8965-ee2a91a29aa3 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:00.382049 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ca3fe-b61a-4ae5-8965-ee2a91a29aa3 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:00.396189 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1061/2099] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:08:00.403002 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:00.414461 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fc7d8-d378-466e-a402-972e79113b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:00.415948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fc7d8-d378-466e-a402-972e79113b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:00.416420 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fc7d8-d378-466e-a402-972e79113b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:00.416928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fc7d8-d378-466e-a402-972e79113b97 admin admin] PATH_INFO: `/v3/projects/f0bec297917e4843a8ac851e04a58e5e` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:00.418882 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fc7d8-d378-466e-a402-972e79113b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0bec297917e4843a8ac851e04a58e5e)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:00.422432 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fc7d8-d378-466e-a402-972e79113b97 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:00.434386 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ca3fe-b61a-4ae5-8965-ee2a91a29aa3 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:00.445046 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ca3fe-b61a-4ae5-8965-ee2a91a29aa3 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:00.449758 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b890cda-6798-4e4e-a1c2-7e134967e951 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fa3a6509c7f485f8e19ad54eaae85d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31eb01068b549108ccdbfc55001f1e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:00.450772 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b890cda-6798-4e4e-a1c2-7e134967e951 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:00.451553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b890cda-6798-4e4e-a1c2-7e134967e951 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:00.451860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b890cda-6798-4e4e-a1c2-7e134967e951 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] PATH_INFO: `/v3/projects/0819083ae98c4968b0179fc00acf7755` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:00.453232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b890cda-6798-4e4e-a1c2-7e134967e951 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0819083ae98c4968b0179fc00acf7755)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:00.455261 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b890cda-6798-4e4e-a1c2-7e134967e951 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:00.474914 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:00.476321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5d4fc7d8-d378-466e-a402-972e79113b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0bec297917e4843a8ac851e04a58e5e', 'request_id': 'req-5d4fc7d8-d378-466e-a402-972e79113b97'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:00.486631 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5d4fc7d8-d378-466e-a402-972e79113b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0bec297917e4843a8ac851e04a58e5e', 'request_id': 'req-5d4fc7d8-d378-466e-a402-972e79113b97'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:00.495575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5d4fc7d8-d378-466e-a402-972e79113b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0bec297917e4843a8ac851e04a58e5e', 'request_id': 'req-5d4fc7d8-d378-466e-a402-972e79113b97'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:00.510744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5d4fc7d8-d378-466e-a402-972e79113b97 admin admin] The token cache is being invalidate because project f0bec297917e4843a8ac851e04a58e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:08:00.511086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5d4fc7d8-d378-466e-a402-972e79113b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:00.512069 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5d4fc7d8-d378-466e-a402-972e79113b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:00.517462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1039/2100] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:08:00 2022] DELETE /identity/v3/projects/f0bec297917e4843a8ac851e04a58e5e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:08:00.519044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471737f-31bb-4f7e-89dd-e6a78d65890d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:00.519339 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471737f-31bb-4f7e-89dd-e6a78d65890d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:00.520182 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5b890cda-6798-4e4e-a1c2-7e134967e951 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0819083ae98c4968b0179fc00acf7755', 'request_id': 'req-5b890cda-6798-4e4e-a1c2-7e134967e951'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:00.520546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471737f-31bb-4f7e-89dd-e6a78d65890d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:00.539865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5b890cda-6798-4e4e-a1c2-7e134967e951 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0819083ae98c4968b0179fc00acf7755', 'request_id': 'req-5b890cda-6798-4e4e-a1c2-7e134967e951'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:00.545129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4471737f-31bb-4f7e-89dd-e6a78d65890d None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:00.546554 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4471737f-31bb-4f7e-89dd-e6a78d65890d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:00.554554 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5b890cda-6798-4e4e-a1c2-7e134967e951 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0819083ae98c4968b0179fc00acf7755', 'request_id': 'req-5b890cda-6798-4e4e-a1c2-7e134967e951'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:00.570062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5b890cda-6798-4e4e-a1c2-7e134967e951 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] The token cache is being invalidate because project 0819083ae98c4968b0179fc00acf7755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:08:00.570787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5b890cda-6798-4e4e-a1c2-7e134967e951 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:00.571239 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5b890cda-6798-4e4e-a1c2-7e134967e951 tempest-VolumeQuotaClassesTest-438053339 tempest-VolumeQuotaClassesTest-438053339-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:00.573204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1062/2101] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:08:00 2022] DELETE /identity/v3/projects/0819083ae98c4968b0179fc00acf7755 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:08:00.656182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1040/2102] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:00.668420 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f615b86-8d0d-440a-88b7-05ce8cc1e53f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:00.668945 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f615b86-8d0d-440a-88b7-05ce8cc1e53f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:00.669539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f615b86-8d0d-440a-88b7-05ce8cc1e53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:00.701582 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5f615b86-8d0d-440a-88b7-05ce8cc1e53f None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:00.703540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5f615b86-8d0d-440a-88b7-05ce8cc1e53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:00.722327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1063/2103] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:08:00.727681 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471737f-31bb-4f7e-89dd-e6a78d65890d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:00.740961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471737f-31bb-4f7e-89dd-e6a78d65890d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:00.746685 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b171577-d16d-4483-af1e-9a983ddb42bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:00.747560 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b171577-d16d-4483-af1e-9a983ddb42bd admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:00.747981 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b171577-d16d-4483-af1e-9a983ddb42bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:00.748460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b171577-d16d-4483-af1e-9a983ddb42bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:00.749213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b171577-d16d-4483-af1e-9a983ddb42bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:08:00.749539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b171577-d16d-4483-af1e-9a983ddb42bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:00.751162 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b171577-d16d-4483-af1e-9a983ddb42bd admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:00.767854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1041/2104] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:08:00.773014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f615b86-8d0d-440a-88b7-05ce8cc1e53f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:00.782528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f615b86-8d0d-440a-88b7-05ce8cc1e53f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:00.787715 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca30742-7f31-4f11-9fbe-8f02d4e534a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:00.789136 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca30742-7f31-4f11-9fbe-8f02d4e534a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:00.789480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca30742-7f31-4f11-9fbe-8f02d4e534a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:00.789768 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca30742-7f31-4f11-9fbe-8f02d4e534a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:00.790542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca30742-7f31-4f11-9fbe-8f02d4e534a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:00.792488 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca30742-7f31-4f11-9fbe-8f02d4e534a2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:00.834723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1064/2105] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:08:00 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:08:00.839024 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b171577-d16d-4483-af1e-9a983ddb42bd admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:00.849544 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b171577-d16d-4483-af1e-9a983ddb42bd admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:00.860322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca30742-7f31-4f11-9fbe-8f02d4e534a2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:00.862010 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6ca30742-7f31-4f11-9fbe-8f02d4e534a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:00.910149 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5e66e-6c7f-42ef-a75a-70cb25bcd3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:00.910848 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5e66e-6c7f-42ef-a75a-70cb25bcd3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:00.911128 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5e66e-6c7f-42ef-a75a-70cb25bcd3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:00.911575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5e66e-6c7f-42ef-a75a-70cb25bcd3b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:00.912112 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5e66e-6c7f-42ef-a75a-70cb25bcd3b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:00.914051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5e66e-6c7f-42ef-a75a-70cb25bcd3b4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:00.930472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca30742-7f31-4f11-9fbe-8f02d4e534a2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:00.934128 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:00.935652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb32e4f-74b3-49db-99d4-4cfd4f199c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:00.936683 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb32e4f-74b3-49db-99d4-4cfd4f199c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:00.936970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb32e4f-74b3-49db-99d4-4cfd4f199c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:00.937254 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb32e4f-74b3-49db-99d4-4cfd4f199c0a admin admin] PATH_INFO: `/v3/users/36816a0cbbe6479eaf519f996969839c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:00.938475 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb32e4f-74b3-49db-99d4-4cfd4f199c0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=36816a0cbbe6479eaf519f996969839c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:00.940711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb32e4f-74b3-49db-99d4-4cfd4f199c0a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:00.941498 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1042/2106] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:08:00 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:08:00.945820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5e66e-6c7f-42ef-a75a-70cb25bcd3b4 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:00.956227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5e66e-6c7f-42ef-a75a-70cb25bcd3b4 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:00.961107 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d64bff-6092-47fa-8ec9-01f9114083ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:00.961765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d64bff-6092-47fa-8ec9-01f9114083ae admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:00.962050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d64bff-6092-47fa-8ec9-01f9114083ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:00.962326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d64bff-6092-47fa-8ec9-01f9114083ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:00.963047 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d64bff-6092-47fa-8ec9-01f9114083ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:00.964665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d64bff-6092-47fa-8ec9-01f9114083ae admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:00.976288 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1043/2107] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:08:00.980342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d64bff-6092-47fa-8ec9-01f9114083ae admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:00.991405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d64bff-6092-47fa-8ec9-01f9114083ae admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:00.995994 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-efb32e4f-74b3-49db-99d4-4cfd4f199c0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36816a0cbbe6479eaf519f996969839c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:00.996754 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc0476-9364-43bf-933f-3d0d0946347b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:00.997463 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc0476-9364-43bf-933f-3d0d0946347b admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:00.997900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc0476-9364-43bf-933f-3d0d0946347b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:00.998191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc0476-9364-43bf-933f-3d0d0946347b admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:00.999340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc0476-9364-43bf-933f-3d0d0946347b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:01.001381 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc0476-9364-43bf-933f-3d0d0946347b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:01.003652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-efb32e4f-74b3-49db-99d4-4cfd4f199c0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36816a0cbbe6479eaf519f996969839c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:01.013039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1044/2108] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:08:01.017121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-efb32e4f-74b3-49db-99d4-4cfd4f199c0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36816a0cbbe6479eaf519f996969839c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:01.017260 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc0476-9364-43bf-933f-3d0d0946347b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:01.017855 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-efb32e4f-74b3-49db-99d4-4cfd4f199c0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36816a0cbbe6479eaf519f996969839c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:01.019402 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-45dc0476-9364-43bf-933f-3d0d0946347b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:01.020430 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:01.027035 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-efb32e4f-74b3-49db-99d4-4cfd4f199c0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36816a0cbbe6479eaf519f996969839c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:01.033993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc0476-9364-43bf-933f-3d0d0946347b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:01.034387 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1065/2109] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:08:00 2022] DELETE /identity/v3/users/36816a0cbbe6479eaf519f996969839c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:08:01.038864 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c2616-4b1e-4fb5-9e9f-dc1f7a67605c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:01.039161 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c2616-4b1e-4fb5-9e9f-dc1f7a67605c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:01.039437 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c2616-4b1e-4fb5-9e9f-dc1f7a67605c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:01.058141 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5a0c2616-4b1e-4fb5-9e9f-dc1f7a67605c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:01.059838 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5a0c2616-4b1e-4fb5-9e9f-dc1f7a67605c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:01.100405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080a92d-57d8-42dd-8a33-98f945019b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:01.101305 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080a92d-57d8-42dd-8a33-98f945019b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:01.101648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080a92d-57d8-42dd-8a33-98f945019b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:01.101922 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080a92d-57d8-42dd-8a33-98f945019b5b admin admin] PATH_INFO: `/v3/projects/4f305c94f39042c9b796114c70e59194/users/c1b80e22dd284251ae75ed38ffdd2fa1/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:01.117960 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080a92d-57d8-42dd-8a33-98f945019b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f305c94f39042c9b796114c70e59194, user_id=c1b80e22dd284251ae75ed38ffdd2fa1, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:01.120888 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080a92d-57d8-42dd-8a33-98f945019b5b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:01.128204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1066/2110] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:08:01.135875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1045/2111] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:08:01 2022] PUT /identity/v3/projects/4f305c94f39042c9b796114c70e59194/users/c1b80e22dd284251ae75ed38ffdd2fa1/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:08:01.145533 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c2616-4b1e-4fb5-9e9f-dc1f7a67605c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:01.145533 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5a0c2616-4b1e-4fb5-9e9f-dc1f7a67605c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:01.148671 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5bd72-267b-4dad-9eaf-d1ae40636191 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:01.149006 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5bd72-267b-4dad-9eaf-d1ae40636191 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:01.149321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5bd72-267b-4dad-9eaf-d1ae40636191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:01.176353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2ef5bd72-267b-4dad-9eaf-d1ae40636191 None None] MFA Rules not processed for user `c1b80e22dd284251ae75ed38ffdd2fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:01.177559 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2ef5bd72-267b-4dad-9eaf-d1ae40636191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:01.201567 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c2616-4b1e-4fb5-9e9f-dc1f7a67605c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:01.249764 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1046/2112] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:01.253654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b7ff1-e56d-4788-93f4-9e349c3dd2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:01.255259 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b7ff1-e56d-4788-93f4-9e349c3dd2ed service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:01.255546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b7ff1-e56d-4788-93f4-9e349c3dd2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:01.255841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b7ff1-e56d-4788-93f4-9e349c3dd2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:01.262354 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5bd72-267b-4dad-9eaf-d1ae40636191 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:01.263743 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2ef5bd72-267b-4dad-9eaf-d1ae40636191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:01.317175 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b7ff1-e56d-4788-93f4-9e349c3dd2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:01.318848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b7ff1-e56d-4788-93f4-9e349c3dd2ed service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:01.322180 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:01.322980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:01.327263 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5bd72-267b-4dad-9eaf-d1ae40636191 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:01.331887 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97051d-903c-40b6-aa03-b5f63ba694a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:01.333521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97051d-903c-40b6-aa03-b5f63ba694a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:01.333817 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1067/2113] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:08:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:08:01.333950 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97051d-903c-40b6-aa03-b5f63ba694a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:01.334105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97051d-903c-40b6-aa03-b5f63ba694a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:01.343370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97051d-903c-40b6-aa03-b5f63ba694a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:01.344917 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97051d-903c-40b6-aa03-b5f63ba694a2 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:01.355464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1047/2114] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:08:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:08:01.644408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b7ff1-e56d-4788-93f4-9e349c3dd2ed service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:01.647022 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9c7b7ff1-e56d-4788-93f4-9e349c3dd2ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:01.668064 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b7ff1-e56d-4788-93f4-9e349c3dd2ed service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:01.694470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6958e-e49e-48b0-9fd4-c3504bd2eef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:01.694470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6958e-e49e-48b0-9fd4-c3504bd2eef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:01.694470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6958e-e49e-48b0-9fd4-c3504bd2eef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:01.694470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6958e-e49e-48b0-9fd4-c3504bd2eef1 admin admin] PATH_INFO: `/v3/projects/c13bcb875aca48759e7fff01818de9cc` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:01.695517 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6958e-e49e-48b0-9fd4-c3504bd2eef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13bcb875aca48759e7fff01818de9cc)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:01.695517 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6958e-e49e-48b0-9fd4-c3504bd2eef1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:01.754527 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-13a6958e-e49e-48b0-9fd4-c3504bd2eef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13bcb875aca48759e7fff01818de9cc', 'request_id': 'req-13a6958e-e49e-48b0-9fd4-c3504bd2eef1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:01.761608 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-13a6958e-e49e-48b0-9fd4-c3504bd2eef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13bcb875aca48759e7fff01818de9cc', 'request_id': 'req-13a6958e-e49e-48b0-9fd4-c3504bd2eef1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:01.773310 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-13a6958e-e49e-48b0-9fd4-c3504bd2eef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13bcb875aca48759e7fff01818de9cc', 'request_id': 'req-13a6958e-e49e-48b0-9fd4-c3504bd2eef1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:01.785006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-13a6958e-e49e-48b0-9fd4-c3504bd2eef1 admin admin] The token cache is being invalidate because project c13bcb875aca48759e7fff01818de9cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:08:01.786673 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-13a6958e-e49e-48b0-9fd4-c3504bd2eef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:01.787451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-13a6958e-e49e-48b0-9fd4-c3504bd2eef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:01.789051 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1068/2115] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:08:01 2022] DELETE /identity/v3/projects/c13bcb875aca48759e7fff01818de9cc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:08:01.793053 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97051d-903c-40b6-aa03-b5f63ba694a2 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:01.804078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97051d-903c-40b6-aa03-b5f63ba694a2 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:01.864753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d5726-c3f3-4d79-8a6b-4acbbf8ee770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:01.865639 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d5726-c3f3-4d79-8a6b-4acbbf8ee770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:01.865921 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d5726-c3f3-4d79-8a6b-4acbbf8ee770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:01.866200 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d5726-c3f3-4d79-8a6b-4acbbf8ee770 admin admin] PATH_INFO: `/v3/users/8fa3a6509c7f485f8e19ad54eaae85d1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:01.867394 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d5726-c3f3-4d79-8a6b-4acbbf8ee770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fa3a6509c7f485f8e19ad54eaae85d1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:01.869360 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d5726-c3f3-4d79-8a6b-4acbbf8ee770 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:01.917131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7c6d5726-c3f3-4d79-8a6b-4acbbf8ee770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fa3a6509c7f485f8e19ad54eaae85d1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:01.926097 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7c6d5726-c3f3-4d79-8a6b-4acbbf8ee770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fa3a6509c7f485f8e19ad54eaae85d1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:01.939644 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7c6d5726-c3f3-4d79-8a6b-4acbbf8ee770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fa3a6509c7f485f8e19ad54eaae85d1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:01.940448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7c6d5726-c3f3-4d79-8a6b-4acbbf8ee770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fa3a6509c7f485f8e19ad54eaae85d1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:01.941225 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7c6d5726-c3f3-4d79-8a6b-4acbbf8ee770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fa3a6509c7f485f8e19ad54eaae85d1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:01.954828 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1048/2116] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:08:01 2022] DELETE /identity/v3/users/8fa3a6509c7f485f8e19ad54eaae85d1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:08:01.962432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6958e-e49e-48b0-9fd4-c3504bd2eef1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:01.963901 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-13a6958e-e49e-48b0-9fd4-c3504bd2eef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:01.977508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6958e-e49e-48b0-9fd4-c3504bd2eef1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:02.038088 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd987bc-7168-4d64-8287-6dbdceedfe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:02.038872 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd987bc-7168-4d64-8287-6dbdceedfe98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:02.039160 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd987bc-7168-4d64-8287-6dbdceedfe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:02.039438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd987bc-7168-4d64-8287-6dbdceedfe98 admin admin] PATH_INFO: `/v3/users/a9b62a8b4dfa4fc1a5ed4025df4f2200` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:02.040802 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd987bc-7168-4d64-8287-6dbdceedfe98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b62a8b4dfa4fc1a5ed4025df4f2200)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:02.042823 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd987bc-7168-4d64-8287-6dbdceedfe98 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:02.097327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1fd987bc-7168-4d64-8287-6dbdceedfe98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b62a8b4dfa4fc1a5ed4025df4f2200'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:02.106866 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1fd987bc-7168-4d64-8287-6dbdceedfe98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b62a8b4dfa4fc1a5ed4025df4f2200'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:02.121742 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1fd987bc-7168-4d64-8287-6dbdceedfe98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b62a8b4dfa4fc1a5ed4025df4f2200'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:02.122454 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1fd987bc-7168-4d64-8287-6dbdceedfe98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b62a8b4dfa4fc1a5ed4025df4f2200'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:02.130170 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1fd987bc-7168-4d64-8287-6dbdceedfe98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b62a8b4dfa4fc1a5ed4025df4f2200'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:02.132336 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:02.137722 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1069/2117] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:08:01 2022] DELETE /identity/v3/users/a9b62a8b4dfa4fc1a5ed4025df4f2200 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:08:02.142484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c50e8-8de1-4b54-b099-801ce5efb5ed None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:02.142958 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c50e8-8de1-4b54-b099-801ce5efb5ed None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:02.143249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c50e8-8de1-4b54-b099-801ce5efb5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:02.161722 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-db7c50e8-8de1-4b54-b099-801ce5efb5ed None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:02.162997 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-db7c50e8-8de1-4b54-b099-801ce5efb5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:02.227407 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1049/2118] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:02.237716 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd987bc-7168-4d64-8287-6dbdceedfe98 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:02.239203 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1fd987bc-7168-4d64-8287-6dbdceedfe98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:02.241793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c50e8-8de1-4b54-b099-801ce5efb5ed None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:02.243216 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-db7c50e8-8de1-4b54-b099-801ce5efb5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:02.256705 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c50e8-8de1-4b54-b099-801ce5efb5ed None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:02.261528 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6178bc-0e6b-4ba7-a68c-b8a48f925177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:02.262407 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6178bc-0e6b-4ba7-a68c-b8a48f925177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:02.262697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6178bc-0e6b-4ba7-a68c-b8a48f925177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:02.262979 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6178bc-0e6b-4ba7-a68c-b8a48f925177 admin admin] PATH_INFO: `/v3/projects/a31eb01068b549108ccdbfc55001f1e0` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:02.264204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6178bc-0e6b-4ba7-a68c-b8a48f925177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a31eb01068b549108ccdbfc55001f1e0)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:02.266326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6178bc-0e6b-4ba7-a68c-b8a48f925177 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:02.273771 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:02.309226 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd987bc-7168-4d64-8287-6dbdceedfe98 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:02.322423 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ef6178bc-0e6b-4ba7-a68c-b8a48f925177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a31eb01068b549108ccdbfc55001f1e0', 'request_id': 'req-ef6178bc-0e6b-4ba7-a68c-b8a48f925177'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:02.329947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ef6178bc-0e6b-4ba7-a68c-b8a48f925177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a31eb01068b549108ccdbfc55001f1e0', 'request_id': 'req-ef6178bc-0e6b-4ba7-a68c-b8a48f925177'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:02.337165 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ef6178bc-0e6b-4ba7-a68c-b8a48f925177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a31eb01068b549108ccdbfc55001f1e0', 'request_id': 'req-ef6178bc-0e6b-4ba7-a68c-b8a48f925177'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:02.349526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ef6178bc-0e6b-4ba7-a68c-b8a48f925177 admin admin] The token cache is being invalidate because project a31eb01068b549108ccdbfc55001f1e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:08:02.350226 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ef6178bc-0e6b-4ba7-a68c-b8a48f925177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:02.350469 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ef6178bc-0e6b-4ba7-a68c-b8a48f925177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:02.352388 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1050/2119] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:08:02 2022] DELETE /identity/v3/projects/a31eb01068b549108ccdbfc55001f1e0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:08:02.357150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa4770-87ea-4872-83b1-318fd48952a7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:02.357447 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa4770-87ea-4872-83b1-318fd48952a7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:02.357735 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa4770-87ea-4872-83b1-318fd48952a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:02.364317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1d844-0d86-41bc-82b2-a14a3761bd77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:02.365720 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1d844-0d86-41bc-82b2-a14a3761bd77 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:02.365720 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1d844-0d86-41bc-82b2-a14a3761bd77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:02.365720 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1d844-0d86-41bc-82b2-a14a3761bd77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:02.367537 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bec1d844-0d86-41bc-82b2-a14a3761bd77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:02.376513 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-79aa4770-87ea-4872-83b1-318fd48952a7 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:02.377953 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-79aa4770-87ea-4872-83b1-318fd48952a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:02.436496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1d844-0d86-41bc-82b2-a14a3761bd77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:02.438153 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1d844-0d86-41bc-82b2-a14a3761bd77 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:02.443457 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1051/2120] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:08:02.448992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1070/2121] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:02.451221 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62aac2-0cdd-4bfa-83f2-e3de4bf3c0a5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:02.451449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62aac2-0cdd-4bfa-83f2-e3de4bf3c0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:02.451731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62aac2-0cdd-4bfa-83f2-e3de4bf3c0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:02.469876 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-dd62aac2-0cdd-4bfa-83f2-e3de4bf3c0a5 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:02.471095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-dd62aac2-0cdd-4bfa-83f2-e3de4bf3c0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:02.479114 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1052/2122] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:02.483316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1d844-0d86-41bc-82b2-a14a3761bd77 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:02.494579 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1d844-0d86-41bc-82b2-a14a3761bd77 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:02.499334 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e26bb-376a-48f8-af30-4b45423a9e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:02.500040 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e26bb-376a-48f8-af30-4b45423a9e57 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:02.500330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e26bb-376a-48f8-af30-4b45423a9e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:02.500620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e26bb-376a-48f8-af30-4b45423a9e57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:02.501354 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e26bb-376a-48f8-af30-4b45423a9e57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:08:02.501677 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e26bb-376a-48f8-af30-4b45423a9e57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:02.503284 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e26bb-376a-48f8-af30-4b45423a9e57 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:02.520960 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1071/2123] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:08:02.522100 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62aac2-0cdd-4bfa-83f2-e3de4bf3c0a5 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:02.531801 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62aac2-0cdd-4bfa-83f2-e3de4bf3c0a5 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:02.536939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a117a98-ce3d-4615-b583-bdcdf0d63b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:02.537608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a117a98-ce3d-4615-b583-bdcdf0d63b91 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:02.537924 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a117a98-ce3d-4615-b583-bdcdf0d63b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:02.538206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a117a98-ce3d-4615-b583-bdcdf0d63b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:02.539022 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a117a98-ce3d-4615-b583-bdcdf0d63b91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:02.541248 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a117a98-ce3d-4615-b583-bdcdf0d63b91 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:02.568704 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1053/2124] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:08:02 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:08:02.573085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e26bb-376a-48f8-af30-4b45423a9e57 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:02.583961 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e26bb-376a-48f8-af30-4b45423a9e57 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:02.640425 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:02.650303 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a41a4-10b3-4dcf-9629-311a98c7284f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:02.650985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a41a4-10b3-4dcf-9629-311a98c7284f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:02.651274 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a41a4-10b3-4dcf-9629-311a98c7284f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:02.651554 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a41a4-10b3-4dcf-9629-311a98c7284f admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:02.652506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a41a4-10b3-4dcf-9629-311a98c7284f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:02.654426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a41a4-10b3-4dcf-9629-311a98c7284f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:02.674580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1072/2125] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:08:02 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:08:02.679622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a117a98-ce3d-4615-b583-bdcdf0d63b91 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:02.692688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a117a98-ce3d-4615-b583-bdcdf0d63b91 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:02.710256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3d399-893e-43f2-a645-05aaeb3db3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:02.710949 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3d399-893e-43f2-a645-05aaeb3db3ac admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:02.711232 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3d399-893e-43f2-a645-05aaeb3db3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:02.711511 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3d399-893e-43f2-a645-05aaeb3db3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:02.712285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3d399-893e-43f2-a645-05aaeb3db3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:02.714030 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3d399-893e-43f2-a645-05aaeb3db3ac admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:02.727658 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1054/2126] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:08:02.732137 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a41a4-10b3-4dcf-9629-311a98c7284f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:02.733265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3d399-893e-43f2-a645-05aaeb3db3ac admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:02.735476 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5ef3d399-893e-43f2-a645-05aaeb3db3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:02.744830 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a41a4-10b3-4dcf-9629-311a98c7284f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:02.749662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f7a76-4737-49c7-b86d-37b81225d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:02.750819 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f7a76-4737-49c7-b86d-37b81225d1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:02.750819 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f7a76-4737-49c7-b86d-37b81225d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:02.750993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f7a76-4737-49c7-b86d-37b81225d1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:02.751621 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f7a76-4737-49c7-b86d-37b81225d1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:02.753260 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f7a76-4737-49c7-b86d-37b81225d1a3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:02.757228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3d399-893e-43f2-a645-05aaeb3db3ac admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:02.767785 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1073/2127] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:08:02.775098 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb7aa2-4d95-431c-85ba-d56b1dd2ae48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:02.775098 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb7aa2-4d95-431c-85ba-d56b1dd2ae48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:02.775098 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb7aa2-4d95-431c-85ba-d56b1dd2ae48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:02.775098 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb7aa2-4d95-431c-85ba-d56b1dd2ae48 admin admin] PATH_INFO: `/v3/projects/461cf394f3194815a2ba072bacf1c78d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:02.775710 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb7aa2-4d95-431c-85ba-d56b1dd2ae48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=461cf394f3194815a2ba072bacf1c78d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:02.775870 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f7a76-4737-49c7-b86d-37b81225d1a3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:02.782375 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb7aa2-4d95-431c-85ba-d56b1dd2ae48 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:02.792746 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f7a76-4737-49c7-b86d-37b81225d1a3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:02.799864 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3547a3f-a9d4-4c70-aeef-e04175bef528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:02.802811 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3547a3f-a9d4-4c70-aeef-e04175bef528 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:02.803859 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3547a3f-a9d4-4c70-aeef-e04175bef528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:02.805197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3547a3f-a9d4-4c70-aeef-e04175bef528 admin admin] PATH_INFO: `/v3/projects/d2d36136795d4c428bb47e734b126017/users/cb24ad08e2f44827ab39684760cfa5a3/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:02.845147 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3547a3f-a9d4-4c70-aeef-e04175bef528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d36136795d4c428bb47e734b126017, user_id=cb24ad08e2f44827ab39684760cfa5a3, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:02.850975 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3547a3f-a9d4-4c70-aeef-e04175bef528 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:02.851167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-91eb7aa2-4d95-431c-85ba-d56b1dd2ae48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '461cf394f3194815a2ba072bacf1c78d', 'request_id': 'req-91eb7aa2-4d95-431c-85ba-d56b1dd2ae48'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:02.853659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:02.865454 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-91eb7aa2-4d95-431c-85ba-d56b1dd2ae48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '461cf394f3194815a2ba072bacf1c78d', 'request_id': 'req-91eb7aa2-4d95-431c-85ba-d56b1dd2ae48'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:02.876226 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1074/2128] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:08:02 2022] PUT /identity/v3/projects/d2d36136795d4c428bb47e734b126017/users/cb24ad08e2f44827ab39684760cfa5a3/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:08:02.877195 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-91eb7aa2-4d95-431c-85ba-d56b1dd2ae48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '461cf394f3194815a2ba072bacf1c78d', 'request_id': 'req-91eb7aa2-4d95-431c-85ba-d56b1dd2ae48'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:02.879618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc7856-2e48-4888-b299-9ca4cb3e7b35 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:02.880167 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc7856-2e48-4888-b299-9ca4cb3e7b35 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:02.880502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc7856-2e48-4888-b299-9ca4cb3e7b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:02.896837 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-91eb7aa2-4d95-431c-85ba-d56b1dd2ae48 admin admin] The token cache is being invalidate because project 461cf394f3194815a2ba072bacf1c78d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:08:02.896976 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-91eb7aa2-4d95-431c-85ba-d56b1dd2ae48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:02.897714 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-91eb7aa2-4d95-431c-85ba-d56b1dd2ae48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:02.899416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1055/2129] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:08:02 2022] DELETE /identity/v3/projects/461cf394f3194815a2ba072bacf1c78d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:08:02.904788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-73fc7856-2e48-4888-b299-9ca4cb3e7b35 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:02.905284 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84e89b-0dba-439b-9869-a82746dbeee0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:02.905579 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84e89b-0dba-439b-9869-a82746dbeee0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:02.905857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84e89b-0dba-439b-9869-a82746dbeee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:02.906835 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-73fc7856-2e48-4888-b299-9ca4cb3e7b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:02.928279 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ac84e89b-0dba-439b-9869-a82746dbeee0 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:02.929496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ac84e89b-0dba-439b-9869-a82746dbeee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:02.978303 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1075/2130] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:08:02.990823 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc7856-2e48-4888-b299-9ca4cb3e7b35 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:02.992667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-73fc7856-2e48-4888-b299-9ca4cb3e7b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:03.038148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1056/2131] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:03.046451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea08491-1019-4499-a798-d1ce02dfd625 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:03.046615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea08491-1019-4499-a798-d1ce02dfd625 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:03.046986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea08491-1019-4499-a798-d1ce02dfd625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:03.069237 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-bea08491-1019-4499-a798-d1ce02dfd625 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:03.070565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bea08491-1019-4499-a798-d1ce02dfd625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:03.083643 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc7856-2e48-4888-b299-9ca4cb3e7b35 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:03.097983 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1057/2132] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:08:03.098144 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331514d0-7095-45d3-a199-d081194256d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:03.098144 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331514d0-7095-45d3-a199-d081194256d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:03.098144 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331514d0-7095-45d3-a199-d081194256d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:03.098144 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331514d0-7095-45d3-a199-d081194256d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:03.099391 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea08491-1019-4499-a798-d1ce02dfd625 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:03.110162 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea08491-1019-4499-a798-d1ce02dfd625 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:03.113411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331514d0-7095-45d3-a199-d081194256d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:03.115943 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebd27a-bf90-4a18-b0af-d7a34851745c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:03.116614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebd27a-bf90-4a18-b0af-d7a34851745c admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:03.116902 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebd27a-bf90-4a18-b0af-d7a34851745c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:03.117183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebd27a-bf90-4a18-b0af-d7a34851745c admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:03.117766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331514d0-7095-45d3-a199-d081194256d5 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:03.118060 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebd27a-bf90-4a18-b0af-d7a34851745c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:08:03.118441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebd27a-bf90-4a18-b0af-d7a34851745c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:03.120081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebd27a-bf90-4a18-b0af-d7a34851745c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:03.133019 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1076/2133] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:08:03.139566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1058/2134] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:08:03.140799 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331514d0-7095-45d3-a199-d081194256d5 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:03.153233 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331514d0-7095-45d3-a199-d081194256d5 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:03.159178 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209c9c0-c038-41e7-bcc7-bdaff6bbab70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:03.160495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209c9c0-c038-41e7-bcc7-bdaff6bbab70 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:03.160781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209c9c0-c038-41e7-bcc7-bdaff6bbab70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:03.161076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209c9c0-c038-41e7-bcc7-bdaff6bbab70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:03.161933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209c9c0-c038-41e7-bcc7-bdaff6bbab70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:03.166478 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209c9c0-c038-41e7-bcc7-bdaff6bbab70 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:03.202167 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1077/2135] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:08:03 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:08:03.208569 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebd27a-bf90-4a18-b0af-d7a34851745c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:03.226748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebd27a-bf90-4a18-b0af-d7a34851745c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:03.292335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6c53d-dc1f-417b-b3e3-d173e0790d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:03.293040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6c53d-dc1f-417b-b3e3-d173e0790d29 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:03.293333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6c53d-dc1f-417b-b3e3-d173e0790d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:03.293656 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6c53d-dc1f-417b-b3e3-d173e0790d29 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:03.294445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6c53d-dc1f-417b-b3e3-d173e0790d29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:03.296705 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6c53d-dc1f-417b-b3e3-d173e0790d29 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:03.322611 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1059/2136] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:08:03 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:08:03.324713 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209c9c0-c038-41e7-bcc7-bdaff6bbab70 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:03.345994 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209c9c0-c038-41e7-bcc7-bdaff6bbab70 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:03.354813 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fa30a-2f32-4c52-9d9b-2e424be84002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:03.356134 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fa30a-2f32-4c52-9d9b-2e424be84002 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:03.356433 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fa30a-2f32-4c52-9d9b-2e424be84002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:03.356812 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fa30a-2f32-4c52-9d9b-2e424be84002 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:03.357567 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fa30a-2f32-4c52-9d9b-2e424be84002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:03.363700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fa30a-2f32-4c52-9d9b-2e424be84002 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:03.379001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1078/2137] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:08:03.383343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6c53d-dc1f-417b-b3e3-d173e0790d29 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:03.397644 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6c53d-dc1f-417b-b3e3-d173e0790d29 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:03.402561 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e3c88-40fc-4940-98d6-3ccaa32959dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:03.403599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3c88-40fc-4940-98d6-3ccaa32959dd admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:03.404099 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3c88-40fc-4940-98d6-3ccaa32959dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:03.404460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3c88-40fc-4940-98d6-3ccaa32959dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:03.405291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e3c88-40fc-4940-98d6-3ccaa32959dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:03.407052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e3c88-40fc-4940-98d6-3ccaa32959dd admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:03.418802 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1060/2138] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:08:03.423301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fa30a-2f32-4c52-9d9b-2e424be84002 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:03.434620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fa30a-2f32-4c52-9d9b-2e424be84002 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:03.439276 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d0c9d-9ca1-4219-b5c6-e342432a4d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:03.440205 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d0c9d-9ca1-4219-b5c6-e342432a4d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:03.440496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d0c9d-9ca1-4219-b5c6-e342432a4d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:03.440777 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d0c9d-9ca1-4219-b5c6-e342432a4d50 admin admin] PATH_INFO: `/v3/projects/0fa1cd28ccbd46a2925b432e3ff62c3f/users/b6c7d188b2764872b2bd3245e1a7ab1a/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:03.455888 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d0c9d-9ca1-4219-b5c6-e342432a4d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa1cd28ccbd46a2925b432e3ff62c3f, user_id=b6c7d188b2764872b2bd3245e1a7ab1a, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:03.459236 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d0c9d-9ca1-4219-b5c6-e342432a4d50 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:03.461495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:03.473403 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1079/2139] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:08:03 2022] PUT /identity/v3/projects/0fa1cd28ccbd46a2925b432e3ff62c3f/users/b6c7d188b2764872b2bd3245e1a7ab1a/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:08:03.478458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acc7e5-89ff-4076-a841-c70990f6b554 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:03.478761 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acc7e5-89ff-4076-a841-c70990f6b554 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:03.479047 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acc7e5-89ff-4076-a841-c70990f6b554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:03.497308 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-93acc7e5-89ff-4076-a841-c70990f6b554 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:03.498538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-93acc7e5-89ff-4076-a841-c70990f6b554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:03.533429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:03.566851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1061/2140] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:03.579984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d0c9d-9ca1-4219-b5c6-e342432a4d50 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:03.605333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218609b4-8c06-4bed-95f3-89ebd2578b7f None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:03.605333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218609b4-8c06-4bed-95f3-89ebd2578b7f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:03.605621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218609b4-8c06-4bed-95f3-89ebd2578b7f None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:03.607251 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1062/2141] 10.222.0.41 () {54 vars in 921 bytes} [Mon May 30 12:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 12:08:03.640664 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d0c9d-9ca1-4219-b5c6-e342432a4d50 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:03.643672 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219d9f3-efef-43ba-9fe8-2e2e7c739e6b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:03.644087 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219d9f3-efef-43ba-9fe8-2e2e7c739e6b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:03.646100 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219d9f3-efef-43ba-9fe8-2e2e7c739e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:03.646516 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6818a-d141-4239-9e25-27448b45a5b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:03.647304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6818a-d141-4239-9e25-27448b45a5b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:03.648100 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6818a-d141-4239-9e25-27448b45a5b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:03.648100 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6818a-d141-4239-9e25-27448b45a5b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:03.658818 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6818a-d141-4239-9e25-27448b45a5b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:03.660992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6818a-d141-4239-9e25-27448b45a5b6 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:03.670030 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f219d9f3-efef-43ba-9fe8-2e2e7c739e6b None None] MFA Rules not processed for user `48b43eb1a0ac4db5adee3512453459aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:03.671734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f219d9f3-efef-43ba-9fe8-2e2e7c739e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:03.671900 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1080/2142] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:03.725275 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6818a-d141-4239-9e25-27448b45a5b6 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:03.727437 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-48b6818a-d141-4239-9e25-27448b45a5b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:03.742191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6818a-d141-4239-9e25-27448b45a5b6 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:03.747893 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755ee9d-cb2d-4c0e-97f0-e717b835c909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:03.748990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755ee9d-cb2d-4c0e-97f0-e717b835c909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:03.749315 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755ee9d-cb2d-4c0e-97f0-e717b835c909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:03.750132 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755ee9d-cb2d-4c0e-97f0-e717b835c909 admin admin] PATH_INFO: `/v3/users/ec4a4f7736964e5ca31d0ac8f63ffd19` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:03.751347 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755ee9d-cb2d-4c0e-97f0-e717b835c909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec4a4f7736964e5ca31d0ac8f63ffd19)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:03.753320 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755ee9d-cb2d-4c0e-97f0-e717b835c909 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:03.757777 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1063/2143] 10.222.0.41 () {58 vars in 1018 bytes} [Mon May 30 12:08:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:08:03.787079 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219d9f3-efef-43ba-9fe8-2e2e7c739e6b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:03.789472 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f219d9f3-efef-43ba-9fe8-2e2e7c739e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:03.804412 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219d9f3-efef-43ba-9fe8-2e2e7c739e6b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:03.810493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2d52a-a194-4233-a0c9-160d53908ea0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b43eb1a0ac4db5adee3512453459aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:03.811229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2d52a-a194-4233-a0c9-160d53908ea0 service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:03.812086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2d52a-a194-4233-a0c9-160d53908ea0 service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:03.812086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2d52a-a194-4233-a0c9-160d53908ea0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:03.812498 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1755ee9d-cb2d-4c0e-97f0-e717b835c909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec4a4f7736964e5ca31d0ac8f63ffd19'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:03.822749 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1755ee9d-cb2d-4c0e-97f0-e717b835c909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec4a4f7736964e5ca31d0ac8f63ffd19'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:03.824038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2d52a-a194-4233-a0c9-160d53908ea0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:03.825603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2d52a-a194-4233-a0c9-160d53908ea0 service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:03.838238 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1755ee9d-cb2d-4c0e-97f0-e717b835c909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec4a4f7736964e5ca31d0ac8f63ffd19'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:03.838899 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1755ee9d-cb2d-4c0e-97f0-e717b835c909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec4a4f7736964e5ca31d0ac8f63ffd19'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:03.840049 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1064/2144] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:08:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:08:03.852686 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1755ee9d-cb2d-4c0e-97f0-e717b835c909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec4a4f7736964e5ca31d0ac8f63ffd19'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:03.859098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1081/2145] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:08:03 2022] DELETE /identity/v3/users/ec4a4f7736964e5ca31d0ac8f63ffd19 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:08:04.187227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2d52a-a194-4233-a0c9-160d53908ea0 service placement] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:04.215231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2d52a-a194-4233-a0c9-160d53908ea0 service placement] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:04.298035 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16033374-9363-48e0-b316-c30251a45ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:04.300120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16033374-9363-48e0-b316-c30251a45ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:04.300677 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16033374-9363-48e0-b316-c30251a45ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:04.301029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16033374-9363-48e0-b316-c30251a45ada admin admin] PATH_INFO: `/v3/projects/2288722145134e6b9b93fb4075f0a291` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:04.302555 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16033374-9363-48e0-b316-c30251a45ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=2288722145134e6b9b93fb4075f0a291)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:04.305536 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16033374-9363-48e0-b316-c30251a45ada admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:04.375348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-16033374-9363-48e0-b316-c30251a45ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2288722145134e6b9b93fb4075f0a291', 'request_id': 'req-16033374-9363-48e0-b316-c30251a45ada'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:04.387880 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-16033374-9363-48e0-b316-c30251a45ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2288722145134e6b9b93fb4075f0a291', 'request_id': 'req-16033374-9363-48e0-b316-c30251a45ada'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:04.396302 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-16033374-9363-48e0-b316-c30251a45ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2288722145134e6b9b93fb4075f0a291', 'request_id': 'req-16033374-9363-48e0-b316-c30251a45ada'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:04.399578 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:04.414092 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70a53f-407b-407b-a00f-2acaa0c3ed88 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:04.414645 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70a53f-407b-407b-a00f-2acaa0c3ed88 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:04.414645 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70a53f-407b-407b-a00f-2acaa0c3ed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:04.425053 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-16033374-9363-48e0-b316-c30251a45ada admin admin] The token cache is being invalidate because project 2288722145134e6b9b93fb4075f0a291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:08:04.426648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-16033374-9363-48e0-b316-c30251a45ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:04.428801 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-16033374-9363-48e0-b316-c30251a45ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:04.430531 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1065/2146] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:08:04 2022] DELETE /identity/v3/projects/2288722145134e6b9b93fb4075f0a291 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:08:04.436170 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1b978-7191-4719-9450-5a117edc249f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:04.437404 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1b978-7191-4719-9450-5a117edc249f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:04.438203 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1b978-7191-4719-9450-5a117edc249f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:04.468945 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-7c70a53f-407b-407b-a00f-2acaa0c3ed88 None None] MFA Rules not processed for user `cb24ad08e2f44827ab39684760cfa5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:04.470297 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7c70a53f-407b-407b-a00f-2acaa0c3ed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:04.491245 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2cb1b978-7191-4719-9450-5a117edc249f None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:04.492502 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2cb1b978-7191-4719-9450-5a117edc249f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:04.583809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:04.591089 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1082/2147] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:08:04.595659 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70a53f-407b-407b-a00f-2acaa0c3ed88 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:04.597320 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1066/2148] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:08:04.600502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7c70a53f-407b-407b-a00f-2acaa0c3ed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:04.607633 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a3839-979e-4244-9399-7efd0f71bad9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:04.608673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a3839-979e-4244-9399-7efd0f71bad9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:04.609632 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a3839-979e-4244-9399-7efd0f71bad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:04.629191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70a53f-407b-407b-a00f-2acaa0c3ed88 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:04.634652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9fd5f-95e5-4935-8bae-a9c82a577dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:04.635333 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9fd5f-95e5-4935-8bae-a9c82a577dfd admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:04.635614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9fd5f-95e5-4935-8bae-a9c82a577dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:04.636075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9fd5f-95e5-4935-8bae-a9c82a577dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:04.636961 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9fd5f-95e5-4935-8bae-a9c82a577dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:04.638991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9fd5f-95e5-4935-8bae-a9c82a577dfd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:04.657277 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-159a3839-979e-4244-9399-7efd0f71bad9 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:04.661812 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-159a3839-979e-4244-9399-7efd0f71bad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:04.681406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1083/2149] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:08:04 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:08:04.681707 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1067/2150] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:04.683188 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9fd5f-95e5-4935-8bae-a9c82a577dfd admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:04.684323 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a3839-979e-4244-9399-7efd0f71bad9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:04.701614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a3839-979e-4244-9399-7efd0f71bad9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:04.772853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1de704-6329-4e32-a345-0f44e7e3ce2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:04.773976 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1de704-6329-4e32-a345-0f44e7e3ce2a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:04.773976 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1de704-6329-4e32-a345-0f44e7e3ce2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:04.774299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1de704-6329-4e32-a345-0f44e7e3ce2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:04.775114 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1de704-6329-4e32-a345-0f44e7e3ce2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:08:04.777652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1de704-6329-4e32-a345-0f44e7e3ce2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:04.779046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1de704-6329-4e32-a345-0f44e7e3ce2a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:04.785283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9fd5f-95e5-4935-8bae-a9c82a577dfd admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:04.791535 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1068/2151] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:08:04.792988 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ac01d-1b9d-4f24-826a-bd2e088ea1ac None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:04.793277 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ac01d-1b9d-4f24-826a-bd2e088ea1ac None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:04.793550 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ac01d-1b9d-4f24-826a-bd2e088ea1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:04.795193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b44ed6-d5ce-4f7a-9058-3cfdff5a0751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:04.796165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b44ed6-d5ce-4f7a-9058-3cfdff5a0751 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:04.796685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b44ed6-d5ce-4f7a-9058-3cfdff5a0751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:04.797122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b44ed6-d5ce-4f7a-9058-3cfdff5a0751 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:04.798072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b44ed6-d5ce-4f7a-9058-3cfdff5a0751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:04.800278 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b44ed6-d5ce-4f7a-9058-3cfdff5a0751 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:04.823342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-223ac01d-1b9d-4f24-826a-bd2e088ea1ac None None] MFA Rules not processed for user `b6c7d188b2764872b2bd3245e1a7ab1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:04.824635 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-223ac01d-1b9d-4f24-826a-bd2e088ea1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:04.828705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1084/2152] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:08:04 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:08:04.832779 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b44ed6-d5ce-4f7a-9058-3cfdff5a0751 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:04.843038 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b44ed6-d5ce-4f7a-9058-3cfdff5a0751 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:04.848391 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d8587-acc5-4083-a577-2ba991a7d2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:04.849052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d8587-acc5-4083-a577-2ba991a7d2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:04.849662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d8587-acc5-4083-a577-2ba991a7d2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:04.850107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d8587-acc5-4083-a577-2ba991a7d2f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:04.850818 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d8587-acc5-4083-a577-2ba991a7d2f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:04.852881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d8587-acc5-4083-a577-2ba991a7d2f0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:04.884163 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1085/2153] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:08:04 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:08:04.885091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d8587-acc5-4083-a577-2ba991a7d2f0 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:04.907539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1069/2154] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:04.908230 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ac01d-1b9d-4f24-826a-bd2e088ea1ac None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:04.921235 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ac01d-1b9d-4f24-826a-bd2e088ea1ac None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:04.926681 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:04.969609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d8587-acc5-4083-a577-2ba991a7d2f0 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:04.975154 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d425c-caec-4afc-a188-bf323214192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:04.975842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d425c-caec-4afc-a188-bf323214192c admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:04.976217 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d425c-caec-4afc-a188-bf323214192c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:04.976504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d425c-caec-4afc-a188-bf323214192c admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:04.977251 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d425c-caec-4afc-a188-bf323214192c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:04.978858 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d425c-caec-4afc-a188-bf323214192c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:04.988490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818a926-b706-452b-b31d-cb79b7f1d2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:04.989347 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818a926-b706-452b-b31d-cb79b7f1d2cf admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:04.989640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818a926-b706-452b-b31d-cb79b7f1d2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:04.989925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818a926-b706-452b-b31d-cb79b7f1d2cf admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:04.990480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1086/2155] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:08:04.990653 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818a926-b706-452b-b31d-cb79b7f1d2cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:04.991298 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d425c-caec-4afc-a188-bf323214192c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:04.992669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818a926-b706-452b-b31d-cb79b7f1d2cf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:04.993268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-001d425c-caec-4afc-a188-bf323214192c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:05.015511 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1070/2156] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:08:04 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:08:05.015511 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818a926-b706-452b-b31d-cb79b7f1d2cf admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:05.024123 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818a926-b706-452b-b31d-cb79b7f1d2cf admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:05.029515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533c076-00ef-4190-9046-9f6c7bf48b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:05.030504 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533c076-00ef-4190-9046-9f6c7bf48b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:05.030796 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533c076-00ef-4190-9046-9f6c7bf48b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:05.031071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533c076-00ef-4190-9046-9f6c7bf48b39 admin admin] PATH_INFO: `/v3/projects/00f91af361b64630a0e6ca092d116bf5/users/9996e60d2cfd448b8df19c5c2b49dcd7/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:05.040403 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:05.047027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533c076-00ef-4190-9046-9f6c7bf48b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f91af361b64630a0e6ca092d116bf5, user_id=9996e60d2cfd448b8df19c5c2b49dcd7, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:05.049738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533c076-00ef-4190-9046-9f6c7bf48b39 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:05.056217 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d425c-caec-4afc-a188-bf323214192c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:05.062603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1071/2157] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:08:05 2022] PUT /identity/v3/projects/00f91af361b64630a0e6ca092d116bf5/users/9996e60d2cfd448b8df19c5c2b49dcd7/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:08:05.063608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533c076-00ef-4190-9046-9f6c7bf48b39 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:05.110881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc266b79-6313-4351-a842-eddd0f857491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:05.111573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc266b79-6313-4351-a842-eddd0f857491 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:05.111903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc266b79-6313-4351-a842-eddd0f857491 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:05.112298 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc266b79-6313-4351-a842-eddd0f857491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:05.126107 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533c076-00ef-4190-9046-9f6c7bf48b39 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:05.131672 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c84135-acff-4fee-b8f6-b8bcab5f414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:05.132397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c84135-acff-4fee-b8f6-b8bcab5f414d admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:05.132747 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c84135-acff-4fee-b8f6-b8bcab5f414d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:05.133081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c84135-acff-4fee-b8f6-b8bcab5f414d admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:05.133811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c84135-acff-4fee-b8f6-b8bcab5f414d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:05.135420 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c84135-acff-4fee-b8f6-b8bcab5f414d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:05.146736 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1072/2158] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:08:05.147554 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c84135-acff-4fee-b8f6-b8bcab5f414d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:05.157287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c84135-acff-4fee-b8f6-b8bcab5f414d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:05.162039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb4366-82d7-4104-af27-a8ef30611424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:05.162692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb4366-82d7-4104-af27-a8ef30611424 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:05.162978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb4366-82d7-4104-af27-a8ef30611424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:05.163256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb4366-82d7-4104-af27-a8ef30611424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:05.164015 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb4366-82d7-4104-af27-a8ef30611424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:05.165659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb4366-82d7-4104-af27-a8ef30611424 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:05.173512 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc266b79-6313-4351-a842-eddd0f857491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:05.174977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc266b79-6313-4351-a842-eddd0f857491 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:05.175471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1073/2159] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:08:05.175471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb4366-82d7-4104-af27-a8ef30611424 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:05.184370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1087/2160] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:08:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:05.185158 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc266b79-6313-4351-a842-eddd0f857491 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:05.187396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb4366-82d7-4104-af27-a8ef30611424 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:05.193129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc9f65-eb25-4c0b-850c-2b863e5c5c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:05.193793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc9f65-eb25-4c0b-850c-2b863e5c5c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:05.194083 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc9f65-eb25-4c0b-850c-2b863e5c5c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:05.194364 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc9f65-eb25-4c0b-850c-2b863e5c5c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:05.195294 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc9f65-eb25-4c0b-850c-2b863e5c5c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:05.196929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc266b79-6313-4351-a842-eddd0f857491 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:05.197601 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc9f65-eb25-4c0b-850c-2b863e5c5c06 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:05.202054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1867394-44cf-42b7-9c75-a319fad04a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:05.202944 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1867394-44cf-42b7-9c75-a319fad04a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:05.203222 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1867394-44cf-42b7-9c75-a319fad04a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:05.203502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1867394-44cf-42b7-9c75-a319fad04a19 admin admin] PATH_INFO: `/v3/projects/00f91af361b64630a0e6ca092d116bf5/users/9996e60d2cfd448b8df19c5c2b49dcd7/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:05.205511 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1867394-44cf-42b7-9c75-a319fad04a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f91af361b64630a0e6ca092d116bf5, user_id=9996e60d2cfd448b8df19c5c2b49dcd7, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:05.209005 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1867394-44cf-42b7-9c75-a319fad04a19 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:05.209960 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1074/2161] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:08:05.214012 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc9f65-eb25-4c0b-850c-2b863e5c5c06 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:05.225352 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1088/2162] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:08:05 2022] PUT /identity/v3/projects/00f91af361b64630a0e6ca092d116bf5/users/9996e60d2cfd448b8df19c5c2b49dcd7/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:08:05.226203 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc9f65-eb25-4c0b-850c-2b863e5c5c06 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:05.281816 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:05.298775 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c112b9-536c-4db4-85f1-7040446cbd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:05.299676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c112b9-536c-4db4-85f1-7040446cbd53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:05.299985 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c112b9-536c-4db4-85f1-7040446cbd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:05.300537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c112b9-536c-4db4-85f1-7040446cbd53 admin admin] PATH_INFO: `/v3/projects/66312b3f3f73477cbe27defa317537a4/users/4e875190d9dc48edb929bb316d5e576e/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:05.318824 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c112b9-536c-4db4-85f1-7040446cbd53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66312b3f3f73477cbe27defa317537a4, user_id=4e875190d9dc48edb929bb316d5e576e, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:05.321750 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c112b9-536c-4db4-85f1-7040446cbd53 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:05.338361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1075/2163] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:08:05 2022] PUT /identity/v3/projects/66312b3f3f73477cbe27defa317537a4/users/4e875190d9dc48edb929bb316d5e576e/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:08:05.343942 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90b2b-2371-44a7-98fd-36ffe859f4b8 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:05.344328 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90b2b-2371-44a7-98fd-36ffe859f4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:05.344744 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90b2b-2371-44a7-98fd-36ffe859f4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:05.366547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-dda90b2b-2371-44a7-98fd-36ffe859f4b8 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:05.367787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dda90b2b-2371-44a7-98fd-36ffe859f4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:05.453175 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1089/2164] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:08:05.464142 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c112b9-536c-4db4-85f1-7040446cbd53 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:05.468172 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-75c112b9-536c-4db4-85f1-7040446cbd53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:05.546081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c112b9-536c-4db4-85f1-7040446cbd53 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:05.552443 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2e849-95f3-4b92-8033-a77cb25dc96d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:05.552904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2e849-95f3-4b92-8033-a77cb25dc96d service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:05.553371 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2e849-95f3-4b92-8033-a77cb25dc96d service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:05.553655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2e849-95f3-4b92-8033-a77cb25dc96d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:05.588405 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2e849-95f3-4b92-8033-a77cb25dc96d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:05.591403 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2e849-95f3-4b92-8033-a77cb25dc96d service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:05.603856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1076/2165] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:06.176641 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c63abd-c2eb-43ee-b46d-8a8ba38bb092 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:06.177363 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c63abd-c2eb-43ee-b46d-8a8ba38bb092 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:06.177750 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c63abd-c2eb-43ee-b46d-8a8ba38bb092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:06.205869 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-39c63abd-c2eb-43ee-b46d-8a8ba38bb092 None None] MFA Rules not processed for user `9996e60d2cfd448b8df19c5c2b49dcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:06.208630 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-39c63abd-c2eb-43ee-b46d-8a8ba38bb092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:06.238895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:06.295220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1090/2166] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:06 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:06.307120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2e849-95f3-4b92-8033-a77cb25dc96d service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:06.308624 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-81d2e849-95f3-4b92-8033-a77cb25dc96d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:06.374453 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2e849-95f3-4b92-8033-a77cb25dc96d service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:06.378943 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e5f7a-82fd-48d4-bdb8-1be44b844d0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:06.380051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e5f7a-82fd-48d4-bdb8-1be44b844d0f service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:06.380352 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e5f7a-82fd-48d4-bdb8-1be44b844d0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:06.380855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e5f7a-82fd-48d4-bdb8-1be44b844d0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:06.448629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e5f7a-82fd-48d4-bdb8-1be44b844d0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:06.450188 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e5f7a-82fd-48d4-bdb8-1be44b844d0f service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:06.460811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1077/2167] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:08:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:06.602499 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6fa89-237b-4ef1-b99c-be9750b1576b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:06.603053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6fa89-237b-4ef1-b99c-be9750b1576b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:06.603148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6fa89-237b-4ef1-b99c-be9750b1576b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:06.623250 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d8c6fa89-237b-4ef1-b99c-be9750b1576b None None] MFA Rules not processed for user `b6c7d188b2764872b2bd3245e1a7ab1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:06.624399 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d8c6fa89-237b-4ef1-b99c-be9750b1576b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:06.740231 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1091/2168] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:07.979360 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e5f7a-82fd-48d4-bdb8-1be44b844d0f service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:07.990074 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e5f7a-82fd-48d4-bdb8-1be44b844d0f service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:07.994929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f2342-efab-41fb-83ca-12085de14ba5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:07.996531 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f2342-efab-41fb-83ca-12085de14ba5 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:07.997013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f2342-efab-41fb-83ca-12085de14ba5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:07.997298 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f2342-efab-41fb-83ca-12085de14ba5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:08.008639 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f2342-efab-41fb-83ca-12085de14ba5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:08.010246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f2342-efab-41fb-83ca-12085de14ba5 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:08.028166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1078/2169] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:08:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:10.827268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e8f52-29a1-45e0-bba5-3cc4b408cf5b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:10.828257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e8f52-29a1-45e0-bba5-3cc4b408cf5b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:10.828512 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e8f52-29a1-45e0-bba5-3cc4b408cf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:10.859408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-234e8f52-29a1-45e0-bba5-3cc4b408cf5b None None] MFA Rules not processed for user `4e875190d9dc48edb929bb316d5e576e`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:10.860874 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-234e8f52-29a1-45e0-bba5-3cc4b408cf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:10.940008 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1092/2170] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:10.942448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce045444-445f-4912-ac72-7b04e8e426ed None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:10.942887 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce045444-445f-4912-ac72-7b04e8e426ed None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:10.943012 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce045444-445f-4912-ac72-7b04e8e426ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:10.961771 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ce045444-445f-4912-ac72-7b04e8e426ed None None] MFA Rules not processed for user `4e875190d9dc48edb929bb316d5e576e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:10.963030 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ce045444-445f-4912-ac72-7b04e8e426ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:10.983903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1079/2171] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:10.984881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e8f52-29a1-45e0-bba5-3cc4b408cf5b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:10.987145 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-234e8f52-29a1-45e0-bba5-3cc4b408cf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:11.052659 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:11.071037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e8f52-29a1-45e0-bba5-3cc4b408cf5b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:11.076636 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350d843-8619-4020-8010-b0c0ecb25949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:11.077282 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350d843-8619-4020-8010-b0c0ecb25949 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:11.077564 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350d843-8619-4020-8010-b0c0ecb25949 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:11.077841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350d843-8619-4020-8010-b0c0ecb25949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:11.085798 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350d843-8619-4020-8010-b0c0ecb25949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:11.087401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350d843-8619-4020-8010-b0c0ecb25949 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:11.096736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1093/2172] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:08:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:11.907565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dea4c-8ed7-42c9-b3ac-c3bca8e39180 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:11.907681 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dea4c-8ed7-42c9-b3ac-c3bca8e39180 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:11.908062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dea4c-8ed7-42c9-b3ac-c3bca8e39180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:11.928710 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ce8dea4c-8ed7-42c9-b3ac-c3bca8e39180 None None] MFA Rules not processed for user `4e875190d9dc48edb929bb316d5e576e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:11.929932 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ce8dea4c-8ed7-42c9-b3ac-c3bca8e39180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:11.938552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1080/2173] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:21.092286 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=8 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:21.922322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:23.593538 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fefd6-dbe9-4d06-99aa-35fabecb7168 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:23.594046 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fefd6-dbe9-4d06-99aa-35fabecb7168 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:23.594171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fefd6-dbe9-4d06-99aa-35fabecb7168 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:23.595546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1094/2174] 10.222.0.41 () {54 vars in 921 bytes} [Mon May 30 12:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:23.631205 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a3521-3e68-4824-a630-fb1c3dcd4042 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:23.631740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a3521-3e68-4824-a630-fb1c3dcd4042 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:23.632064 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a3521-3e68-4824-a630-fb1c3dcd4042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:23.651637 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-910a3521-3e68-4824-a630-fb1c3dcd4042 None None] MFA Rules not processed for user `48b43eb1a0ac4db5adee3512453459aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:23.653098 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-910a3521-3e68-4824-a630-fb1c3dcd4042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:23.748653 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1081/2175] 10.222.0.41 () {58 vars in 1018 bytes} [Mon May 30 12:08:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:23.760427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fefd6-dbe9-4d06-99aa-35fabecb7168 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:23.762325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-750fefd6-dbe9-4d06-99aa-35fabecb7168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:23.798990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fefd6-dbe9-4d06-99aa-35fabecb7168 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:23.805385 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89df298-e2ae-4acb-8bc7-17af195feaa6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b43eb1a0ac4db5adee3512453459aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:23.806042 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89df298-e2ae-4acb-8bc7-17af195feaa6 service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:23.806329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89df298-e2ae-4acb-8bc7-17af195feaa6 service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:23.806609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89df298-e2ae-4acb-8bc7-17af195feaa6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:23.821089 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89df298-e2ae-4acb-8bc7-17af195feaa6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:23.822714 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89df298-e2ae-4acb-8bc7-17af195feaa6 service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:23.833957 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1095/2176] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:08:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:24.928367 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a3521-3e68-4824-a630-fb1c3dcd4042 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:24.934563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a3521-3e68-4824-a630-fb1c3dcd4042 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:24.940140 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e552e-cc07-4b0f-86f4-97c9bce5d459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:24.942609 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e552e-cc07-4b0f-86f4-97c9bce5d459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:24.943113 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e552e-cc07-4b0f-86f4-97c9bce5d459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:24.943580 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e552e-cc07-4b0f-86f4-97c9bce5d459 admin admin] PATH_INFO: `/v3/users/cb24ad08e2f44827ab39684760cfa5a3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:24.945416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e552e-cc07-4b0f-86f4-97c9bce5d459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb24ad08e2f44827ab39684760cfa5a3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:24.948273 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e552e-cc07-4b0f-86f4-97c9bce5d459 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:25.026803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-502e552e-cc07-4b0f-86f4-97c9bce5d459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb24ad08e2f44827ab39684760cfa5a3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:25.037130 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-502e552e-cc07-4b0f-86f4-97c9bce5d459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb24ad08e2f44827ab39684760cfa5a3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:25.051882 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-502e552e-cc07-4b0f-86f4-97c9bce5d459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb24ad08e2f44827ab39684760cfa5a3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:25.052594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-502e552e-cc07-4b0f-86f4-97c9bce5d459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb24ad08e2f44827ab39684760cfa5a3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:25.053219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-502e552e-cc07-4b0f-86f4-97c9bce5d459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb24ad08e2f44827ab39684760cfa5a3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:25.070443 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1082/2177] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:08:24 2022] DELETE /identity/v3/users/cb24ad08e2f44827ab39684760cfa5a3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:08:25.355025 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89df298-e2ae-4acb-8bc7-17af195feaa6 service placement] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:25.366772 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89df298-e2ae-4acb-8bc7-17af195feaa6 service placement] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:25.428119 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1f889-a8a5-4ef0-b227-e73cfcf73db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:25.429019 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1f889-a8a5-4ef0-b227-e73cfcf73db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:25.429307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1f889-a8a5-4ef0-b227-e73cfcf73db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:25.429894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1f889-a8a5-4ef0-b227-e73cfcf73db0 admin admin] PATH_INFO: `/v3/projects/d2d36136795d4c428bb47e734b126017` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:25.430785 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1f889-a8a5-4ef0-b227-e73cfcf73db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d36136795d4c428bb47e734b126017)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:25.433200 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1f889-a8a5-4ef0-b227-e73cfcf73db0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:25.481695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b1c1f889-a8a5-4ef0-b227-e73cfcf73db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d36136795d4c428bb47e734b126017', 'request_id': 'req-b1c1f889-a8a5-4ef0-b227-e73cfcf73db0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:25.489169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b1c1f889-a8a5-4ef0-b227-e73cfcf73db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d36136795d4c428bb47e734b126017', 'request_id': 'req-b1c1f889-a8a5-4ef0-b227-e73cfcf73db0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:25.497553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b1c1f889-a8a5-4ef0-b227-e73cfcf73db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d36136795d4c428bb47e734b126017', 'request_id': 'req-b1c1f889-a8a5-4ef0-b227-e73cfcf73db0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:25.507904 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b1c1f889-a8a5-4ef0-b227-e73cfcf73db0 admin admin] The token cache is being invalidate because project d2d36136795d4c428bb47e734b126017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:08:25.508196 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b1c1f889-a8a5-4ef0-b227-e73cfcf73db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:25.508841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b1c1f889-a8a5-4ef0-b227-e73cfcf73db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:25.510374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1096/2178] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:08:25 2022] DELETE /identity/v3/projects/d2d36136795d4c428bb47e734b126017 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:08:25.514445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e552e-cc07-4b0f-86f4-97c9bce5d459 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:25.515876 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-502e552e-cc07-4b0f-86f4-97c9bce5d459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:25.528917 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e552e-cc07-4b0f-86f4-97c9bce5d459 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:25.589115 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6e5b7-a5e6-4231-8836-a77a9b9f7cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:25.589928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6e5b7-a5e6-4231-8836-a77a9b9f7cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:25.590209 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6e5b7-a5e6-4231-8836-a77a9b9f7cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:25.590483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6e5b7-a5e6-4231-8836-a77a9b9f7cd5 admin admin] PATH_INFO: `/v3/users/9996e60d2cfd448b8df19c5c2b49dcd7` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:25.591659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6e5b7-a5e6-4231-8836-a77a9b9f7cd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9996e60d2cfd448b8df19c5c2b49dcd7)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:25.593606 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6e5b7-a5e6-4231-8836-a77a9b9f7cd5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:25.604486 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:25.642094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9af6e5b7-a5e6-4231-8836-a77a9b9f7cd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9996e60d2cfd448b8df19c5c2b49dcd7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:25.650767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9af6e5b7-a5e6-4231-8836-a77a9b9f7cd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9996e60d2cfd448b8df19c5c2b49dcd7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:25.664799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9af6e5b7-a5e6-4231-8836-a77a9b9f7cd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9996e60d2cfd448b8df19c5c2b49dcd7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:25.665514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9af6e5b7-a5e6-4231-8836-a77a9b9f7cd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9996e60d2cfd448b8df19c5c2b49dcd7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:25.666124 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9af6e5b7-a5e6-4231-8836-a77a9b9f7cd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9996e60d2cfd448b8df19c5c2b49dcd7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:25.679782 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1083/2179] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:08:25 2022] DELETE /identity/v3/users/9996e60d2cfd448b8df19c5c2b49dcd7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:08:25.872236 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1f889-a8a5-4ef0-b227-e73cfcf73db0 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:25.873795 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b1c1f889-a8a5-4ef0-b227-e73cfcf73db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:25.893188 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1f889-a8a5-4ef0-b227-e73cfcf73db0 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:25.965928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5afee-52e7-4805-a15b-6401c3f0ea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:25.966848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5afee-52e7-4805-a15b-6401c3f0ea3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:25.967136 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5afee-52e7-4805-a15b-6401c3f0ea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:25.967451 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5afee-52e7-4805-a15b-6401c3f0ea3d admin admin] PATH_INFO: `/v3/projects/00f91af361b64630a0e6ca092d116bf5` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:25.968682 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5afee-52e7-4805-a15b-6401c3f0ea3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=00f91af361b64630a0e6ca092d116bf5)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:25.970798 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5afee-52e7-4805-a15b-6401c3f0ea3d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:26.001407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:26.041700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8cf5afee-52e7-4805-a15b-6401c3f0ea3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00f91af361b64630a0e6ca092d116bf5', 'request_id': 'req-8cf5afee-52e7-4805-a15b-6401c3f0ea3d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:26.049746 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8cf5afee-52e7-4805-a15b-6401c3f0ea3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00f91af361b64630a0e6ca092d116bf5', 'request_id': 'req-8cf5afee-52e7-4805-a15b-6401c3f0ea3d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:26.060647 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8cf5afee-52e7-4805-a15b-6401c3f0ea3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00f91af361b64630a0e6ca092d116bf5', 'request_id': 'req-8cf5afee-52e7-4805-a15b-6401c3f0ea3d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:26.075694 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8cf5afee-52e7-4805-a15b-6401c3f0ea3d admin admin] The token cache is being invalidate because project 00f91af361b64630a0e6ca092d116bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:08:26.076022 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8cf5afee-52e7-4805-a15b-6401c3f0ea3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:26.076741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8cf5afee-52e7-4805-a15b-6401c3f0ea3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:26.080774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1097/2180] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:08:25 2022] DELETE /identity/v3/projects/00f91af361b64630a0e6ca092d116bf5 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:08:26.089629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cd3ef-fa6e-4456-a502-1768d90f45e1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:26.090105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cd3ef-fa6e-4456-a502-1768d90f45e1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:26.090202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cd3ef-fa6e-4456-a502-1768d90f45e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:26.116967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-954cd3ef-fa6e-4456-a502-1768d90f45e1 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:26.118182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-954cd3ef-fa6e-4456-a502-1768d90f45e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:26.179911 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1084/2181] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:26.187793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac909d-1b44-4e34-b245-397d7583c61b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:26.188137 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac909d-1b44-4e34-b245-397d7583c61b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:26.188447 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac909d-1b44-4e34-b245-397d7583c61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:26.207637 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-48ac909d-1b44-4e34-b245-397d7583c61b None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:26.208876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-48ac909d-1b44-4e34-b245-397d7583c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:26.216756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1098/2182] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:08:26.220887 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cd3ef-fa6e-4456-a502-1768d90f45e1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:26.231045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cd3ef-fa6e-4456-a502-1768d90f45e1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:26.235906 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d8a15-1942-4932-9933-d01cb9ce9e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:26.236554 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d8a15-1942-4932-9933-d01cb9ce9e61 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:26.236840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d8a15-1942-4932-9933-d01cb9ce9e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:26.237116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d8a15-1942-4932-9933-d01cb9ce9e61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:26.238506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d8a15-1942-4932-9933-d01cb9ce9e61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:08:26.238812 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d8a15-1942-4932-9933-d01cb9ce9e61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:26.240449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d8a15-1942-4932-9933-d01cb9ce9e61 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:26.251878 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1085/2183] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:08:26.256136 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac909d-1b44-4e34-b245-397d7583c61b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:26.265120 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac909d-1b44-4e34-b245-397d7583c61b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:26.270245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5c4e8-9efe-49b6-9e4a-573e161a3a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:26.270904 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5c4e8-9efe-49b6-9e4a-573e161a3a5f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:26.271198 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5c4e8-9efe-49b6-9e4a-573e161a3a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:26.271537 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5c4e8-9efe-49b6-9e4a-573e161a3a5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:26.272290 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5c4e8-9efe-49b6-9e4a-573e161a3a5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:26.274235 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5c4e8-9efe-49b6-9e4a-573e161a3a5f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:26.301056 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1099/2184] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:08:26 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:08:26.304977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d8a15-1942-4932-9933-d01cb9ce9e61 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:26.314843 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d8a15-1942-4932-9933-d01cb9ce9e61 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:26.380875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c5c27-be5b-4d52-9b86-83bd7b012c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:26.381516 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c5c27-be5b-4d52-9b86-83bd7b012c8e admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:26.381811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c5c27-be5b-4d52-9b86-83bd7b012c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:26.382087 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c5c27-be5b-4d52-9b86-83bd7b012c8e admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:26.382790 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c5c27-be5b-4d52-9b86-83bd7b012c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:26.384771 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c5c27-be5b-4d52-9b86-83bd7b012c8e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:26.406900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1086/2185] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:08:26 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:08:26.412064 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5c4e8-9efe-49b6-9e4a-573e161a3a5f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:26.433649 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5c4e8-9efe-49b6-9e4a-573e161a3a5f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:26.442841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590db35-2106-472f-aa1e-d3a653768737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:26.443768 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590db35-2106-472f-aa1e-d3a653768737 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:26.444250 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590db35-2106-472f-aa1e-d3a653768737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:26.448183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590db35-2106-472f-aa1e-d3a653768737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:26.448984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590db35-2106-472f-aa1e-d3a653768737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:26.450609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590db35-2106-472f-aa1e-d3a653768737 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:26.467241 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1100/2186] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:08:26.467889 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c5c27-be5b-4d52-9b86-83bd7b012c8e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:26.478263 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:26.484131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c5c27-be5b-4d52-9b86-83bd7b012c8e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:26.494507 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c69ee0-56e7-4090-a628-1b6819135027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:26.496775 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c69ee0-56e7-4090-a628-1b6819135027 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:26.498605 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c69ee0-56e7-4090-a628-1b6819135027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:26.498993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c69ee0-56e7-4090-a628-1b6819135027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:26.499974 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c69ee0-56e7-4090-a628-1b6819135027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:26.503409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c69ee0-56e7-4090-a628-1b6819135027 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:26.527869 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1087/2187] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:08:26.531701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590db35-2106-472f-aa1e-d3a653768737 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:26.550191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590db35-2106-472f-aa1e-d3a653768737 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:26.558289 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f511840-bb2b-44f6-820d-3646d3eff0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:26.559204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f511840-bb2b-44f6-820d-3646d3eff0a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:26.559496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f511840-bb2b-44f6-820d-3646d3eff0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:26.560394 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f511840-bb2b-44f6-820d-3646d3eff0a5 admin admin] PATH_INFO: `/v3/projects/c8d4cdfc934b4055a80654e7425defb4/users/397136bc720a48f4b4000442b753c423/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:26.577793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f511840-bb2b-44f6-820d-3646d3eff0a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d4cdfc934b4055a80654e7425defb4, user_id=397136bc720a48f4b4000442b753c423, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:26.580509 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f511840-bb2b-44f6-820d-3646d3eff0a5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:26.600810 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1101/2188] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:08:26 2022] PUT /identity/v3/projects/c8d4cdfc934b4055a80654e7425defb4/users/397136bc720a48f4b4000442b753c423/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:08:26.612623 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9ccd3-8ade-42b6-9a87-f02d2466fb0a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:26.612947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9ccd3-8ade-42b6-9a87-f02d2466fb0a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:26.613335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9ccd3-8ade-42b6-9a87-f02d2466fb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:26.649299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-78b9ccd3-8ade-42b6-9a87-f02d2466fb0a None None] MFA Rules not processed for user `397136bc720a48f4b4000442b753c423`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:26.650702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-78b9ccd3-8ade-42b6-9a87-f02d2466fb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:26.723554 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1088/2189] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:08:26.734775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f511840-bb2b-44f6-820d-3646d3eff0a5 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:26.736559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1f511840-bb2b-44f6-820d-3646d3eff0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:26.810897 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f511840-bb2b-44f6-820d-3646d3eff0a5 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:26.816876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b2096-3d25-47c7-b59c-a855b50db8ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:26.816876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b2096-3d25-47c7-b59c-a855b50db8ed service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:26.816876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b2096-3d25-47c7-b59c-a855b50db8ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:26.816876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b2096-3d25-47c7-b59c-a855b50db8ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:26.825824 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b2096-3d25-47c7-b59c-a855b50db8ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:26.827250 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b2096-3d25-47c7-b59c-a855b50db8ed service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:26.837215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1102/2190] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:08:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:35.741328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e886d3-7ab5-4724-9752-9df6226955d2 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:35.741955 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e886d3-7ab5-4724-9752-9df6226955d2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:35.741955 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e886d3-7ab5-4724-9752-9df6226955d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:35.759865 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-28e886d3-7ab5-4724-9752-9df6226955d2 None None] MFA Rules not processed for user `b6c7d188b2764872b2bd3245e1a7ab1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:35.761091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-28e886d3-7ab5-4724-9752-9df6226955d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:35.854315 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1089/2191] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:36.384673 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b2096-3d25-47c7-b59c-a855b50db8ed service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:36.440484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:36.457152 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b2096-3d25-47c7-b59c-a855b50db8ed service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:36.464641 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd609f8b-f374-4ea2-9f13-fb9f9e032b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:36.465877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd609f8b-f374-4ea2-9f13-fb9f9e032b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:36.466381 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd609f8b-f374-4ea2-9f13-fb9f9e032b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:36.466757 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd609f8b-f374-4ea2-9f13-fb9f9e032b87 admin admin] PATH_INFO: `/v3/users/397136bc720a48f4b4000442b753c423` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:36.468449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd609f8b-f374-4ea2-9f13-fb9f9e032b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=397136bc720a48f4b4000442b753c423)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:36.470668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd609f8b-f374-4ea2-9f13-fb9f9e032b87 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:36.526832 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fd609f8b-f374-4ea2-9f13-fb9f9e032b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '397136bc720a48f4b4000442b753c423'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:36.533991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fd609f8b-f374-4ea2-9f13-fb9f9e032b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '397136bc720a48f4b4000442b753c423'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:36.548642 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fd609f8b-f374-4ea2-9f13-fb9f9e032b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '397136bc720a48f4b4000442b753c423'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:36.549530 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fd609f8b-f374-4ea2-9f13-fb9f9e032b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '397136bc720a48f4b4000442b753c423'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:36.557400 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fd609f8b-f374-4ea2-9f13-fb9f9e032b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '397136bc720a48f4b4000442b753c423'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:36.563688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1103/2192] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:08:36 2022] DELETE /identity/v3/users/397136bc720a48f4b4000442b753c423 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:08:36.568323 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c68404-02a1-4ea6-adca-2587340b47b8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:36.568690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c68404-02a1-4ea6-adca-2587340b47b8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:36.569042 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c68404-02a1-4ea6-adca-2587340b47b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:36.587989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-22c68404-02a1-4ea6-adca-2587340b47b8 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:36.589450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-22c68404-02a1-4ea6-adca-2587340b47b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:36.655592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1090/2193] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:36.666935 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd609f8b-f374-4ea2-9f13-fb9f9e032b87 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:36.668913 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-fd609f8b-f374-4ea2-9f13-fb9f9e032b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:36.733147 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd609f8b-f374-4ea2-9f13-fb9f9e032b87 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:36.736763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03268820-02b7-4451-8cd3-8fe837ededb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:36.737408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03268820-02b7-4451-8cd3-8fe837ededb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:36.737689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03268820-02b7-4451-8cd3-8fe837ededb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:36.737967 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03268820-02b7-4451-8cd3-8fe837ededb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:36.748754 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03268820-02b7-4451-8cd3-8fe837ededb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:36.750587 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03268820-02b7-4451-8cd3-8fe837ededb5 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:36.763246 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1104/2194] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:37.093353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c68404-02a1-4ea6-adca-2587340b47b8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:37.094889 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-22c68404-02a1-4ea6-adca-2587340b47b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:37.110156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c68404-02a1-4ea6-adca-2587340b47b8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:37.116426 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e13f0d-4323-4ff3-9241-f2acd6adac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:37.117539 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e13f0d-4323-4ff3-9241-f2acd6adac07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:37.117899 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e13f0d-4323-4ff3-9241-f2acd6adac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:37.118183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e13f0d-4323-4ff3-9241-f2acd6adac07 admin admin] PATH_INFO: `/v3/projects/c8d4cdfc934b4055a80654e7425defb4` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:37.119612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e13f0d-4323-4ff3-9241-f2acd6adac07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d4cdfc934b4055a80654e7425defb4)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:37.121923 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e13f0d-4323-4ff3-9241-f2acd6adac07 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:37.149391 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:37.174546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-91e13f0d-4323-4ff3-9241-f2acd6adac07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d4cdfc934b4055a80654e7425defb4', 'request_id': 'req-91e13f0d-4323-4ff3-9241-f2acd6adac07'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:37.182794 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-91e13f0d-4323-4ff3-9241-f2acd6adac07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d4cdfc934b4055a80654e7425defb4', 'request_id': 'req-91e13f0d-4323-4ff3-9241-f2acd6adac07'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:37.189350 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-91e13f0d-4323-4ff3-9241-f2acd6adac07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d4cdfc934b4055a80654e7425defb4', 'request_id': 'req-91e13f0d-4323-4ff3-9241-f2acd6adac07'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:37.200315 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-91e13f0d-4323-4ff3-9241-f2acd6adac07 admin admin] The token cache is being invalidate because project c8d4cdfc934b4055a80654e7425defb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:08:37.200605 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-91e13f0d-4323-4ff3-9241-f2acd6adac07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:37.201242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-91e13f0d-4323-4ff3-9241-f2acd6adac07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:37.202766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1091/2195] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:08:37 2022] DELETE /identity/v3/projects/c8d4cdfc934b4055a80654e7425defb4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:08:37.208107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a1dd2-8d54-42a9-9158-6757159f175a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:37.208402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a1dd2-8d54-42a9-9158-6757159f175a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:37.208681 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a1dd2-8d54-42a9-9158-6757159f175a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:37.226574 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d40a1dd2-8d54-42a9-9158-6757159f175a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:37.227769 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d40a1dd2-8d54-42a9-9158-6757159f175a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:37.289440 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1105/2196] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:08:37.297369 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581a4d8-6c0c-4b4c-9abc-152d95b1bf75 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:37.297659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581a4d8-6c0c-4b4c-9abc-152d95b1bf75 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:37.297967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581a4d8-6c0c-4b4c-9abc-152d95b1bf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:37.318733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f581a4d8-6c0c-4b4c-9abc-152d95b1bf75 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:37.320078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f581a4d8-6c0c-4b4c-9abc-152d95b1bf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:37.328855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1092/2197] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:08:37.335489 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a1dd2-8d54-42a9-9158-6757159f175a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:37.345515 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a1dd2-8d54-42a9-9158-6757159f175a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:37.350269 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb9fd7-0fdd-4e6d-a070-2287bae15230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:37.350929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb9fd7-0fdd-4e6d-a070-2287bae15230 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:37.351215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb9fd7-0fdd-4e6d-a070-2287bae15230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:37.351504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb9fd7-0fdd-4e6d-a070-2287bae15230 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:37.352258 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb9fd7-0fdd-4e6d-a070-2287bae15230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:08:37.352569 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb9fd7-0fdd-4e6d-a070-2287bae15230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:37.354162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb9fd7-0fdd-4e6d-a070-2287bae15230 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:37.356647 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:37.368815 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1106/2198] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:08:37.372926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581a4d8-6c0c-4b4c-9abc-152d95b1bf75 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:37.383154 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581a4d8-6c0c-4b4c-9abc-152d95b1bf75 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:37.388240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ca444-0bb0-423d-8112-5d507466f850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:37.388910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ca444-0bb0-423d-8112-5d507466f850 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:37.389198 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ca444-0bb0-423d-8112-5d507466f850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:37.389477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ca444-0bb0-423d-8112-5d507466f850 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:37.390194 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ca444-0bb0-423d-8112-5d507466f850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:37.392155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ca444-0bb0-423d-8112-5d507466f850 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:37.422480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1093/2199] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:08:37 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:08:37.426768 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb9fd7-0fdd-4e6d-a070-2287bae15230 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:37.437871 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb9fd7-0fdd-4e6d-a070-2287bae15230 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:37.496718 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ea124-bad1-453b-91ea-730205ff8ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:37.497397 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ea124-bad1-453b-91ea-730205ff8ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:37.497703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ea124-bad1-453b-91ea-730205ff8ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:37.497967 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ea124-bad1-453b-91ea-730205ff8ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:37.498697 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ea124-bad1-453b-91ea-730205ff8ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:37.500656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ea124-bad1-453b-91ea-730205ff8ae0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:37.523399 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1107/2200] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:08:37 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:08:37.528978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ca444-0bb0-423d-8112-5d507466f850 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:37.540328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ca444-0bb0-423d-8112-5d507466f850 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:37.546477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83915c-e984-426d-9590-f6a5adf1eeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:37.547219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83915c-e984-426d-9590-f6a5adf1eeac admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:37.547541 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83915c-e984-426d-9590-f6a5adf1eeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:37.547894 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83915c-e984-426d-9590-f6a5adf1eeac admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:37.548862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83915c-e984-426d-9590-f6a5adf1eeac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:37.550705 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83915c-e984-426d-9590-f6a5adf1eeac admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:37.562610 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1094/2201] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:08:37.567423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ea124-bad1-453b-91ea-730205ff8ae0 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:37.581266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ea124-bad1-453b-91ea-730205ff8ae0 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:37.586649 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff199857-6f2e-44e9-94c3-1919b6a88b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:37.587438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff199857-6f2e-44e9-94c3-1919b6a88b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:37.587881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff199857-6f2e-44e9-94c3-1919b6a88b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:37.588169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff199857-6f2e-44e9-94c3-1919b6a88b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:37.589547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff199857-6f2e-44e9-94c3-1919b6a88b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:37.591181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff199857-6f2e-44e9-94c3-1919b6a88b80 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:37.605985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1108/2202] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:08:37.607411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83915c-e984-426d-9590-f6a5adf1eeac admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:37.618796 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83915c-e984-426d-9590-f6a5adf1eeac admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:37.623415 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7094ab3-b71a-42d1-b17b-d63f21e2764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:37.624370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7094ab3-b71a-42d1-b17b-d63f21e2764e admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:37.624655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7094ab3-b71a-42d1-b17b-d63f21e2764e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:37.624927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7094ab3-b71a-42d1-b17b-d63f21e2764e admin admin] PATH_INFO: `/v3/projects/d22b1bc83bba4f8e9deafc253449e8ab/users/c6451c3ad6dc4a7b82b25dbfbd100965/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:37.641403 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7094ab3-b71a-42d1-b17b-d63f21e2764e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22b1bc83bba4f8e9deafc253449e8ab, user_id=c6451c3ad6dc4a7b82b25dbfbd100965, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:37.643731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7094ab3-b71a-42d1-b17b-d63f21e2764e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:37.658668 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1095/2203] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:08:37 2022] PUT /identity/v3/projects/d22b1bc83bba4f8e9deafc253449e8ab/users/c6451c3ad6dc4a7b82b25dbfbd100965/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:08:37.670876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06e8a1-7d62-485e-a0f5-1f7d89cfc7c5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:37.671171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06e8a1-7d62-485e-a0f5-1f7d89cfc7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:37.671447 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06e8a1-7d62-485e-a0f5-1f7d89cfc7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:37.699668 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8a06e8a1-7d62-485e-a0f5-1f7d89cfc7c5 None None] MFA Rules not processed for user `c6451c3ad6dc4a7b82b25dbfbd100965`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:37.700983 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8a06e8a1-7d62-485e-a0f5-1f7d89cfc7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:37.765242 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1109/2204] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:37.776885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7094ab3-b71a-42d1-b17b-d63f21e2764e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:37.778630 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a7094ab3-b71a-42d1-b17b-d63f21e2764e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:37.836932 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7094ab3-b71a-42d1-b17b-d63f21e2764e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:37.840561 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c131001-8d58-4840-a905-6c13feac5cb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:37.841219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c131001-8d58-4840-a905-6c13feac5cb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:37.841503 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c131001-8d58-4840-a905-6c13feac5cb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:37.841780 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c131001-8d58-4840-a905-6c13feac5cb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:37.851679 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c131001-8d58-4840-a905-6c13feac5cb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:37.853186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c131001-8d58-4840-a905-6c13feac5cb5 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:37.862814 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1096/2205] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:08:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:08:39.330774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45375490-4661-4438-9c67-b6ea9fe63429 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:39.331330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45375490-4661-4438-9c67-b6ea9fe63429 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:39.331330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45375490-4661-4438-9c67-b6ea9fe63429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:39.350096 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-45375490-4661-4438-9c67-b6ea9fe63429 None None] MFA Rules not processed for user `c6451c3ad6dc4a7b82b25dbfbd100965`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:39.351419 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-45375490-4661-4438-9c67-b6ea9fe63429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:39.360173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1110/2206] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:46.908912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72f289-d1cf-4c7f-bad0-47ad9609d156 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:46.909547 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72f289-d1cf-4c7f-bad0-47ad9609d156 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:46.909547 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72f289-d1cf-4c7f-bad0-47ad9609d156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:46.937932 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6e72f289-d1cf-4c7f-bad0-47ad9609d156 None None] MFA Rules not processed for user `e12d075bc9144a5e8de3fe53004e9052`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:46.939384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6e72f289-d1cf-4c7f-bad0-47ad9609d156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:46.980770 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:47.019996 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1097/2207] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:49.344087 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=71,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:49.805250 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45375490-4661-4438-9c67-b6ea9fe63429 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:49.808235 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-45375490-4661-4438-9c67-b6ea9fe63429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:49.993670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45375490-4661-4438-9c67-b6ea9fe63429 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:49.998476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044bfdd-431c-4ddb-955a-83f0367a6566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:49.999250 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044bfdd-431c-4ddb-955a-83f0367a6566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:49.999536 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044bfdd-431c-4ddb-955a-83f0367a6566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:49.999834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044bfdd-431c-4ddb-955a-83f0367a6566 admin admin] PATH_INFO: `/v3/users/c1b80e22dd284251ae75ed38ffdd2fa1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:50.001072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044bfdd-431c-4ddb-955a-83f0367a6566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b80e22dd284251ae75ed38ffdd2fa1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:50.002991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044bfdd-431c-4ddb-955a-83f0367a6566 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:50.047540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d044bfdd-431c-4ddb-955a-83f0367a6566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b80e22dd284251ae75ed38ffdd2fa1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:50.056667 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d044bfdd-431c-4ddb-955a-83f0367a6566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b80e22dd284251ae75ed38ffdd2fa1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:50.068445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d044bfdd-431c-4ddb-955a-83f0367a6566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b80e22dd284251ae75ed38ffdd2fa1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:50.069076 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d044bfdd-431c-4ddb-955a-83f0367a6566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b80e22dd284251ae75ed38ffdd2fa1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:50.076087 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d044bfdd-431c-4ddb-955a-83f0367a6566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b80e22dd284251ae75ed38ffdd2fa1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:50.082285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1111/2208] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:08:49 2022] DELETE /identity/v3/users/c1b80e22dd284251ae75ed38ffdd2fa1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:08:50.086755 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa26c7-3a51-4616-a789-9e6fbabc6dd1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:50.087229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa26c7-3a51-4616-a789-9e6fbabc6dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:50.087331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa26c7-3a51-4616-a789-9e6fbabc6dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:50.115001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5faa26c7-3a51-4616-a789-9e6fbabc6dd1 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:50.116234 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5faa26c7-3a51-4616-a789-9e6fbabc6dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:50.173580 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1098/2209] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:50.183661 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044bfdd-431c-4ddb-955a-83f0367a6566 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:50.185096 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d044bfdd-431c-4ddb-955a-83f0367a6566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:50.209855 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:50.287522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044bfdd-431c-4ddb-955a-83f0367a6566 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:50.291260 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213ef82-e627-4e90-a203-a16de78e4e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:50.291977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213ef82-e627-4e90-a203-a16de78e4e15 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:50.292269 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213ef82-e627-4e90-a203-a16de78e4e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:50.292552 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213ef82-e627-4e90-a203-a16de78e4e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:50.303226 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213ef82-e627-4e90-a203-a16de78e4e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:50.304741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213ef82-e627-4e90-a203-a16de78e4e15 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:50.315041 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1112/2210] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:08:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:50.575776 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa26c7-3a51-4616-a789-9e6fbabc6dd1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:50.577288 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5faa26c7-3a51-4616-a789-9e6fbabc6dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:50.591284 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa26c7-3a51-4616-a789-9e6fbabc6dd1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:50.595869 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f36e7-b3fe-4339-91fc-d55a47931b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:50.596749 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f36e7-b3fe-4339-91fc-d55a47931b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:50.597747 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f36e7-b3fe-4339-91fc-d55a47931b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:50.598136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f36e7-b3fe-4339-91fc-d55a47931b6a admin admin] PATH_INFO: `/v3/projects/4f305c94f39042c9b796114c70e59194` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:50.599363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f36e7-b3fe-4339-91fc-d55a47931b6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f305c94f39042c9b796114c70e59194)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:50.601309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f36e7-b3fe-4339-91fc-d55a47931b6a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:50.649977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2e5f36e7-b3fe-4339-91fc-d55a47931b6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f305c94f39042c9b796114c70e59194', 'request_id': 'req-2e5f36e7-b3fe-4339-91fc-d55a47931b6a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:50.657465 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2e5f36e7-b3fe-4339-91fc-d55a47931b6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f305c94f39042c9b796114c70e59194', 'request_id': 'req-2e5f36e7-b3fe-4339-91fc-d55a47931b6a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:50.664534 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2e5f36e7-b3fe-4339-91fc-d55a47931b6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f305c94f39042c9b796114c70e59194', 'request_id': 'req-2e5f36e7-b3fe-4339-91fc-d55a47931b6a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:50.675146 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2e5f36e7-b3fe-4339-91fc-d55a47931b6a admin admin] The token cache is being invalidate because project 4f305c94f39042c9b796114c70e59194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:08:50.675541 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2e5f36e7-b3fe-4339-91fc-d55a47931b6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:50.676413 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2e5f36e7-b3fe-4339-91fc-d55a47931b6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:08:50.678016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1099/2211] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:08:50 2022] DELETE /identity/v3/projects/4f305c94f39042c9b796114c70e59194 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:08:50.683280 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9f1c2-ba42-4802-84a0-ea9220add3f5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:50.683764 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9f1c2-ba42-4802-84a0-ea9220add3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:50.683880 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9f1c2-ba42-4802-84a0-ea9220add3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:50.725473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a7c9f1c2-ba42-4802-84a0-ea9220add3f5 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:50.726699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a7c9f1c2-ba42-4802-84a0-ea9220add3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:50.808421 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1113/2212] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:50.816854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc126b9f-ab7b-4db8-9932-1a92b25b67f9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:50.817152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc126b9f-ab7b-4db8-9932-1a92b25b67f9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:50.817439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc126b9f-ab7b-4db8-9932-1a92b25b67f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:50.836656 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-fc126b9f-ab7b-4db8-9932-1a92b25b67f9 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:50.837903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fc126b9f-ab7b-4db8-9932-1a92b25b67f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:50.846237 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1100/2213] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:50.850702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9f1c2-ba42-4802-84a0-ea9220add3f5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:50.862807 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9f1c2-ba42-4802-84a0-ea9220add3f5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:50.867994 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf277b5d-62d7-46d7-ac38-72c00f5bbbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:50.868696 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf277b5d-62d7-46d7-ac38-72c00f5bbbdd admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:50.868991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf277b5d-62d7-46d7-ac38-72c00f5bbbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:50.869319 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf277b5d-62d7-46d7-ac38-72c00f5bbbdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:50.870067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf277b5d-62d7-46d7-ac38-72c00f5bbbdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:08:50.870504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf277b5d-62d7-46d7-ac38-72c00f5bbbdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:50.872048 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf277b5d-62d7-46d7-ac38-72c00f5bbbdd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:50.896275 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1114/2214] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:08:50.900429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc126b9f-ab7b-4db8-9932-1a92b25b67f9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:50.909628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc126b9f-ab7b-4db8-9932-1a92b25b67f9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:50.914280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30867f21-349b-4595-9c12-5ff70aac13e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:50.914936 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30867f21-349b-4595-9c12-5ff70aac13e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:50.915220 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30867f21-349b-4595-9c12-5ff70aac13e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:50.915495 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30867f21-349b-4595-9c12-5ff70aac13e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:50.916228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30867f21-349b-4595-9c12-5ff70aac13e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:50.918133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30867f21-349b-4595-9c12-5ff70aac13e7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:50.950398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1101/2215] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:08:50 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:08:50.951658 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf277b5d-62d7-46d7-ac38-72c00f5bbbdd admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:50.963003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf277b5d-62d7-46d7-ac38-72c00f5bbbdd admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:51.041998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:51.051729 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce646dc2-5f7e-43ae-9601-dca9ef0e9459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:51.053075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646dc2-5f7e-43ae-9601-dca9ef0e9459 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:51.053737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646dc2-5f7e-43ae-9601-dca9ef0e9459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:51.054393 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646dc2-5f7e-43ae-9601-dca9ef0e9459 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:51.055209 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce646dc2-5f7e-43ae-9601-dca9ef0e9459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:51.057523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce646dc2-5f7e-43ae-9601-dca9ef0e9459 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:51.085186 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1115/2216] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:08:50 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:08:51.086585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30867f21-349b-4595-9c12-5ff70aac13e7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:51.097321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30867f21-349b-4595-9c12-5ff70aac13e7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:51.102593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee0f53-d30f-4458-af12-3c8b4531411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:51.103470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee0f53-d30f-4458-af12-3c8b4531411b admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:51.103866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee0f53-d30f-4458-af12-3c8b4531411b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:51.104157 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee0f53-d30f-4458-af12-3c8b4531411b admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:51.104937 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee0f53-d30f-4458-af12-3c8b4531411b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:51.106604 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee0f53-d30f-4458-af12-3c8b4531411b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:51.119499 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1102/2217] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:08:51.122844 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce646dc2-5f7e-43ae-9601-dca9ef0e9459 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:51.133599 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce646dc2-5f7e-43ae-9601-dca9ef0e9459 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:51.138469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11539c-9971-41e4-8e33-91a1f5c5a71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:51.139130 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11539c-9971-41e4-8e33-91a1f5c5a71d admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:51.139448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11539c-9971-41e4-8e33-91a1f5c5a71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:51.139730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11539c-9971-41e4-8e33-91a1f5c5a71d admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:51.140500 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11539c-9971-41e4-8e33-91a1f5c5a71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:51.142095 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11539c-9971-41e4-8e33-91a1f5c5a71d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:51.153224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1116/2218] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:08:51.157401 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee0f53-d30f-4458-af12-3c8b4531411b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:51.167808 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee0f53-d30f-4458-af12-3c8b4531411b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:51.172523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5611ab0-ed14-48d0-91cd-e7096383cb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:51.173409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5611ab0-ed14-48d0-91cd-e7096383cb39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:51.173694 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5611ab0-ed14-48d0-91cd-e7096383cb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:51.173980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5611ab0-ed14-48d0-91cd-e7096383cb39 admin admin] PATH_INFO: `/v3/projects/4249e846c5d54876a6ed97678450c1d2/users/f7e7ce32b4c0457196c8765d6c5ada7e/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:51.177453 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:51.193743 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5611ab0-ed14-48d0-91cd-e7096383cb39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4249e846c5d54876a6ed97678450c1d2, user_id=f7e7ce32b4c0457196c8765d6c5ada7e, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:51.196631 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5611ab0-ed14-48d0-91cd-e7096383cb39 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:51.209629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1103/2219] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:08:51 2022] PUT /identity/v3/projects/4249e846c5d54876a6ed97678450c1d2/users/f7e7ce32b4c0457196c8765d6c5ada7e/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:08:51.214534 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6adf76-afe5-4dd0-94ce-49e067360e54 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:51.214834 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6adf76-afe5-4dd0-94ce-49e067360e54 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:51.215121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6adf76-afe5-4dd0-94ce-49e067360e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:51.233770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-aa6adf76-afe5-4dd0-94ce-49e067360e54 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:51.234984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-aa6adf76-afe5-4dd0-94ce-49e067360e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:51.294722 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1117/2220] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:51.304653 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5611ab0-ed14-48d0-91cd-e7096383cb39 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:51.306383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b5611ab0-ed14-48d0-91cd-e7096383cb39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:51.373604 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5611ab0-ed14-48d0-91cd-e7096383cb39 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:51.377206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30fe7c-2281-4840-8738-c196f52aa4a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:51.377933 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30fe7c-2281-4840-8738-c196f52aa4a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:51.379542 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30fe7c-2281-4840-8738-c196f52aa4a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:51.379860 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30fe7c-2281-4840-8738-c196f52aa4a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:51.389333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30fe7c-2281-4840-8738-c196f52aa4a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:51.390834 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30fe7c-2281-4840-8738-c196f52aa4a3 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:51.401463 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1104/2221] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:08:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:57.976757 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7b119-e5da-4199-b361-e7c5d5197eaf None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:57.977287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7b119-e5da-4199-b361-e7c5d5197eaf None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:57.977381 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7b119-e5da-4199-b361-e7c5d5197eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:58.013786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6be7b119-e5da-4199-b361-e7c5d5197eaf None None] MFA Rules not processed for user `f7e7ce32b4c0457196c8765d6c5ada7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:58.015582 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6be7b119-e5da-4199-b361-e7c5d5197eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:58.115680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1118/2222] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:08:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:58.116934 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30fe7c-2281-4840-8738-c196f52aa4a3 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:58.129288 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30fe7c-2281-4840-8738-c196f52aa4a3 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:58.135029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ce26a-75ee-448e-b431-eac63896bfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:58.136033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ce26a-75ee-448e-b431-eac63896bfdb admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:58.136468 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ce26a-75ee-448e-b431-eac63896bfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:58.137009 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ce26a-75ee-448e-b431-eac63896bfdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:58.137904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ce26a-75ee-448e-b431-eac63896bfdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:58.139993 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ce26a-75ee-448e-b431-eac63896bfdb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:58.190442 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1105/2223] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:08:58 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:08:58.191548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7b119-e5da-4199-b361-e7c5d5197eaf None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:58.207132 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7b119-e5da-4199-b361-e7c5d5197eaf None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:58.294367 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d9dc8-c747-4ad0-8bfc-8e351c0534bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:58.295060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d9dc8-c747-4ad0-8bfc-8e351c0534bd admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:58.295347 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d9dc8-c747-4ad0-8bfc-8e351c0534bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:58.295626 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d9dc8-c747-4ad0-8bfc-8e351c0534bd admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:58.296630 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d9dc8-c747-4ad0-8bfc-8e351c0534bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:58.298577 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d9dc8-c747-4ad0-8bfc-8e351c0534bd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:58.310718 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:58.333103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1119/2224] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:08:58 2022] POST /identity/v3/users => generated 296 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:08:58.334713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ce26a-75ee-448e-b431-eac63896bfdb admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:58.345701 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ce26a-75ee-448e-b431-eac63896bfdb admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:58.351471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72579c-0d1f-4ab3-a1c5-9c014cc128c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:58.352330 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72579c-0d1f-4ab3-a1c5-9c014cc128c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:58.352535 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72579c-0d1f-4ab3-a1c5-9c014cc128c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:58.352723 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72579c-0d1f-4ab3-a1c5-9c014cc128c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:58.353562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72579c-0d1f-4ab3-a1c5-9c014cc128c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:58.355099 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72579c-0d1f-4ab3-a1c5-9c014cc128c4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:58.368264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1106/2225] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:08:58.372115 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d9dc8-c747-4ad0-8bfc-8e351c0534bd admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:58.383426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d9dc8-c747-4ad0-8bfc-8e351c0534bd admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:58.388831 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af2e42-45d2-45e5-8149-444ca847c890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:58.389903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af2e42-45d2-45e5-8149-444ca847c890 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:58.390310 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af2e42-45d2-45e5-8149-444ca847c890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:58.390688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af2e42-45d2-45e5-8149-444ca847c890 admin admin] PATH_INFO: `/v3/projects/39d96be72478434bb2cf1fce10c9d48c/users/4f4f089afae1451da221130ea9fa80b4/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:58.408877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af2e42-45d2-45e5-8149-444ca847c890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d96be72478434bb2cf1fce10c9d48c, user_id=4f4f089afae1451da221130ea9fa80b4, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:58.412270 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af2e42-45d2-45e5-8149-444ca847c890 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:58.432726 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1120/2226] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:08:58 2022] PUT /identity/v3/projects/39d96be72478434bb2cf1fce10c9d48c/users/4f4f089afae1451da221130ea9fa80b4/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:08:58.437760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72579c-0d1f-4ab3-a1c5-9c014cc128c4 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:58.448845 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72579c-0d1f-4ab3-a1c5-9c014cc128c4 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:58.511460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022db17-3065-4e04-b17c-30f9335f98e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:58.512172 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022db17-3065-4e04-b17c-30f9335f98e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:58.512461 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022db17-3065-4e04-b17c-30f9335f98e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:58.512740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022db17-3065-4e04-b17c-30f9335f98e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:58.513474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022db17-3065-4e04-b17c-30f9335f98e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:58.515075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022db17-3065-4e04-b17c-30f9335f98e3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:58.532375 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1107/2227] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:08:58.534004 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af2e42-45d2-45e5-8149-444ca847c890 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:58.546859 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af2e42-45d2-45e5-8149-444ca847c890 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:58.554172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea147b6-05a3-43a2-b080-c2e81b317113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:58.555142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea147b6-05a3-43a2-b080-c2e81b317113 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:58.555445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea147b6-05a3-43a2-b080-c2e81b317113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:58.555934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea147b6-05a3-43a2-b080-c2e81b317113 admin admin] PATH_INFO: `/v3/projects/39d96be72478434bb2cf1fce10c9d48c/users/4f4f089afae1451da221130ea9fa80b4/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:58.558407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea147b6-05a3-43a2-b080-c2e81b317113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d96be72478434bb2cf1fce10c9d48c, user_id=4f4f089afae1451da221130ea9fa80b4, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:58.561324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea147b6-05a3-43a2-b080-c2e81b317113 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:58.573986 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1121/2228] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:08:58 2022] PUT /identity/v3/projects/39d96be72478434bb2cf1fce10c9d48c/users/4f4f089afae1451da221130ea9fa80b4/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:09:03.157547 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f19762-966e-4424-9ee1-6dbcf579500e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:03.159076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f19762-966e-4424-9ee1-6dbcf579500e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:03.159654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f19762-966e-4424-9ee1-6dbcf579500e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:03.218642 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-02f19762-966e-4424-9ee1-6dbcf579500e None None] MFA Rules not processed for user `a63dd78421064bbe838b1ed0261c13bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:03.225151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-02f19762-966e-4424-9ee1-6dbcf579500e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:03.277738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:03.304149 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1108/2229] 10.222.0.41 () {58 vars in 1009 bytes} [Mon May 30 12:09:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:03.371163 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea147b6-05a3-43a2-b080-c2e81b317113 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:03.379850 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8ea147b6-05a3-43a2-b080-c2e81b317113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:03.561300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea147b6-05a3-43a2-b080-c2e81b317113 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:03.576109 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5450d-0e95-40b8-b58b-a5c4ca70fc9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e5f980cdb74227bb31c7e7e5eab74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:03.576917 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5450d-0e95-40b8-b58b-a5c4ca70fc9a service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:03.577268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5450d-0e95-40b8-b58b-a5c4ca70fc9a service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:03.578051 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5450d-0e95-40b8-b58b-a5c4ca70fc9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:03.603245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5450d-0e95-40b8-b58b-a5c4ca70fc9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:03.605480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5450d-0e95-40b8-b58b-a5c4ca70fc9a service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:03.631414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1122/2230] 10.222.0.41 () {60 vars in 1384 bytes} [Mon May 30 12:09:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:09:06.016782 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30f150-145e-4e4b-b299-2d79d21ecff1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:06.019212 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30f150-145e-4e4b-b299-2d79d21ecff1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:06.020185 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30f150-145e-4e4b-b299-2d79d21ecff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:06.085013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5f30f150-145e-4e4b-b299-2d79d21ecff1 None None] MFA Rules not processed for user `4f4f089afae1451da221130ea9fa80b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:06.087109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5f30f150-145e-4e4b-b299-2d79d21ecff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:06.227878 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1109/2231] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:09:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:06.236535 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5450d-0e95-40b8-b58b-a5c4ca70fc9a service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:06.239328 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5bb5450d-0e95-40b8-b58b-a5c4ca70fc9a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:06.376367 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5450d-0e95-40b8-b58b-a5c4ca70fc9a service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:06.383869 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac827745-dcf7-4440-8b55-5aea87fadabf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:06.384760 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac827745-dcf7-4440-8b55-5aea87fadabf service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:06.385212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac827745-dcf7-4440-8b55-5aea87fadabf service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:06.385644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac827745-dcf7-4440-8b55-5aea87fadabf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:06.496845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:06.527670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac827745-dcf7-4440-8b55-5aea87fadabf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:06.529312 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac827745-dcf7-4440-8b55-5aea87fadabf service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:06.543874 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1123/2232] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:09:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:09:09.110777 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3773d8-0544-4ba3-b93c-35f2ff5d75fb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:09.111702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3773d8-0544-4ba3-b93c-35f2ff5d75fb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:09.112876 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3773d8-0544-4ba3-b93c-35f2ff5d75fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:09.157944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3d3773d8-0544-4ba3-b93c-35f2ff5d75fb None None] MFA Rules not processed for user `a63dd78421064bbe838b1ed0261c13bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:09.165808 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3d3773d8-0544-4ba3-b93c-35f2ff5d75fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:09.262255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1110/2233] 10.222.0.41 () {58 vars in 1009 bytes} [Mon May 30 12:09:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:09.288241 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac827745-dcf7-4440-8b55-5aea87fadabf service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:09.317969 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac827745-dcf7-4440-8b55-5aea87fadabf service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:09.329686 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e8a47-03e1-4607-98bd-8622e69f013f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e5f980cdb74227bb31c7e7e5eab74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:09.332291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e8a47-03e1-4607-98bd-8622e69f013f service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:09.332845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e8a47-03e1-4607-98bd-8622e69f013f service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:09.333377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e8a47-03e1-4607-98bd-8622e69f013f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:09.367653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e8a47-03e1-4607-98bd-8622e69f013f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:09.370347 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e8a47-03e1-4607-98bd-8622e69f013f service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:09.382062 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1124/2234] 10.222.0.41 () {60 vars in 1384 bytes} [Mon May 30 12:09:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:09:19.236285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=47 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:19.378501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=13 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:24.037798 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff4228-ee65-47a8-b9d6-36284bd34172 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:24.038372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff4228-ee65-47a8-b9d6-36284bd34172 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:24.038372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff4228-ee65-47a8-b9d6-36284bd34172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:24.058692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0cff4228-ee65-47a8-b9d6-36284bd34172 None None] MFA Rules not processed for user `a63dd78421064bbe838b1ed0261c13bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:24.060095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0cff4228-ee65-47a8-b9d6-36284bd34172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:24.068748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1111/2235] 10.222.0.41 () {58 vars in 1009 bytes} [Mon May 30 12:09:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:24.091472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e8a47-03e1-4607-98bd-8622e69f013f service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:24.104788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e8a47-03e1-4607-98bd-8622e69f013f service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:24.110375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7d116-59a1-4c88-964a-0853f8ba534f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e5f980cdb74227bb31c7e7e5eab74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:24.111052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7d116-59a1-4c88-964a-0853f8ba534f service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:24.111369 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7d116-59a1-4c88-964a-0853f8ba534f service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:24.111649 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7d116-59a1-4c88-964a-0853f8ba534f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:24.120532 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7d116-59a1-4c88-964a-0853f8ba534f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:24.122130 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7d116-59a1-4c88-964a-0853f8ba534f service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:24.139042 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1125/2236] 10.222.0.41 () {60 vars in 1384 bytes} [Mon May 30 12:09:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:09:25.011369 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4d668-7eb6-4094-84a3-afc60c4a5e71 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:25.011660 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4d668-7eb6-4094-84a3-afc60c4a5e71 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:25.012013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4d668-7eb6-4094-84a3-afc60c4a5e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:25.046272 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f9a4d668-7eb6-4094-84a3-afc60c4a5e71 None None] MFA Rules not processed for user `a63dd78421064bbe838b1ed0261c13bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:25.048111 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f9a4d668-7eb6-4094-84a3-afc60c4a5e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:25.063234 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1112/2237] 10.222.0.41 () {58 vars in 967 bytes} [Mon May 30 12:09:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:25.093673 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7d116-59a1-4c88-964a-0853f8ba534f service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:25.114019 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7d116-59a1-4c88-964a-0853f8ba534f service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:25.128866 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594df7a-6620-4b6a-bc0f-f5e3eb658010 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e5f980cdb74227bb31c7e7e5eab74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:25.130139 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594df7a-6620-4b6a-bc0f-f5e3eb658010 service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:25.130692 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594df7a-6620-4b6a-bc0f-f5e3eb658010 service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:25.131161 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594df7a-6620-4b6a-bc0f-f5e3eb658010 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:25.147231 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594df7a-6620-4b6a-bc0f-f5e3eb658010 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:25.150152 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594df7a-6620-4b6a-bc0f-f5e3eb658010 service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:25.163124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1126/2238] 10.222.0.41 () {60 vars in 1384 bytes} [Mon May 30 12:09:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:09:25.591429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bbbd3-739b-4337-bca2-4a90cfb15164 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:25.593186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bbbd3-739b-4337-bca2-4a90cfb15164 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:25.593186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bbbd3-739b-4337-bca2-4a90cfb15164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:25.613028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d91bbbd3-739b-4337-bca2-4a90cfb15164 None None] MFA Rules not processed for user `a63dd78421064bbe838b1ed0261c13bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:25.616056 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d91bbbd3-739b-4337-bca2-4a90cfb15164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:25.623992 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1113/2239] 10.222.0.41 () {58 vars in 1009 bytes} [Mon May 30 12:09:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:25.645790 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594df7a-6620-4b6a-bc0f-f5e3eb658010 service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:25.659689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594df7a-6620-4b6a-bc0f-f5e3eb658010 service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:25.665692 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa96ce-407a-48e1-baa8-7a5fcfce94b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e5f980cdb74227bb31c7e7e5eab74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:25.668523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa96ce-407a-48e1-baa8-7a5fcfce94b0 service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:25.669079 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa96ce-407a-48e1-baa8-7a5fcfce94b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:25.669562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa96ce-407a-48e1-baa8-7a5fcfce94b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:25.680251 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa96ce-407a-48e1-baa8-7a5fcfce94b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:25.682006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa96ce-407a-48e1-baa8-7a5fcfce94b0 service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:25.692604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1127/2240] 10.222.0.41 () {60 vars in 1384 bytes} [Mon May 30 12:09:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:09:27.367697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822af9a-9a43-4ef9-8700-add306148c09 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:27.368270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822af9a-9a43-4ef9-8700-add306148c09 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:27.368396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822af9a-9a43-4ef9-8700-add306148c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:27.386496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c822af9a-9a43-4ef9-8700-add306148c09 None None] MFA Rules not processed for user `a63dd78421064bbe838b1ed0261c13bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:27.387693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c822af9a-9a43-4ef9-8700-add306148c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:27.396745 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1114/2241] 10.222.0.41 () {58 vars in 967 bytes} [Mon May 30 12:09:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:27.410877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa96ce-407a-48e1-baa8-7a5fcfce94b0 service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:27.421206 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa96ce-407a-48e1-baa8-7a5fcfce94b0 service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:27.426199 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611638a-dd23-418e-b2ad-b97b776abb91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e5f980cdb74227bb31c7e7e5eab74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:27.426825 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611638a-dd23-418e-b2ad-b97b776abb91 service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:27.427140 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611638a-dd23-418e-b2ad-b97b776abb91 service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:27.427415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611638a-dd23-418e-b2ad-b97b776abb91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:27.435511 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611638a-dd23-418e-b2ad-b97b776abb91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:27.437110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611638a-dd23-418e-b2ad-b97b776abb91 service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:27.445633 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1128/2242] 10.222.0.41 () {60 vars in 1384 bytes} [Mon May 30 12:09:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:09:28.500765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bfe67-fb6c-4a6e-84db-801ddc6f26d6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:28.501221 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bfe67-fb6c-4a6e-84db-801ddc6f26d6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:28.501335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bfe67-fb6c-4a6e-84db-801ddc6f26d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:28.521051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4f2bfe67-fb6c-4a6e-84db-801ddc6f26d6 None None] MFA Rules not processed for user `a63dd78421064bbe838b1ed0261c13bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:28.522308 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4f2bfe67-fb6c-4a6e-84db-801ddc6f26d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:28.529605 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1115/2243] 10.222.0.41 () {58 vars in 967 bytes} [Mon May 30 12:09:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:28.542679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611638a-dd23-418e-b2ad-b97b776abb91 service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:28.554821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611638a-dd23-418e-b2ad-b97b776abb91 service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:28.559756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e200086-998e-4619-a584-8fa1536b0a7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e5f980cdb74227bb31c7e7e5eab74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:28.560424 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e200086-998e-4619-a584-8fa1536b0a7d service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:28.560702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e200086-998e-4619-a584-8fa1536b0a7d service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:28.560978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e200086-998e-4619-a584-8fa1536b0a7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:28.569959 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e200086-998e-4619-a584-8fa1536b0a7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:28.571525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e200086-998e-4619-a584-8fa1536b0a7d service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:28.579352 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1129/2244] 10.222.0.41 () {60 vars in 1384 bytes} [Mon May 30 12:09:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 30 12:09:29.568770 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bfe67-fb6c-4a6e-84db-801ddc6f26d6 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:29.570512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4f2bfe67-fb6c-4a6e-84db-801ddc6f26d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:29.643490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bfe67-fb6c-4a6e-84db-801ddc6f26d6 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:29.647988 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09a412-6d98-4858-af6d-b66faa91e03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:29.648869 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09a412-6d98-4858-af6d-b66faa91e03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:29.649151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09a412-6d98-4858-af6d-b66faa91e03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:29.649425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09a412-6d98-4858-af6d-b66faa91e03d admin admin] PATH_INFO: `/v3/users/c6451c3ad6dc4a7b82b25dbfbd100965` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:29.650674 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09a412-6d98-4858-af6d-b66faa91e03d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6451c3ad6dc4a7b82b25dbfbd100965)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:29.652630 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09a412-6d98-4858-af6d-b66faa91e03d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:29.704626 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2b09a412-6d98-4858-af6d-b66faa91e03d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6451c3ad6dc4a7b82b25dbfbd100965'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:29.712936 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2b09a412-6d98-4858-af6d-b66faa91e03d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6451c3ad6dc4a7b82b25dbfbd100965'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:29.729829 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2b09a412-6d98-4858-af6d-b66faa91e03d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6451c3ad6dc4a7b82b25dbfbd100965'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:29.730665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2b09a412-6d98-4858-af6d-b66faa91e03d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6451c3ad6dc4a7b82b25dbfbd100965'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:29.731288 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2b09a412-6d98-4858-af6d-b66faa91e03d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6451c3ad6dc4a7b82b25dbfbd100965'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:29.747095 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1116/2245] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:09:29 2022] DELETE /identity/v3/users/c6451c3ad6dc4a7b82b25dbfbd100965 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:09:29.752179 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bdab3-019a-4f4d-8586-5daa72005699 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:29.752892 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bdab3-019a-4f4d-8586-5daa72005699 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:29.752892 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bdab3-019a-4f4d-8586-5daa72005699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:29.771811 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-928bdab3-019a-4f4d-8586-5daa72005699 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:29.773167 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-928bdab3-019a-4f4d-8586-5daa72005699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:29.842616 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1130/2246] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:29.850454 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09a412-6d98-4858-af6d-b66faa91e03d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:29.852015 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2b09a412-6d98-4858-af6d-b66faa91e03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:29.937822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:29.947092 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09a412-6d98-4858-af6d-b66faa91e03d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:29.960065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20e1ff-6995-4c45-9fe9-9cc7d4a9eb5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:29.960831 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20e1ff-6995-4c45-9fe9-9cc7d4a9eb5b service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:29.963503 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20e1ff-6995-4c45-9fe9-9cc7d4a9eb5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:29.964005 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20e1ff-6995-4c45-9fe9-9cc7d4a9eb5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:29.976067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20e1ff-6995-4c45-9fe9-9cc7d4a9eb5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:29.977568 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20e1ff-6995-4c45-9fe9-9cc7d4a9eb5b service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:29.993932 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1117/2247] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:09:30.183871 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba0a37-4c28-4408-826c-5893cd4f8eda None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:30.184174 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba0a37-4c28-4408-826c-5893cd4f8eda None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:30.184462 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba0a37-4c28-4408-826c-5893cd4f8eda None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:30.185830 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1131/2248] 10.222.0.41 () {54 vars in 921 bytes} [Mon May 30 12:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:09:30.193462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a635a12-081b-437d-8c06-fb5d352a4159 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:30.194343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a635a12-081b-437d-8c06-fb5d352a4159 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:30.194860 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a635a12-081b-437d-8c06-fb5d352a4159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:30.283323 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2a635a12-081b-437d-8c06-fb5d352a4159 None None] MFA Rules not processed for user `bb3820a613744c15b840681fe6b6e808`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:30.284751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2a635a12-081b-437d-8c06-fb5d352a4159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:30.399126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1118/2249] 10.222.0.41 () {58 vars in 1018 bytes} [Mon May 30 12:09:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:09:30.400712 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba0a37-4c28-4408-826c-5893cd4f8eda None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:30.403755 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cbba0a37-4c28-4408-826c-5893cd4f8eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:30.413133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a635a12-081b-437d-8c06-fb5d352a4159 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:30.414590 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2a635a12-081b-437d-8c06-fb5d352a4159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:30.450379 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba0a37-4c28-4408-826c-5893cd4f8eda None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:30.459879 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eebcad-4127-460d-913e-6512da9e3dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:30.463737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eebcad-4127-460d-913e-6512da9e3dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:30.464235 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eebcad-4127-460d-913e-6512da9e3dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:30.464740 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eebcad-4127-460d-913e-6512da9e3dc5 admin admin] PATH_INFO: `/v3/projects/d22b1bc83bba4f8e9deafc253449e8ab` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:30.467220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eebcad-4127-460d-913e-6512da9e3dc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d22b1bc83bba4f8e9deafc253449e8ab)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:30.469648 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eebcad-4127-460d-913e-6512da9e3dc5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:30.531136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a635a12-081b-437d-8c06-fb5d352a4159 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:30.554760 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-60eebcad-4127-460d-913e-6512da9e3dc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22b1bc83bba4f8e9deafc253449e8ab', 'request_id': 'req-60eebcad-4127-460d-913e-6512da9e3dc5'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:30.563207 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-60eebcad-4127-460d-913e-6512da9e3dc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22b1bc83bba4f8e9deafc253449e8ab', 'request_id': 'req-60eebcad-4127-460d-913e-6512da9e3dc5'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:30.572338 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-60eebcad-4127-460d-913e-6512da9e3dc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22b1bc83bba4f8e9deafc253449e8ab', 'request_id': 'req-60eebcad-4127-460d-913e-6512da9e3dc5'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:30.585860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-60eebcad-4127-460d-913e-6512da9e3dc5 admin admin] The token cache is being invalidate because project d22b1bc83bba4f8e9deafc253449e8ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:09:30.586149 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-60eebcad-4127-460d-913e-6512da9e3dc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:30.587005 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-60eebcad-4127-460d-913e-6512da9e3dc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:30.588696 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1132/2250] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:09:30 2022] DELETE /identity/v3/projects/d22b1bc83bba4f8e9deafc253449e8ab => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:09:30.599626 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386e76c-9a1f-495d-be89-4ac76959a6a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ffa6d38c01f4820a705c06991654bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:30.600384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386e76c-9a1f-495d-be89-4ac76959a6a7 service glance] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:30.600623 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386e76c-9a1f-495d-be89-4ac76959a6a7 service glance] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:30.601957 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386e76c-9a1f-495d-be89-4ac76959a6a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:30.604045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c386e76c-9a1f-495d-be89-4ac76959a6a7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:30.623396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:30.700322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386e76c-9a1f-495d-be89-4ac76959a6a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:30.702550 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386e76c-9a1f-495d-be89-4ac76959a6a7 service glance] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:30.718701 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1119/2251] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:09:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:09:30.814817 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31982902-638a-4434-bc3e-d044a0508a96 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:30.815585 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31982902-638a-4434-bc3e-d044a0508a96 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:30.815895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31982902-638a-4434-bc3e-d044a0508a96 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:30.818267 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1133/2252] 10.222.0.41 () {54 vars in 921 bytes} [Mon May 30 12:09:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:09:30.823701 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc14cf-25d6-43c2-acb5-fef58d3237d2 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:30.824041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc14cf-25d6-43c2-acb5-fef58d3237d2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:30.824339 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc14cf-25d6-43c2-acb5-fef58d3237d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:30.843773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6bfc14cf-25d6-43c2-acb5-fef58d3237d2 None None] MFA Rules not processed for user `ae7bc0d4fd924bfb89f874d1c6fc3d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:30.845018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6bfc14cf-25d6-43c2-acb5-fef58d3237d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:30.900293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31982902-638a-4434-bc3e-d044a0508a96 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:30.902031 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-31982902-638a-4434-bc3e-d044a0508a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:30.910714 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1120/2253] 10.222.0.41 () {58 vars in 1018 bytes} [Mon May 30 12:09:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:30.924607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:30.926921 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc14cf-25d6-43c2-acb5-fef58d3237d2 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:30.928697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6bfc14cf-25d6-43c2-acb5-fef58d3237d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:30.939491 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc14cf-25d6-43c2-acb5-fef58d3237d2 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:30.949443 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bee500-0c50-4aac-a26f-d9536a0dbd52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:30.950188 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bee500-0c50-4aac-a26f-d9536a0dbd52 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:30.950481 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bee500-0c50-4aac-a26f-d9536a0dbd52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:30.950797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bee500-0c50-4aac-a26f-d9536a0dbd52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:30.959785 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bee500-0c50-4aac-a26f-d9536a0dbd52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:30.961419 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bee500-0c50-4aac-a26f-d9536a0dbd52 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:30.969545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1121/2254] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:09:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:09:30.980004 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31982902-638a-4434-bc3e-d044a0508a96 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:30.984877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ebfbd-7840-4f3f-9c78-f0f8178e3bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:30.985770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ebfbd-7840-4f3f-9c78-f0f8178e3bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:30.986090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ebfbd-7840-4f3f-9c78-f0f8178e3bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:30.986420 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ebfbd-7840-4f3f-9c78-f0f8178e3bab admin admin] PATH_INFO: `/v3/users/b6c7d188b2764872b2bd3245e1a7ab1a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:30.987666 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ebfbd-7840-4f3f-9c78-f0f8178e3bab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6c7d188b2764872b2bd3245e1a7ab1a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:30.989681 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ebfbd-7840-4f3f-9c78-f0f8178e3bab admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:31.053390 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b35ebfbd-7840-4f3f-9c78-f0f8178e3bab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6c7d188b2764872b2bd3245e1a7ab1a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:31.062488 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b35ebfbd-7840-4f3f-9c78-f0f8178e3bab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6c7d188b2764872b2bd3245e1a7ab1a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:31.067811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971f89c-2731-4dac-a250-6be860ed92da None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:31.068266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971f89c-2731-4dac-a250-6be860ed92da None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:31.068658 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971f89c-2731-4dac-a250-6be860ed92da None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:31.070570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1122/2255] 10.222.0.41 () {54 vars in 921 bytes} [Mon May 30 12:09:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:09:31.075583 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc597821-0365-48e9-945a-d45fd040e9df None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:31.075922 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc597821-0365-48e9-945a-d45fd040e9df None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:31.076211 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc597821-0365-48e9-945a-d45fd040e9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:31.083417 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b35ebfbd-7840-4f3f-9c78-f0f8178e3bab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6c7d188b2764872b2bd3245e1a7ab1a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:31.084159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b35ebfbd-7840-4f3f-9c78-f0f8178e3bab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6c7d188b2764872b2bd3245e1a7ab1a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:31.091294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b35ebfbd-7840-4f3f-9c78-f0f8178e3bab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6c7d188b2764872b2bd3245e1a7ab1a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:31.098085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1134/2256] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:09:30 2022] DELETE /identity/v3/users/b6c7d188b2764872b2bd3245e1a7ab1a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:09:31.102426 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-fc597821-0365-48e9-945a-d45fd040e9df None None] MFA Rules not processed for user `bb3820a613744c15b840681fe6b6e808`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:31.103966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fc597821-0365-48e9-945a-d45fd040e9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:31.191807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1123/2257] 10.222.0.41 () {58 vars in 1018 bytes} [Mon May 30 12:09:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:09:31.210000 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ebfbd-7840-4f3f-9c78-f0f8178e3bab admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:31.212221 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b35ebfbd-7840-4f3f-9c78-f0f8178e3bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:31.294757 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ebfbd-7840-4f3f-9c78-f0f8178e3bab admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:31.295673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc597821-0365-48e9-945a-d45fd040e9df None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:31.297197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fc597821-0365-48e9-945a-d45fd040e9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:31.300279 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4410165-7c0c-4e96-9e3d-15f0d7db32f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:31.301237 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4410165-7c0c-4e96-9e3d-15f0d7db32f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:31.301763 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4410165-7c0c-4e96-9e3d-15f0d7db32f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:31.302260 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4410165-7c0c-4e96-9e3d-15f0d7db32f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:31.317504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4410165-7c0c-4e96-9e3d-15f0d7db32f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:31.318888 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4410165-7c0c-4e96-9e3d-15f0d7db32f3 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:31.331938 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1135/2258] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:09:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:09:31.344303 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:31.391071 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc597821-0365-48e9-945a-d45fd040e9df None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:31.397081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af1007-23d1-48aa-aca4-0246bec27975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:31.397965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af1007-23d1-48aa-aca4-0246bec27975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:31.398302 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af1007-23d1-48aa-aca4-0246bec27975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:31.398683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af1007-23d1-48aa-aca4-0246bec27975 admin admin] PATH_INFO: `/v3/projects/0fa1cd28ccbd46a2925b432e3ff62c3f` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:31.400513 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af1007-23d1-48aa-aca4-0246bec27975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa1cd28ccbd46a2925b432e3ff62c3f)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:31.403024 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af1007-23d1-48aa-aca4-0246bec27975 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:31.471611 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a4af1007-23d1-48aa-aca4-0246bec27975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'request_id': 'req-a4af1007-23d1-48aa-aca4-0246bec27975'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:31.482600 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a4af1007-23d1-48aa-aca4-0246bec27975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'request_id': 'req-a4af1007-23d1-48aa-aca4-0246bec27975'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:31.492618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a4af1007-23d1-48aa-aca4-0246bec27975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'request_id': 'req-a4af1007-23d1-48aa-aca4-0246bec27975'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:31.510947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a4af1007-23d1-48aa-aca4-0246bec27975 admin admin] The token cache is being invalidate because project 0fa1cd28ccbd46a2925b432e3ff62c3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:09:31.511404 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a4af1007-23d1-48aa-aca4-0246bec27975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:31.512645 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a4af1007-23d1-48aa-aca4-0246bec27975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:09:31.517433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1124/2259] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:09:31 2022] DELETE /identity/v3/projects/0fa1cd28ccbd46a2925b432e3ff62c3f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:09:31.523850 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa55ac-2505-49da-b346-6231b0461af5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:31.524327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa55ac-2505-49da-b346-6231b0461af5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:31.524848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa55ac-2505-49da-b346-6231b0461af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:31.545804 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2dfa55ac-2505-49da-b346-6231b0461af5 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:31.547368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2dfa55ac-2505-49da-b346-6231b0461af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:31.603870 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:31.648558 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1136/2260] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:09:31.656660 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ba1e2-1e54-44db-bf9b-689d08b055ee None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:31.657129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ba1e2-1e54-44db-bf9b-689d08b055ee None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:31.657318 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ba1e2-1e54-44db-bf9b-689d08b055ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:31.677463 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ad1ba1e2-1e54-44db-bf9b-689d08b055ee None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:31.678763 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ad1ba1e2-1e54-44db-bf9b-689d08b055ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:31.687051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1125/2261] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:31.691547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa55ac-2505-49da-b346-6231b0461af5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:31.701899 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa55ac-2505-49da-b346-6231b0461af5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:31.707249 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2e593-43ec-46a8-9199-d10884f3799d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:31.707971 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2e593-43ec-46a8-9199-d10884f3799d admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:31.708257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2e593-43ec-46a8-9199-d10884f3799d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:31.708535 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2e593-43ec-46a8-9199-d10884f3799d admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:31.709270 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2e593-43ec-46a8-9199-d10884f3799d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:09:31.709608 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2e593-43ec-46a8-9199-d10884f3799d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:31.711207 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2e593-43ec-46a8-9199-d10884f3799d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:31.723674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1137/2262] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:09:31.728572 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ba1e2-1e54-44db-bf9b-689d08b055ee None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:31.743192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ba1e2-1e54-44db-bf9b-689d08b055ee None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:31.748202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3073cb8-9e50-49a5-97a3-ce34f4496d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:31.748949 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3073cb8-9e50-49a5-97a3-ce34f4496d80 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:31.749303 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3073cb8-9e50-49a5-97a3-ce34f4496d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:31.749648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3073cb8-9e50-49a5-97a3-ce34f4496d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:31.750427 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3073cb8-9e50-49a5-97a3-ce34f4496d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:31.753241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3073cb8-9e50-49a5-97a3-ce34f4496d80 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:31.786503 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1126/2263] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:09:31 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:09:31.789846 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2e593-43ec-46a8-9199-d10884f3799d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:31.804515 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2e593-43ec-46a8-9199-d10884f3799d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:31.872063 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e63e8-1ecb-46df-9439-f58554006f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:31.872754 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e63e8-1ecb-46df-9439-f58554006f7e admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:31.872943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e63e8-1ecb-46df-9439-f58554006f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:31.873225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e63e8-1ecb-46df-9439-f58554006f7e admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:31.873931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e63e8-1ecb-46df-9439-f58554006f7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:31.875891 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e63e8-1ecb-46df-9439-f58554006f7e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:31.902374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1138/2264] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:09:31 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:09:31.903616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3073cb8-9e50-49a5-97a3-ce34f4496d80 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:31.914445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3073cb8-9e50-49a5-97a3-ce34f4496d80 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:31.919619 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782cb93-4f8a-4c62-828c-c0fdd3dfe996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:31.920378 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782cb93-4f8a-4c62-828c-c0fdd3dfe996 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:31.920663 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782cb93-4f8a-4c62-828c-c0fdd3dfe996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:31.920945 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782cb93-4f8a-4c62-828c-c0fdd3dfe996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:31.921692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782cb93-4f8a-4c62-828c-c0fdd3dfe996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:31.923371 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782cb93-4f8a-4c62-828c-c0fdd3dfe996 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:31.940938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1127/2265] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:09:31.941490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e63e8-1ecb-46df-9439-f58554006f7e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:31.951810 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e63e8-1ecb-46df-9439-f58554006f7e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:31.957085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089402a9-76e7-4f2b-af62-7a0cb41f28d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:31.957746 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089402a9-76e7-4f2b-af62-7a0cb41f28d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:31.958033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089402a9-76e7-4f2b-af62-7a0cb41f28d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:31.958313 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089402a9-76e7-4f2b-af62-7a0cb41f28d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:31.959242 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089402a9-76e7-4f2b-af62-7a0cb41f28d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:31.960971 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089402a9-76e7-4f2b-af62-7a0cb41f28d2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:31.975182 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1139/2266] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:09:31.977529 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782cb93-4f8a-4c62-828c-c0fdd3dfe996 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:31.988663 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782cb93-4f8a-4c62-828c-c0fdd3dfe996 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:31.993508 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c76de8-e70d-4662-803e-6fcf2240a536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:31.994411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c76de8-e70d-4662-803e-6fcf2240a536 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:31.994699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c76de8-e70d-4662-803e-6fcf2240a536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:31.995006 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c76de8-e70d-4662-803e-6fcf2240a536 admin admin] PATH_INFO: `/v3/projects/4d363027ab254adfb4ba1b13de71d7e7/users/dbe77e4880a44d259fac8dfa05722f18/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:32.015484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c76de8-e70d-4662-803e-6fcf2240a536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d363027ab254adfb4ba1b13de71d7e7, user_id=dbe77e4880a44d259fac8dfa05722f18, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:32.018814 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c76de8-e70d-4662-803e-6fcf2240a536 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:32.031731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1128/2267] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:09:31 2022] PUT /identity/v3/projects/4d363027ab254adfb4ba1b13de71d7e7/users/dbe77e4880a44d259fac8dfa05722f18/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:09:32.036954 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eda7eb-f9f8-4d01-82dd-544d8321db07 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:32.037252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eda7eb-f9f8-4d01-82dd-544d8321db07 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:32.037539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eda7eb-f9f8-4d01-82dd-544d8321db07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:32.054352 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-32eda7eb-f9f8-4d01-82dd-544d8321db07 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:32.055555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-32eda7eb-f9f8-4d01-82dd-544d8321db07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:32.116657 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1140/2268] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:09:32.127969 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c76de8-e70d-4662-803e-6fcf2240a536 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:32.130801 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-45c76de8-e70d-4662-803e-6fcf2240a536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:32.188480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c76de8-e70d-4662-803e-6fcf2240a536 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:32.193222 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7c21d-07fb-49ff-bca5-075833f337aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:32.193862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7c21d-07fb-49ff-bca5-075833f337aa service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:32.194144 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7c21d-07fb-49ff-bca5-075833f337aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:32.194420 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7c21d-07fb-49ff-bca5-075833f337aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:32.200262 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:32.205484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7c21d-07fb-49ff-bca5-075833f337aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:32.207743 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7c21d-07fb-49ff-bca5-075833f337aa service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:32.217295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1129/2269] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:09:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:09:33.095749 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67a007-552b-4ff0-ba6c-577aab4a62b2 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:33.096427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67a007-552b-4ff0-ba6c-577aab4a62b2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:33.096427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67a007-552b-4ff0-ba6c-577aab4a62b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:33.130329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ec67a007-552b-4ff0-ba6c-577aab4a62b2 None None] MFA Rules not processed for user `dbe77e4880a44d259fac8dfa05722f18`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:33.131562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ec67a007-552b-4ff0-ba6c-577aab4a62b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:33.166511 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:33.214336 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1141/2270] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:09:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:33.225821 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7c21d-07fb-49ff-bca5-075833f337aa service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:33.227273 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0de7c21d-07fb-49ff-bca5-075833f337aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:33.308343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7c21d-07fb-49ff-bca5-075833f337aa service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:33.312082 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060f314-c12e-4e32-bd97-42d87dc0f8d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:33.312731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060f314-c12e-4e32-bd97-42d87dc0f8d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:33.313018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060f314-c12e-4e32-bd97-42d87dc0f8d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:33.313300 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060f314-c12e-4e32-bd97-42d87dc0f8d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:33.321610 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060f314-c12e-4e32-bd97-42d87dc0f8d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:33.323048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060f314-c12e-4e32-bd97-42d87dc0f8d0 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:33.332786 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1130/2271] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:09:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:09:34.708821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e9eb1-ef63-44e1-bb73-c8f2a982a5a0 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:34.709266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e9eb1-ef63-44e1-bb73-c8f2a982a5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:34.709383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e9eb1-ef63-44e1-bb73-c8f2a982a5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:34.718247 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e7e4b-f4b7-4d69-81ec-987d4f10e63d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:34.718661 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e7e4b-f4b7-4d69-81ec-987d4f10e63d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:34.718806 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e7e4b-f4b7-4d69-81ec-987d4f10e63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:34.727414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-bf5e9eb1-ef63-44e1-bb73-c8f2a982a5a0 None None] MFA Rules not processed for user `dbe77e4880a44d259fac8dfa05722f18`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:34.728662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bf5e9eb1-ef63-44e1-bb73-c8f2a982a5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:34.740075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1142/2272] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:09:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:34.800473 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-940e7e4b-f4b7-4d69-81ec-987d4f10e63d None None] MFA Rules not processed for user `a63dd78421064bbe838b1ed0261c13bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:34.801820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-940e7e4b-f4b7-4d69-81ec-987d4f10e63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:34.867438 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1131/2273] 10.222.0.41 () {58 vars in 1009 bytes} [Mon May 30 12:09:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:09:34.885348 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e9eb1-ef63-44e1-bb73-c8f2a982a5a0 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:34.886938 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bf5e9eb1-ef63-44e1-bb73-c8f2a982a5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:35.009330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e9eb1-ef63-44e1-bb73-c8f2a982a5a0 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:35.014919 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1128b-66ff-4f46-807c-743617b704b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e5f980cdb74227bb31c7e7e5eab74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:35.015569 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1128b-66ff-4f46-807c-743617b704b9 service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:35.015888 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1128b-66ff-4f46-807c-743617b704b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:35.016171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1128b-66ff-4f46-807c-743617b704b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:35.024788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1128b-66ff-4f46-807c-743617b704b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:35.026386 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1128b-66ff-4f46-807c-743617b704b9 service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:35.034922 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1143/2274] 10.222.0.41 () {60 vars in 1384 bytes} [Mon May 30 12:09:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:09:44.864046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=78 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:45.031567 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=55 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:47.486135 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e7e4b-f4b7-4d69-81ec-987d4f10e63d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:47.487685 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-940e7e4b-f4b7-4d69-81ec-987d4f10e63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:47.536545 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee246199-4bc5-47cf-b799-cee751a905ce None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:47.537133 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee246199-4bc5-47cf-b799-cee751a905ce None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:47.537251 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee246199-4bc5-47cf-b799-cee751a905ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:47.557414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ee246199-4bc5-47cf-b799-cee751a905ce None None] MFA Rules not processed for user `f7e7ce32b4c0457196c8765d6c5ada7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:47.558635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ee246199-4bc5-47cf-b799-cee751a905ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:47.582645 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e7e4b-f4b7-4d69-81ec-987d4f10e63d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:47.587775 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc6b6b-3e23-48f4-a5df-259354649877 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b43eb1a0ac4db5adee3512453459aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:47.588496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc6b6b-3e23-48f4-a5df-259354649877 service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:47.588776 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc6b6b-3e23-48f4-a5df-259354649877 service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:47.589050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc6b6b-3e23-48f4-a5df-259354649877 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:47.590778 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-60dc6b6b-3e23-48f4-a5df-259354649877 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:47.603340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc6b6b-3e23-48f4-a5df-259354649877 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:47.604986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc6b6b-3e23-48f4-a5df-259354649877 service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:47.616833 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1132/2275] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:09:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:09:47.619962 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1144/2276] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:09:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:57.610098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=25 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:57.611155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=41 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:03.947668 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ce56f-15b9-4794-ac8a-cc7ff1f39b97 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:10:03.948238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ce56f-15b9-4794-ac8a-cc7ff1f39b97 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:10:03.948467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ce56f-15b9-4794-ac8a-cc7ff1f39b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:10:03.971880 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-362ce56f-15b9-4794-ac8a-cc7ff1f39b97 None None] MFA Rules not processed for user `4e875190d9dc48edb929bb316d5e576e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:10:03.973118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-362ce56f-15b9-4794-ac8a-cc7ff1f39b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:10:03.985540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8128f4-f418-42fb-ab4f-172b0c456c23 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:10:03.986934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8128f4-f418-42fb-ab4f-172b0c456c23 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:10:03.987717 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8128f4-f418-42fb-ab4f-172b0c456c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:10:04.012542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ce8128f4-f418-42fb-ab4f-172b0c456c23 None None] MFA Rules not processed for user `a63dd78421064bbe838b1ed0261c13bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:10:04.014017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ce8128f4-f418-42fb-ab4f-172b0c456c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:10:04.023580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1145/2277] 10.222.0.41 () {58 vars in 967 bytes} [Mon May 30 12:10:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:10:04.054770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8128f4-f418-42fb-ab4f-172b0c456c23 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:10:04.056896 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1133/2278] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:10:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:10:04.071854 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8128f4-f418-42fb-ab4f-172b0c456c23 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:10:04.077229 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77561f-e447-4a92-9e6d-80500daa5cbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e5f980cdb74227bb31c7e7e5eab74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:10:04.078238 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77561f-e447-4a92-9e6d-80500daa5cbb service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:10:04.079421 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77561f-e447-4a92-9e6d-80500daa5cbb service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:10:04.079421 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77561f-e447-4a92-9e6d-80500daa5cbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:10:04.090171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77561f-e447-4a92-9e6d-80500daa5cbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:10:04.091764 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77561f-e447-4a92-9e6d-80500daa5cbb service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:10:04.102557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1146/2279] 10.222.0.41 () {60 vars in 1384 bytes} [Mon May 30 12:10:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 30 12:10:14.041963 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=25 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:14.097827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=9 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:19.809087 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ce56f-15b9-4794-ac8a-cc7ff1f39b97 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:10:19.820424 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ce56f-15b9-4794-ac8a-cc7ff1f39b97 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:10:19.824193 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c800c6a-91a1-489b-954f-b2e7d5cbecec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:10:19.824844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c800c6a-91a1-489b-954f-b2e7d5cbecec service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:10:19.825130 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c800c6a-91a1-489b-954f-b2e7d5cbecec service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:10:19.825407 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c800c6a-91a1-489b-954f-b2e7d5cbecec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:10:19.827163 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1c800c6a-91a1-489b-954f-b2e7d5cbecec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:10:19.903248 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c800c6a-91a1-489b-954f-b2e7d5cbecec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:10:19.904904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c800c6a-91a1-489b-954f-b2e7d5cbecec service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:10:19.915139 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1134/2280] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:10:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:10:29.910718 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=30 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:33.944616 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e771a8c-2d8e-4762-908c-05c28b82d56b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:10:33.945141 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e771a8c-2d8e-4762-908c-05c28b82d56b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:10:33.945225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e771a8c-2d8e-4762-908c-05c28b82d56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:10:33.963105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3e771a8c-2d8e-4762-908c-05c28b82d56b None None] MFA Rules not processed for user `e12d075bc9144a5e8de3fe53004e9052`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:10:33.964338 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3e771a8c-2d8e-4762-908c-05c28b82d56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:10:34.025651 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1147/2281] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:10:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:10:44.018705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=25 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:16.661333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fde13-e25e-4444-bf55-6eb60c94e781 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:16.661846 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fde13-e25e-4444-bf55-6eb60c94e781 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:16.661950 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fde13-e25e-4444-bf55-6eb60c94e781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:16.679988 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-894fde13-e25e-4444-bf55-6eb60c94e781 None None] MFA Rules not processed for user `dbe77e4880a44d259fac8dfa05722f18`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:11:16.681200 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-894fde13-e25e-4444-bf55-6eb60c94e781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:11:16.688096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1135/2282] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:11:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:11:26.674256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:30.762562 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e43b8d-1910-4417-a689-6cb1d2eb3c03 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:30.763047 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e43b8d-1910-4417-a689-6cb1d2eb3c03 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:30.763152 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e43b8d-1910-4417-a689-6cb1d2eb3c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:30.783798 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-86e43b8d-1910-4417-a689-6cb1d2eb3c03 None None] MFA Rules not processed for user `9c9292fdef7f41af8fcb9375ce1764e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:11:30.785593 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-86e43b8d-1910-4417-a689-6cb1d2eb3c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:11:30.844202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1148/2283] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:11:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:11:34.782908 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fde13-e25e-4444-bf55-6eb60c94e781 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:11:34.793310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fde13-e25e-4444-bf55-6eb60c94e781 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:11:34.797024 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d33ad4-0b6d-4096-95fe-b5b4c8a91d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:11:34.797682 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d33ad4-0b6d-4096-95fe-b5b4c8a91d07 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:34.798108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d33ad4-0b6d-4096-95fe-b5b4c8a91d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:34.798813 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d33ad4-0b6d-4096-95fe-b5b4c8a91d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:34.800856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-40d33ad4-0b6d-4096-95fe-b5b4c8a91d07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:11:34.889981 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d33ad4-0b6d-4096-95fe-b5b4c8a91d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:11:34.892905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d33ad4-0b6d-4096-95fe-b5b4c8a91d07 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:11:34.913139 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1136/2284] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:11:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:11:37.260698 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e43b8d-1910-4417-a689-6cb1d2eb3c03 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:11:37.262120 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-86e43b8d-1910-4417-a689-6cb1d2eb3c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:11:37.274569 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e43b8d-1910-4417-a689-6cb1d2eb3c03 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:11:37.278127 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be8cb1-fb2e-4a77-b0b0-0d4c4968a7df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:11:37.278762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be8cb1-fb2e-4a77-b0b0-0d4c4968a7df service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:37.279056 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be8cb1-fb2e-4a77-b0b0-0d4c4968a7df service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:37.279333 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be8cb1-fb2e-4a77-b0b0-0d4c4968a7df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:37.281048 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-24be8cb1-fb2e-4a77-b0b0-0d4c4968a7df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:11:37.293948 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be8cb1-fb2e-4a77-b0b0-0d4c4968a7df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:11:37.295362 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be8cb1-fb2e-4a77-b0b0-0d4c4968a7df service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:11:37.306649 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1149/2285] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:11:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:11:44.900343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=34 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:47.302013 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=31 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:57.712808 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d33ad4-0b6d-4096-95fe-b5b4c8a91d07 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:11:57.721207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d33ad4-0b6d-4096-95fe-b5b4c8a91d07 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:11:57.725963 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071f941-1570-4d15-a1a6-0d6dba521d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:11:57.726611 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071f941-1570-4d15-a1a6-0d6dba521d67 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:57.726897 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071f941-1570-4d15-a1a6-0d6dba521d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:57.727176 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071f941-1570-4d15-a1a6-0d6dba521d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:57.728974 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a071f941-1570-4d15-a1a6-0d6dba521d67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:11:57.738886 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071f941-1570-4d15-a1a6-0d6dba521d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:11:57.740351 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071f941-1570-4d15-a1a6-0d6dba521d67 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:11:57.748115 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1137/2286] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:11:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:12:01.288426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be8cb1-fb2e-4a77-b0b0-0d4c4968a7df service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:12:01.289903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-24be8cb1-fb2e-4a77-b0b0-0d4c4968a7df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:12:01.304079 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be8cb1-fb2e-4a77-b0b0-0d4c4968a7df service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:12:01.309553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73dfd7-215d-4c5d-9f56-e514e9a8808c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:12:01.310189 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73dfd7-215d-4c5d-9f56-e514e9a8808c service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:12:01.310475 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73dfd7-215d-4c5d-9f56-e514e9a8808c service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:12:01.310755 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73dfd7-215d-4c5d-9f56-e514e9a8808c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:12:01.312474 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-df73dfd7-215d-4c5d-9f56-e514e9a8808c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:12:01.322660 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73dfd7-215d-4c5d-9f56-e514e9a8808c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:12:01.324268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73dfd7-215d-4c5d-9f56-e514e9a8808c service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:12:01.334033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1150/2287] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:12:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:12:07.744649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:11.329084 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:20.958738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071f941-1570-4d15-a1a6-0d6dba521d67 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:12:20.972089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071f941-1570-4d15-a1a6-0d6dba521d67 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:12:20.980836 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ccc37-0133-4f8e-a7ef-63a5b6027448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:12:20.981542 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ccc37-0133-4f8e-a7ef-63a5b6027448 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:12:20.981830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ccc37-0133-4f8e-a7ef-63a5b6027448 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:12:20.982105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ccc37-0133-4f8e-a7ef-63a5b6027448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:12:20.984267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-620ccc37-0133-4f8e-a7ef-63a5b6027448 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:12:20.999856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ccc37-0133-4f8e-a7ef-63a5b6027448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:12:21.001505 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ccc37-0133-4f8e-a7ef-63a5b6027448 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:12:21.016219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1138/2288] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:12:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:12:22.580672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f7c71-bba7-4a4e-b0c9-c406d5af0cb9 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:12:22.581239 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f7c71-bba7-4a4e-b0c9-c406d5af0cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:12:22.581239 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f7c71-bba7-4a4e-b0c9-c406d5af0cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:12:22.599595 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-314f7c71-bba7-4a4e-b0c9-c406d5af0cb9 None None] MFA Rules not processed for user `4e875190d9dc48edb929bb316d5e576e`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:12:22.600764 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-314f7c71-bba7-4a4e-b0c9-c406d5af0cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:12:22.608475 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1151/2289] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:12:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:12:25.140392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7650ad-3a95-44a7-bc81-d47c9b20e025 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:12:25.140913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7650ad-3a95-44a7-bc81-d47c9b20e025 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:12:25.141021 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7650ad-3a95-44a7-bc81-d47c9b20e025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:12:25.160326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8b7650ad-3a95-44a7-bc81-d47c9b20e025 None None] MFA Rules not processed for user `e12d075bc9144a5e8de3fe53004e9052`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:12:25.162317 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8b7650ad-3a95-44a7-bc81-d47c9b20e025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:12:25.169331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1139/2290] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:12:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:12:25.480532 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f7c71-bba7-4a4e-b0c9-c406d5af0cb9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:12:25.490210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f7c71-bba7-4a4e-b0c9-c406d5af0cb9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:12:25.493869 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181a9cf-b550-4f74-9c85-5b3b3c648ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:12:25.494504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181a9cf-b550-4f74-9c85-5b3b3c648ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:12:25.494788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181a9cf-b550-4f74-9c85-5b3b3c648ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:12:25.495067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181a9cf-b550-4f74-9c85-5b3b3c648ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:12:25.496863 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4181a9cf-b550-4f74-9c85-5b3b3c648ea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:12:25.506442 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181a9cf-b550-4f74-9c85-5b3b3c648ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:12:25.508021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181a9cf-b550-4f74-9c85-5b3b3c648ea7 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:12:25.515994 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1152/2291] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:12:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:12:25.840764 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7650ad-3a95-44a7-bc81-d47c9b20e025 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:12:25.852820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7650ad-3a95-44a7-bc81-d47c9b20e025 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:12:25.857947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7a588-477d-4c5a-96a2-d9cacea6d77a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b43eb1a0ac4db5adee3512453459aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:12:25.858591 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7a588-477d-4c5a-96a2-d9cacea6d77a service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:12:25.858873 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7a588-477d-4c5a-96a2-d9cacea6d77a service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:12:25.859155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7a588-477d-4c5a-96a2-d9cacea6d77a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:12:25.860947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-83b7a588-477d-4c5a-96a2-d9cacea6d77a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:12:25.872737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7a588-477d-4c5a-96a2-d9cacea6d77a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:12:25.877345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7a588-477d-4c5a-96a2-d9cacea6d77a service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:12:25.888247 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1140/2292] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:12:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:12:27.627687 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181a9cf-b550-4f74-9c85-5b3b3c648ea7 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:12:27.642464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181a9cf-b550-4f74-9c85-5b3b3c648ea7 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:12:27.647458 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4bbfa-2b25-48d3-8a52-5466ce7437a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:12:27.648396 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4bbfa-2b25-48d3-8a52-5466ce7437a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:12:27.648712 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4bbfa-2b25-48d3-8a52-5466ce7437a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:12:27.648992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4bbfa-2b25-48d3-8a52-5466ce7437a7 admin admin] PATH_INFO: `/v3/users/dbe77e4880a44d259fac8dfa05722f18` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:12:27.650197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4bbfa-2b25-48d3-8a52-5466ce7437a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbe77e4880a44d259fac8dfa05722f18)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:12:27.652193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4bbfa-2b25-48d3-8a52-5466ce7437a7 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:12:27.699810 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f9e4bbfa-2b25-48d3-8a52-5466ce7437a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbe77e4880a44d259fac8dfa05722f18'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:12:27.708589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f9e4bbfa-2b25-48d3-8a52-5466ce7437a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbe77e4880a44d259fac8dfa05722f18'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:12:27.720985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f9e4bbfa-2b25-48d3-8a52-5466ce7437a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbe77e4880a44d259fac8dfa05722f18'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:12:27.721672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f9e4bbfa-2b25-48d3-8a52-5466ce7437a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbe77e4880a44d259fac8dfa05722f18'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:12:27.729802 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f9e4bbfa-2b25-48d3-8a52-5466ce7437a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbe77e4880a44d259fac8dfa05722f18'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:12:27.735997 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1153/2293] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:12:27 2022] DELETE /identity/v3/users/dbe77e4880a44d259fac8dfa05722f18 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:12:27.938401 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7a588-477d-4c5a-96a2-d9cacea6d77a service placement] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:12:27.953030 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7a588-477d-4c5a-96a2-d9cacea6d77a service placement] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:12:28.054926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f5636-04bc-476d-8ffd-15761ca27dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:12:28.055997 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f5636-04bc-476d-8ffd-15761ca27dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:12:28.056508 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f5636-04bc-476d-8ffd-15761ca27dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:12:28.056781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f5636-04bc-476d-8ffd-15761ca27dc2 admin admin] PATH_INFO: `/v3/projects/4d363027ab254adfb4ba1b13de71d7e7` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:12:28.060827 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f5636-04bc-476d-8ffd-15761ca27dc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d363027ab254adfb4ba1b13de71d7e7)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:12:28.064239 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f5636-04bc-476d-8ffd-15761ca27dc2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:12:28.163629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cc3f5636-04bc-476d-8ffd-15761ca27dc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d363027ab254adfb4ba1b13de71d7e7', 'request_id': 'req-cc3f5636-04bc-476d-8ffd-15761ca27dc2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:12:28.176053 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cc3f5636-04bc-476d-8ffd-15761ca27dc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d363027ab254adfb4ba1b13de71d7e7', 'request_id': 'req-cc3f5636-04bc-476d-8ffd-15761ca27dc2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:12:28.190234 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cc3f5636-04bc-476d-8ffd-15761ca27dc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d363027ab254adfb4ba1b13de71d7e7', 'request_id': 'req-cc3f5636-04bc-476d-8ffd-15761ca27dc2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:12:28.205472 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cc3f5636-04bc-476d-8ffd-15761ca27dc2 admin admin] The token cache is being invalidate because project 4d363027ab254adfb4ba1b13de71d7e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:12:28.205797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cc3f5636-04bc-476d-8ffd-15761ca27dc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:12:28.207398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cc3f5636-04bc-476d-8ffd-15761ca27dc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:12:28.211435 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1141/2294] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:12:27 2022] DELETE /identity/v3/projects/4d363027ab254adfb4ba1b13de71d7e7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:12:34.387024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4bbfa-2b25-48d3-8a52-5466ce7437a7 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:12:34.388502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f9e4bbfa-2b25-48d3-8a52-5466ce7437a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:12:34.462237 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4bbfa-2b25-48d3-8a52-5466ce7437a7 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:12:34.509034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:34.528415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05072175-c574-46a4-8241-dd2bc48e8bb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:12:34.529051 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05072175-c574-46a4-8241-dd2bc48e8bb5 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:12:34.529341 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05072175-c574-46a4-8241-dd2bc48e8bb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:12:34.529624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05072175-c574-46a4-8241-dd2bc48e8bb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:12:34.531418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-05072175-c574-46a4-8241-dd2bc48e8bb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:12:34.590779 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05072175-c574-46a4-8241-dd2bc48e8bb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:12:34.592390 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05072175-c574-46a4-8241-dd2bc48e8bb5 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:12:34.601474 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1154/2295] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:12:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:12:35.524564 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f5636-04bc-476d-8ffd-15761ca27dc2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:12:35.526089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cc3f5636-04bc-476d-8ffd-15761ca27dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:12:35.546329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f5636-04bc-476d-8ffd-15761ca27dc2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:12:35.552152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce5a69-c86b-482e-8170-86f05f913a74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:12:35.552750 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce5a69-c86b-482e-8170-86f05f913a74 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:12:35.553037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce5a69-c86b-482e-8170-86f05f913a74 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:12:35.553315 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce5a69-c86b-482e-8170-86f05f913a74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:12:35.555126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-69ce5a69-c86b-482e-8170-86f05f913a74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:12:35.568533 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce5a69-c86b-482e-8170-86f05f913a74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:12:35.570139 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce5a69-c86b-482e-8170-86f05f913a74 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:12:35.580953 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1142/2296] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:12:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:12:36.124318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05072175-c574-46a4-8241-dd2bc48e8bb5 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:12:36.125691 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-05072175-c574-46a4-8241-dd2bc48e8bb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:12:36.182363 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05072175-c574-46a4-8241-dd2bc48e8bb5 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:12:36.186003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8dc88-e01a-4f8c-97f9-5678955c3d2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:12:36.186645 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8dc88-e01a-4f8c-97f9-5678955c3d2c service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:12:36.186935 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8dc88-e01a-4f8c-97f9-5678955c3d2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:12:36.187215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8dc88-e01a-4f8c-97f9-5678955c3d2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:12:36.189865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-61e8dc88-e01a-4f8c-97f9-5678955c3d2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:12:36.248693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8dc88-e01a-4f8c-97f9-5678955c3d2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:12:36.250126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8dc88-e01a-4f8c-97f9-5678955c3d2c service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:12:36.260413 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1155/2297] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:12:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:12:40.134596 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce5a69-c86b-482e-8170-86f05f913a74 service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:12:40.152535 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce5a69-c86b-482e-8170-86f05f913a74 service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:12:40.163730 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507da4f-94d2-49e8-aa0a-7e43bd3ac255 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:12:40.164595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507da4f-94d2-49e8-aa0a-7e43bd3ac255 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:12:40.165007 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507da4f-94d2-49e8-aa0a-7e43bd3ac255 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:12:40.165396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507da4f-94d2-49e8-aa0a-7e43bd3ac255 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:12:40.167497 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2507da4f-94d2-49e8-aa0a-7e43bd3ac255 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:12:40.185553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507da4f-94d2-49e8-aa0a-7e43bd3ac255 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:12:40.187382 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507da4f-94d2-49e8-aa0a-7e43bd3ac255 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:12:40.208240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1143/2298] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:12:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:12:43.314871 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad2025-41ad-42a0-8f76-0fb6ab4a4209 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:12:43.315315 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad2025-41ad-42a0-8f76-0fb6ab4a4209 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:12:43.315449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad2025-41ad-42a0-8f76-0fb6ab4a4209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:12:43.333141 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-50ad2025-41ad-42a0-8f76-0fb6ab4a4209 None None] MFA Rules not processed for user `5ee1e385f10e4ed4849ef2febc22e497`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:12:43.334371 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-50ad2025-41ad-42a0-8f76-0fb6ab4a4209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:12:43.341255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1156/2299] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:12:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:12:50.200375 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:53.328329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=84 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:59.459416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf6ee9-a034-4866-ad5e-97afdb5249bf None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:12:59.459988 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf6ee9-a034-4866-ad5e-97afdb5249bf None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:12:59.460173 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf6ee9-a034-4866-ad5e-97afdb5249bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:12:59.492166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d8bf6ee9-a034-4866-ad5e-97afdb5249bf None None] MFA Rules not processed for user `a63dd78421064bbe838b1ed0261c13bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:12:59.493871 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d8bf6ee9-a034-4866-ad5e-97afdb5249bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:12:59.556365 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1144/2300] 10.222.0.41 () {58 vars in 1009 bytes} [Mon May 30 12:12:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:12:59.624548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad2025-41ad-42a0-8f76-0fb6ab4a4209 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:12:59.626810 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-50ad2025-41ad-42a0-8f76-0fb6ab4a4209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:12:59.709176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad2025-41ad-42a0-8f76-0fb6ab4a4209 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:12:59.714957 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247635ef-9cc3-4f04-9387-8e2f2e57424b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e5f980cdb74227bb31c7e7e5eab74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:12:59.715661 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247635ef-9cc3-4f04-9387-8e2f2e57424b service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:12:59.716032 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247635ef-9cc3-4f04-9387-8e2f2e57424b service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:12:59.716316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247635ef-9cc3-4f04-9387-8e2f2e57424b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:12:59.726128 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247635ef-9cc3-4f04-9387-8e2f2e57424b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:12:59.727724 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247635ef-9cc3-4f04-9387-8e2f2e57424b service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:12:59.737907 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1157/2301] 10.222.0.41 () {60 vars in 1384 bytes} [Mon May 30 12:12:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:13:02.404131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56f390-f8a4-4f65-b194-0ad2677cb714 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:02.405065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56f390-f8a4-4f65-b194-0ad2677cb714 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:02.405518 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56f390-f8a4-4f65-b194-0ad2677cb714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:02.429389 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-bf56f390-f8a4-4f65-b194-0ad2677cb714 None None] MFA Rules not processed for user `f7e7ce32b4c0457196c8765d6c5ada7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:02.430658 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bf56f390-f8a4-4f65-b194-0ad2677cb714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:02.504404 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1145/2302] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:13:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:02.869734 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247635ef-9cc3-4f04-9387-8e2f2e57424b service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:02.871245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-247635ef-9cc3-4f04-9387-8e2f2e57424b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:02.936842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247635ef-9cc3-4f04-9387-8e2f2e57424b service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:02.940733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c3f19-bff4-4182-bc24-ac4b7d7961c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:02.941389 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c3f19-bff4-4182-bc24-ac4b7d7961c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:02.941671 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c3f19-bff4-4182-bc24-ac4b7d7961c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:02.941955 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c3f19-bff4-4182-bc24-ac4b7d7961c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:02.943740 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-271c3f19-bff4-4182-bc24-ac4b7d7961c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:02.954197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c3f19-bff4-4182-bc24-ac4b7d7961c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:02.956910 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c3f19-bff4-4182-bc24-ac4b7d7961c9 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:02.968125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1158/2303] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:13:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:13:10.292457 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56f390-f8a4-4f65-b194-0ad2677cb714 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:10.306438 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56f390-f8a4-4f65-b194-0ad2677cb714 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:10.311687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d973cad-d4bf-44a8-8b95-664e917afd9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:10.312350 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d973cad-d4bf-44a8-8b95-664e917afd9c service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:10.312635 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d973cad-d4bf-44a8-8b95-664e917afd9c service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:10.312908 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d973cad-d4bf-44a8-8b95-664e917afd9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:10.314664 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6d973cad-d4bf-44a8-8b95-664e917afd9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:10.374563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d973cad-d4bf-44a8-8b95-664e917afd9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:10.376217 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d973cad-d4bf-44a8-8b95-664e917afd9c service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:10.385382 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1146/2304] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:13:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:13:12.962812 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=58 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:20.381383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=78 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:25.534268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfe055-b1ea-4f64-b64b-2918e82acc48 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:25.535208 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfe055-b1ea-4f64-b64b-2918e82acc48 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:25.535518 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfe055-b1ea-4f64-b64b-2918e82acc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:25.560377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e3bfe055-b1ea-4f64-b64b-2918e82acc48 None None] MFA Rules not processed for user `a63dd78421064bbe838b1ed0261c13bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:25.562004 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e3bfe055-b1ea-4f64-b64b-2918e82acc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:25.570132 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1159/2305] 10.222.0.41 () {58 vars in 1009 bytes} [Mon May 30 12:13:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:13:25.590823 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d973cad-d4bf-44a8-8b95-664e917afd9c service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:25.608497 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d973cad-d4bf-44a8-8b95-664e917afd9c service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:25.617700 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43196a-38a9-4780-a292-4f8fbb316ad2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e5f980cdb74227bb31c7e7e5eab74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:25.618482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43196a-38a9-4780-a292-4f8fbb316ad2 service swift] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:25.618869 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43196a-38a9-4780-a292-4f8fbb316ad2 service swift] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:25.619251 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43196a-38a9-4780-a292-4f8fbb316ad2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:25.645565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43196a-38a9-4780-a292-4f8fbb316ad2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:25.645565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43196a-38a9-4780-a292-4f8fbb316ad2 service swift] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:25.669406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1147/2306] 10.222.0.41 () {60 vars in 1384 bytes} [Mon May 30 12:13:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:13:35.554613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:35.661545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:42.936752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bdc72-9fdd-4278-af4b-225f409aa647 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:42.937208 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bdc72-9fdd-4278-af4b-225f409aa647 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:42.937315 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bdc72-9fdd-4278-af4b-225f409aa647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:42.955886 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-881bdc72-9fdd-4278-af4b-225f409aa647 None None] MFA Rules not processed for user `a63dd78421064bbe838b1ed0261c13bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:42.957287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-881bdc72-9fdd-4278-af4b-225f409aa647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:42.964517 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1160/2307] 10.222.0.41 () {58 vars in 967 bytes} [Mon May 30 12:13:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:42.977949 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43196a-38a9-4780-a292-4f8fbb316ad2 service swift] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:42.988870 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43196a-38a9-4780-a292-4f8fbb316ad2 service swift] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:42.993965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96706e90-9f84-4bee-a983-f224f7a3d2bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e5f980cdb74227bb31c7e7e5eab74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:42.994614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96706e90-9f84-4bee-a983-f224f7a3d2bb service swift] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:42.995012 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96706e90-9f84-4bee-a983-f224f7a3d2bb service swift] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:42.995303 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96706e90-9f84-4bee-a983-f224f7a3d2bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:43.004001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96706e90-9f84-4bee-a983-f224f7a3d2bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:43.005628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96706e90-9f84-4bee-a983-f224f7a3d2bb service swift] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:43.013790 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1148/2308] 10.222.0.41 () {60 vars in 1384 bytes} [Mon May 30 12:13:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:13:45.006429 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bdc72-9fdd-4278-af4b-225f409aa647 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:45.007900 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-881bdc72-9fdd-4278-af4b-225f409aa647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:45.019322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bdc72-9fdd-4278-af4b-225f409aa647 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:45.022997 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadc152-362e-4dae-82d5-1f390febbbf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:45.023717 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadc152-362e-4dae-82d5-1f390febbbf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:45.024099 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadc152-362e-4dae-82d5-1f390febbbf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:45.024444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadc152-362e-4dae-82d5-1f390febbbf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:45.026235 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-efadc152-362e-4dae-82d5-1f390febbbf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:45.091440 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efadc152-362e-4dae-82d5-1f390febbbf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:45.092933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efadc152-362e-4dae-82d5-1f390febbbf4 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:45.103473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1161/2309] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:13:48.540902 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96706e90-9f84-4bee-a983-f224f7a3d2bb service swift] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:48.542457 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-96706e90-9f84-4bee-a983-f224f7a3d2bb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:48.597285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadc152-362e-4dae-82d5-1f390febbbf4 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:48.599724 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-efadc152-362e-4dae-82d5-1f390febbbf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:48.628025 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadc152-362e-4dae-82d5-1f390febbbf4 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:48.634491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b43cd-98fd-48bb-af83-173ae9ceda15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:48.635477 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b43cd-98fd-48bb-af83-173ae9ceda15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:48.635927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b43cd-98fd-48bb-af83-173ae9ceda15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:48.636462 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b43cd-98fd-48bb-af83-173ae9ceda15 admin admin] PATH_INFO: `/v3/users/4e875190d9dc48edb929bb316d5e576e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:48.638382 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b43cd-98fd-48bb-af83-173ae9ceda15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e875190d9dc48edb929bb316d5e576e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:48.641512 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b43cd-98fd-48bb-af83-173ae9ceda15 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:48.658226 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96706e90-9f84-4bee-a983-f224f7a3d2bb service swift] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:48.669463 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad6c15-7ee2-432f-bc65-7989f866e9c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b43eb1a0ac4db5adee3512453459aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:48.670424 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad6c15-7ee2-432f-bc65-7989f866e9c4 service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:48.670713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad6c15-7ee2-432f-bc65-7989f866e9c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:48.671080 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad6c15-7ee2-432f-bc65-7989f866e9c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:48.678501 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f0ad6c15-7ee2-432f-bc65-7989f866e9c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:48.696423 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad6c15-7ee2-432f-bc65-7989f866e9c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:48.698197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad6c15-7ee2-432f-bc65-7989f866e9c4 service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:48.709580 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1149/2310] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:13:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:13:48.711890 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e0b43cd-98fd-48bb-af83-173ae9ceda15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e875190d9dc48edb929bb316d5e576e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:48.732370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e0b43cd-98fd-48bb-af83-173ae9ceda15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e875190d9dc48edb929bb316d5e576e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:48.749597 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e0b43cd-98fd-48bb-af83-173ae9ceda15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e875190d9dc48edb929bb316d5e576e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:48.750525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e0b43cd-98fd-48bb-af83-173ae9ceda15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e875190d9dc48edb929bb316d5e576e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:48.760889 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e0b43cd-98fd-48bb-af83-173ae9ceda15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e875190d9dc48edb929bb316d5e576e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:48.779245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1162/2311] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:13:48 2022] DELETE /identity/v3/users/4e875190d9dc48edb929bb316d5e576e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:13:48.987219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad6c15-7ee2-432f-bc65-7989f866e9c4 service placement] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:49.003979 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad6c15-7ee2-432f-bc65-7989f866e9c4 service placement] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:49.109691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab505c5-8cd2-47d5-aa1d-db8972f08931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:49.110548 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab505c5-8cd2-47d5-aa1d-db8972f08931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:49.110831 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab505c5-8cd2-47d5-aa1d-db8972f08931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:49.111215 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab505c5-8cd2-47d5-aa1d-db8972f08931 admin admin] PATH_INFO: `/v3/projects/66312b3f3f73477cbe27defa317537a4` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:49.114066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab505c5-8cd2-47d5-aa1d-db8972f08931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66312b3f3f73477cbe27defa317537a4)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:49.114905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab505c5-8cd2-47d5-aa1d-db8972f08931 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:49.168637 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-aab505c5-8cd2-47d5-aa1d-db8972f08931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66312b3f3f73477cbe27defa317537a4', 'request_id': 'req-aab505c5-8cd2-47d5-aa1d-db8972f08931'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:49.180387 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-aab505c5-8cd2-47d5-aa1d-db8972f08931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66312b3f3f73477cbe27defa317537a4', 'request_id': 'req-aab505c5-8cd2-47d5-aa1d-db8972f08931'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:49.187701 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-aab505c5-8cd2-47d5-aa1d-db8972f08931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66312b3f3f73477cbe27defa317537a4', 'request_id': 'req-aab505c5-8cd2-47d5-aa1d-db8972f08931'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:49.206412 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-aab505c5-8cd2-47d5-aa1d-db8972f08931 admin admin] The token cache is being invalidate because project 66312b3f3f73477cbe27defa317537a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:13:49.206826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-aab505c5-8cd2-47d5-aa1d-db8972f08931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:49.207619 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-aab505c5-8cd2-47d5-aa1d-db8972f08931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:49.209677 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1150/2312] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:13:48 2022] DELETE /identity/v3/projects/66312b3f3f73477cbe27defa317537a4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:13:49.214599 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e06f3-87ac-4327-be80-6bd1415f2f50 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:49.214773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e06f3-87ac-4327-be80-6bd1415f2f50 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:49.214967 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e06f3-87ac-4327-be80-6bd1415f2f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:49.237611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0d6e06f3-87ac-4327-be80-6bd1415f2f50 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:49.238876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0d6e06f3-87ac-4327-be80-6bd1415f2f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:49.316319 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:49.327882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1163/2313] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:13:49.336442 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8ccda-345d-4492-bc30-b87cbf52c769 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:49.336695 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8ccda-345d-4492-bc30-b87cbf52c769 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:49.336971 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8ccda-345d-4492-bc30-b87cbf52c769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:49.349709 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:49.357295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6ae8ccda-345d-4492-bc30-b87cbf52c769 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:49.359185 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6ae8ccda-345d-4492-bc30-b87cbf52c769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:49.369733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1151/2314] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:49.373730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e06f3-87ac-4327-be80-6bd1415f2f50 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:49.384537 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e06f3-87ac-4327-be80-6bd1415f2f50 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:49.389347 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5864b27-6a30-406a-810c-28531564f668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:49.390042 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5864b27-6a30-406a-810c-28531564f668 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:49.390329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5864b27-6a30-406a-810c-28531564f668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:49.390609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5864b27-6a30-406a-810c-28531564f668 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:49.391356 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5864b27-6a30-406a-810c-28531564f668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:13:49.391671 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5864b27-6a30-406a-810c-28531564f668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:49.393384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5864b27-6a30-406a-810c-28531564f668 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:49.405444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1164/2315] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:13:49.409905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8ccda-345d-4492-bc30-b87cbf52c769 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:49.419203 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8ccda-345d-4492-bc30-b87cbf52c769 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:49.424337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef61fe-38b2-4842-9904-5374b9fb3c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:49.425001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef61fe-38b2-4842-9904-5374b9fb3c69 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:49.425286 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef61fe-38b2-4842-9904-5374b9fb3c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:49.425589 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef61fe-38b2-4842-9904-5374b9fb3c69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:49.426251 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef61fe-38b2-4842-9904-5374b9fb3c69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:49.428264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef61fe-38b2-4842-9904-5374b9fb3c69 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:49.463962 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1152/2316] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:13:49 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:13:49.468290 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5864b27-6a30-406a-810c-28531564f668 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:49.478832 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5864b27-6a30-406a-810c-28531564f668 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:49.542152 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c386011-8f75-47ed-8d5f-442d300e97c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:49.543146 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c386011-8f75-47ed-8d5f-442d300e97c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:49.543427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c386011-8f75-47ed-8d5f-442d300e97c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:49.543708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c386011-8f75-47ed-8d5f-442d300e97c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:49.544463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c386011-8f75-47ed-8d5f-442d300e97c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:49.546442 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c386011-8f75-47ed-8d5f-442d300e97c6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:49.571845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1165/2317] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:13:49 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:13:49.573332 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef61fe-38b2-4842-9904-5374b9fb3c69 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:49.586726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef61fe-38b2-4842-9904-5374b9fb3c69 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:49.592763 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466da6d2-59c3-409f-acc6-de872c34f8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:49.593548 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466da6d2-59c3-409f-acc6-de872c34f8fc admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:49.593839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466da6d2-59c3-409f-acc6-de872c34f8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:49.594118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466da6d2-59c3-409f-acc6-de872c34f8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:49.594880 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466da6d2-59c3-409f-acc6-de872c34f8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:49.597267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466da6d2-59c3-409f-acc6-de872c34f8fc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:49.607733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1153/2318] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:13:49.612619 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c386011-8f75-47ed-8d5f-442d300e97c6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:49.623613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c386011-8f75-47ed-8d5f-442d300e97c6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:49.628588 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e04ad2-4d10-4bcf-b1fe-9e4f4936be0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:49.629256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e04ad2-4d10-4bcf-b1fe-9e4f4936be0a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:49.629541 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e04ad2-4d10-4bcf-b1fe-9e4f4936be0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:49.629815 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e04ad2-4d10-4bcf-b1fe-9e4f4936be0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:49.630712 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e04ad2-4d10-4bcf-b1fe-9e4f4936be0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:49.632357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e04ad2-4d10-4bcf-b1fe-9e4f4936be0a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:49.642916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1166/2319] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:13:49.647094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466da6d2-59c3-409f-acc6-de872c34f8fc admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:49.657636 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466da6d2-59c3-409f-acc6-de872c34f8fc admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:49.663929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04115b5-c3e6-41cb-841f-d4c1d4bf980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:49.664960 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04115b5-c3e6-41cb-841f-d4c1d4bf980d admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:49.665321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04115b5-c3e6-41cb-841f-d4c1d4bf980d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:49.665672 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04115b5-c3e6-41cb-841f-d4c1d4bf980d admin admin] PATH_INFO: `/v3/projects/418a172505534f5084b2fb0ee0ba7cc3/users/af7cd8fc3dba4cc6821dfa5597af4367/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:49.683766 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04115b5-c3e6-41cb-841f-d4c1d4bf980d admin admin] RBAC: Authorizing `identity:create_grant(project_id=418a172505534f5084b2fb0ee0ba7cc3, user_id=af7cd8fc3dba4cc6821dfa5597af4367, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:49.686521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04115b5-c3e6-41cb-841f-d4c1d4bf980d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:49.703505 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1154/2320] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:13:49 2022] PUT /identity/v3/projects/418a172505534f5084b2fb0ee0ba7cc3/users/af7cd8fc3dba4cc6821dfa5597af4367/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:13:49.714277 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f6bef-5f26-4f66-94fc-06b5afd09ec3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:49.714572 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f6bef-5f26-4f66-94fc-06b5afd09ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:49.714857 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f6bef-5f26-4f66-94fc-06b5afd09ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:49.746556 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a33f6bef-5f26-4f66-94fc-06b5afd09ec3 None None] MFA Rules not processed for user `af7cd8fc3dba4cc6821dfa5597af4367`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:49.748113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a33f6bef-5f26-4f66-94fc-06b5afd09ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:49.826197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1167/2321] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:13:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:13:49.831053 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04115b5-c3e6-41cb-841f-d4c1d4bf980d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:49.905437 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04115b5-c3e6-41cb-841f-d4c1d4bf980d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:49.910383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11144862-4d0c-456c-8d33-04c5a9c5cb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:49.911059 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11144862-4d0c-456c-8d33-04c5a9c5cb04 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:49.911348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11144862-4d0c-456c-8d33-04c5a9c5cb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:49.911624 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11144862-4d0c-456c-8d33-04c5a9c5cb04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:49.912361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11144862-4d0c-456c-8d33-04c5a9c5cb04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:49.914272 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11144862-4d0c-456c-8d33-04c5a9c5cb04 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:49.942060 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1155/2322] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:13:49 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:13:49.946093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f6bef-5f26-4f66-94fc-06b5afd09ec3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:49.957568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f6bef-5f26-4f66-94fc-06b5afd09ec3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:50.009776 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:50.018800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b40b1-9d2d-4058-904e-48d480f0e2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:50.019480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b40b1-9d2d-4058-904e-48d480f0e2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:50.019796 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b40b1-9d2d-4058-904e-48d480f0e2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:50.020107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b40b1-9d2d-4058-904e-48d480f0e2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:50.020816 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b40b1-9d2d-4058-904e-48d480f0e2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:50.022790 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b40b1-9d2d-4058-904e-48d480f0e2c2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:50.048873 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1168/2323] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:13:49 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:13:50.052485 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11144862-4d0c-456c-8d33-04c5a9c5cb04 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:50.063205 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11144862-4d0c-456c-8d33-04c5a9c5cb04 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:50.068292 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaaa36a-6af3-4308-bb8c-1b07fa724003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:50.068972 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaa36a-6af3-4308-bb8c-1b07fa724003 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:50.069289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaa36a-6af3-4308-bb8c-1b07fa724003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:50.069617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaa36a-6af3-4308-bb8c-1b07fa724003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:50.070425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaaa36a-6af3-4308-bb8c-1b07fa724003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:50.071969 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaaa36a-6af3-4308-bb8c-1b07fa724003 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:50.083506 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1156/2324] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:13:50.087541 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b40b1-9d2d-4058-904e-48d480f0e2c2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:50.098842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b40b1-9d2d-4058-904e-48d480f0e2c2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:50.104089 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83d79-ef38-4920-9b97-25789e80f271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:50.104972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83d79-ef38-4920-9b97-25789e80f271 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:50.105279 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83d79-ef38-4920-9b97-25789e80f271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:50.105557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83d79-ef38-4920-9b97-25789e80f271 admin admin] PATH_INFO: `/v3/projects/c6e948e491ae4c71a1c8ab4f68a42858/users/5b282e809b4547c5a96bdcad361ed73e/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:50.120308 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e83d79-ef38-4920-9b97-25789e80f271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e948e491ae4c71a1c8ab4f68a42858, user_id=5b282e809b4547c5a96bdcad361ed73e, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:50.123043 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e83d79-ef38-4920-9b97-25789e80f271 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:50.136220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1169/2325] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:13:50 2022] PUT /identity/v3/projects/c6e948e491ae4c71a1c8ab4f68a42858/users/5b282e809b4547c5a96bdcad361ed73e/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:13:50.139918 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaaa36a-6af3-4308-bb8c-1b07fa724003 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:50.150486 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaaa36a-6af3-4308-bb8c-1b07fa724003 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:50.208600 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639b18c-8146-4072-a634-b46b090dafa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:50.209270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639b18c-8146-4072-a634-b46b090dafa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:50.209557 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639b18c-8146-4072-a634-b46b090dafa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:50.209839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639b18c-8146-4072-a634-b46b090dafa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:50.210569 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639b18c-8146-4072-a634-b46b090dafa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:50.212264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639b18c-8146-4072-a634-b46b090dafa9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:50.221988 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1157/2326] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:13:50.226220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83d79-ef38-4920-9b97-25789e80f271 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:50.237344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83d79-ef38-4920-9b97-25789e80f271 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:50.241891 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef4cdb-ffd0-4a89-b02a-3d677f6c7d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:50.242878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef4cdb-ffd0-4a89-b02a-3d677f6c7d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:50.243168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef4cdb-ffd0-4a89-b02a-3d677f6c7d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:50.243447 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef4cdb-ffd0-4a89-b02a-3d677f6c7d4c admin admin] PATH_INFO: `/v3/projects/c6e948e491ae4c71a1c8ab4f68a42858/users/5b282e809b4547c5a96bdcad361ed73e/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:50.245449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef4cdb-ffd0-4a89-b02a-3d677f6c7d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e948e491ae4c71a1c8ab4f68a42858, user_id=5b282e809b4547c5a96bdcad361ed73e, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:50.248100 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef4cdb-ffd0-4a89-b02a-3d677f6c7d4c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:50.259000 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1170/2327] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:13:50 2022] PUT /identity/v3/projects/c6e948e491ae4c71a1c8ab4f68a42858/users/5b282e809b4547c5a96bdcad361ed73e/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:13:50.270193 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0888f67-d23c-4151-b369-845941e90fa7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:50.270490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0888f67-d23c-4151-b369-845941e90fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:50.270776 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0888f67-d23c-4151-b369-845941e90fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:50.277586 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:50.299179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f0888f67-d23c-4151-b369-845941e90fa7 None None] MFA Rules not processed for user `5b282e809b4547c5a96bdcad361ed73e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:50.300605 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f0888f67-d23c-4151-b369-845941e90fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:50.367251 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1158/2328] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:13:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:50.378411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef4cdb-ffd0-4a89-b02a-3d677f6c7d4c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:50.380251 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cdef4cdb-ffd0-4a89-b02a-3d677f6c7d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:50.437072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef4cdb-ffd0-4a89-b02a-3d677f6c7d4c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:50.440846 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abdcfd-8611-4647-b1bb-e20556d575a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:50.441490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abdcfd-8611-4647-b1bb-e20556d575a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:50.441777 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abdcfd-8611-4647-b1bb-e20556d575a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:50.442061 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abdcfd-8611-4647-b1bb-e20556d575a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:50.451068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abdcfd-8611-4647-b1bb-e20556d575a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:50.452534 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abdcfd-8611-4647-b1bb-e20556d575a1 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:50.461900 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1171/2329] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:13:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:13:50.590952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0888f67-d23c-4151-b369-845941e90fa7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:50.661055 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0888f67-d23c-4151-b369-845941e90fa7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:50.665515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d151337-2039-40f1-a4a7-6baf4aa5840b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:50.666398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d151337-2039-40f1-a4a7-6baf4aa5840b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:50.666680 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d151337-2039-40f1-a4a7-6baf4aa5840b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:50.666959 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d151337-2039-40f1-a4a7-6baf4aa5840b admin admin] PATH_INFO: `/v3/users/af7cd8fc3dba4cc6821dfa5597af4367` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:50.668173 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d151337-2039-40f1-a4a7-6baf4aa5840b admin admin] RBAC: Authorizing `identity:delete_user(user_id=af7cd8fc3dba4cc6821dfa5597af4367)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:50.670091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d151337-2039-40f1-a4a7-6baf4aa5840b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:50.721041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4d151337-2039-40f1-a4a7-6baf4aa5840b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af7cd8fc3dba4cc6821dfa5597af4367'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:50.728295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4d151337-2039-40f1-a4a7-6baf4aa5840b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af7cd8fc3dba4cc6821dfa5597af4367'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:50.742970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4d151337-2039-40f1-a4a7-6baf4aa5840b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af7cd8fc3dba4cc6821dfa5597af4367'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:50.743745 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4d151337-2039-40f1-a4a7-6baf4aa5840b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af7cd8fc3dba4cc6821dfa5597af4367'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:50.744418 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4d151337-2039-40f1-a4a7-6baf4aa5840b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af7cd8fc3dba4cc6821dfa5597af4367'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:50.757926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1159/2330] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:13:50 2022] DELETE /identity/v3/users/af7cd8fc3dba4cc6821dfa5597af4367 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:13:50.762354 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76103ac2-6091-4bf6-b1bf-e5d073e3d599 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:50.762846 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76103ac2-6091-4bf6-b1bf-e5d073e3d599 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:50.762965 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76103ac2-6091-4bf6-b1bf-e5d073e3d599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:50.785525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-76103ac2-6091-4bf6-b1bf-e5d073e3d599 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:50.786859 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-76103ac2-6091-4bf6-b1bf-e5d073e3d599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:50.873962 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1172/2331] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:50.883598 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d151337-2039-40f1-a4a7-6baf4aa5840b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:50.885085 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4d151337-2039-40f1-a4a7-6baf4aa5840b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:50.900273 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:50.953191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d151337-2039-40f1-a4a7-6baf4aa5840b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:50.957843 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e62fc7-9bff-40df-8e34-560994a0754e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:50.958627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e62fc7-9bff-40df-8e34-560994a0754e service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:50.958980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e62fc7-9bff-40df-8e34-560994a0754e service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:50.959332 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e62fc7-9bff-40df-8e34-560994a0754e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:50.971020 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e62fc7-9bff-40df-8e34-560994a0754e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:50.972492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e62fc7-9bff-40df-8e34-560994a0754e service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:50.982421 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1160/2332] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:13:51.378509 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76103ac2-6091-4bf6-b1bf-e5d073e3d599 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:51.381644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-76103ac2-6091-4bf6-b1bf-e5d073e3d599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:51.402447 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76103ac2-6091-4bf6-b1bf-e5d073e3d599 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:51.408895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649560d-6ccc-49f0-af16-b76fabec4b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:51.410734 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649560d-6ccc-49f0-af16-b76fabec4b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:51.411055 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649560d-6ccc-49f0-af16-b76fabec4b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:51.411448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649560d-6ccc-49f0-af16-b76fabec4b5e admin admin] PATH_INFO: `/v3/projects/418a172505534f5084b2fb0ee0ba7cc3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:51.412992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649560d-6ccc-49f0-af16-b76fabec4b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=418a172505534f5084b2fb0ee0ba7cc3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:51.415464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649560d-6ccc-49f0-af16-b76fabec4b5e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:51.466890 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:51.469698 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d649560d-6ccc-49f0-af16-b76fabec4b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '418a172505534f5084b2fb0ee0ba7cc3', 'request_id': 'req-d649560d-6ccc-49f0-af16-b76fabec4b5e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:51.479100 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d649560d-6ccc-49f0-af16-b76fabec4b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '418a172505534f5084b2fb0ee0ba7cc3', 'request_id': 'req-d649560d-6ccc-49f0-af16-b76fabec4b5e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:51.488450 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d649560d-6ccc-49f0-af16-b76fabec4b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '418a172505534f5084b2fb0ee0ba7cc3', 'request_id': 'req-d649560d-6ccc-49f0-af16-b76fabec4b5e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:51.501240 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d649560d-6ccc-49f0-af16-b76fabec4b5e admin admin] The token cache is being invalidate because project 418a172505534f5084b2fb0ee0ba7cc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:13:51.501532 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d649560d-6ccc-49f0-af16-b76fabec4b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:51.502767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d649560d-6ccc-49f0-af16-b76fabec4b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:51.504345 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1173/2333] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:13:51 2022] DELETE /identity/v3/projects/418a172505534f5084b2fb0ee0ba7cc3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:13:51.508381 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e62fc7-9bff-40df-8e34-560994a0754e service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:51.518411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e62fc7-9bff-40df-8e34-560994a0754e service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:51.574711 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d9983-48c8-4f20-aa45-cf39611b46d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:51.575579 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d9983-48c8-4f20-aa45-cf39611b46d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:51.575900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d9983-48c8-4f20-aa45-cf39611b46d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:51.576180 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d9983-48c8-4f20-aa45-cf39611b46d5 admin admin] PATH_INFO: `/v3/users/5b282e809b4547c5a96bdcad361ed73e` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:51.577356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d9983-48c8-4f20-aa45-cf39611b46d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b282e809b4547c5a96bdcad361ed73e)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:51.579261 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d9983-48c8-4f20-aa45-cf39611b46d5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:51.623869 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-469d9983-48c8-4f20-aa45-cf39611b46d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b282e809b4547c5a96bdcad361ed73e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:51.632455 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-469d9983-48c8-4f20-aa45-cf39611b46d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b282e809b4547c5a96bdcad361ed73e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:51.644401 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-469d9983-48c8-4f20-aa45-cf39611b46d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b282e809b4547c5a96bdcad361ed73e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:51.645043 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-469d9983-48c8-4f20-aa45-cf39611b46d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b282e809b4547c5a96bdcad361ed73e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:51.645649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-469d9983-48c8-4f20-aa45-cf39611b46d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b282e809b4547c5a96bdcad361ed73e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:51.657610 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1161/2334] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:13:51 2022] DELETE /identity/v3/users/5b282e809b4547c5a96bdcad361ed73e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:13:51.945940 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649560d-6ccc-49f0-af16-b76fabec4b5e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:51.947532 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d649560d-6ccc-49f0-af16-b76fabec4b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:51.967083 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649560d-6ccc-49f0-af16-b76fabec4b5e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:52.031151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76e002-9fce-4519-a2bd-88773b9336c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:52.032052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76e002-9fce-4519-a2bd-88773b9336c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:52.032340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76e002-9fce-4519-a2bd-88773b9336c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:52.032621 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76e002-9fce-4519-a2bd-88773b9336c5 admin admin] PATH_INFO: `/v3/projects/c6e948e491ae4c71a1c8ab4f68a42858` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:52.034585 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76e002-9fce-4519-a2bd-88773b9336c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e948e491ae4c71a1c8ab4f68a42858)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:52.036577 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76e002-9fce-4519-a2bd-88773b9336c5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:52.082875 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bb76e002-9fce-4519-a2bd-88773b9336c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e948e491ae4c71a1c8ab4f68a42858', 'request_id': 'req-bb76e002-9fce-4519-a2bd-88773b9336c5'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:52.089023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bb76e002-9fce-4519-a2bd-88773b9336c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e948e491ae4c71a1c8ab4f68a42858', 'request_id': 'req-bb76e002-9fce-4519-a2bd-88773b9336c5'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:52.097782 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bb76e002-9fce-4519-a2bd-88773b9336c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e948e491ae4c71a1c8ab4f68a42858', 'request_id': 'req-bb76e002-9fce-4519-a2bd-88773b9336c5'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:52.108425 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bb76e002-9fce-4519-a2bd-88773b9336c5 admin admin] The token cache is being invalidate because project c6e948e491ae4c71a1c8ab4f68a42858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:13:52.108717 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bb76e002-9fce-4519-a2bd-88773b9336c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:52.109344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bb76e002-9fce-4519-a2bd-88773b9336c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:52.110926 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1174/2335] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:13:51 2022] DELETE /identity/v3/projects/c6e948e491ae4c71a1c8ab4f68a42858 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:13:52.116759 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f5011-e3aa-4eb0-9853-f36182cb486e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:52.117042 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f5011-e3aa-4eb0-9853-f36182cb486e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:52.117323 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f5011-e3aa-4eb0-9853-f36182cb486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:52.136348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b91f5011-e3aa-4eb0-9853-f36182cb486e None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:52.137542 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b91f5011-e3aa-4eb0-9853-f36182cb486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:52.164176 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:52.200711 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1162/2336] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:52.209166 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385dab3-f666-4815-8d28-0000d4b5ad99 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:52.209462 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385dab3-f666-4815-8d28-0000d4b5ad99 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:52.209748 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385dab3-f666-4815-8d28-0000d4b5ad99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:52.228210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f385dab3-f666-4815-8d28-0000d4b5ad99 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:52.229442 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f385dab3-f666-4815-8d28-0000d4b5ad99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:52.238127 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1175/2337] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:52.242226 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f5011-e3aa-4eb0-9853-f36182cb486e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:52.252825 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f5011-e3aa-4eb0-9853-f36182cb486e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:52.257382 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060a104-9007-4f9a-9c54-0b89b958b5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:52.258025 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060a104-9007-4f9a-9c54-0b89b958b5eb admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:52.258304 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060a104-9007-4f9a-9c54-0b89b958b5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:52.258577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060a104-9007-4f9a-9c54-0b89b958b5eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:52.259298 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060a104-9007-4f9a-9c54-0b89b958b5eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:13:52.259606 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060a104-9007-4f9a-9c54-0b89b958b5eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:52.261253 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060a104-9007-4f9a-9c54-0b89b958b5eb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:52.273053 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1163/2338] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:13:52.277127 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385dab3-f666-4815-8d28-0000d4b5ad99 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:52.286758 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385dab3-f666-4815-8d28-0000d4b5ad99 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:52.291606 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c950cb6-897e-496b-a9c2-59b7f11f79fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:52.292280 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c950cb6-897e-496b-a9c2-59b7f11f79fb admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:52.292569 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c950cb6-897e-496b-a9c2-59b7f11f79fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:52.292959 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c950cb6-897e-496b-a9c2-59b7f11f79fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:52.293663 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c950cb6-897e-496b-a9c2-59b7f11f79fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:52.295665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c950cb6-897e-496b-a9c2-59b7f11f79fb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:52.321976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1176/2339] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:13:52 2022] POST /identity/v3/projects => generated 409 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:13:52.326088 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060a104-9007-4f9a-9c54-0b89b958b5eb admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:52.336192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060a104-9007-4f9a-9c54-0b89b958b5eb admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:52.392063 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caa87b-48a1-4f42-8a84-ea3b0d065eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:52.392878 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caa87b-48a1-4f42-8a84-ea3b0d065eac admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:52.393162 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caa87b-48a1-4f42-8a84-ea3b0d065eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:52.393438 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caa87b-48a1-4f42-8a84-ea3b0d065eac admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:52.394135 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30caa87b-48a1-4f42-8a84-ea3b0d065eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:52.396076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30caa87b-48a1-4f42-8a84-ea3b0d065eac admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:52.415866 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1164/2340] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:13:52 2022] POST /identity/v3/users => generated 305 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:13:52.419936 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c950cb6-897e-496b-a9c2-59b7f11f79fb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:52.430712 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c950cb6-897e-496b-a9c2-59b7f11f79fb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:52.435327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f693be2-946f-4db2-9797-69883e4e248a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:52.436108 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f693be2-946f-4db2-9797-69883e4e248a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:52.436391 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f693be2-946f-4db2-9797-69883e4e248a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:52.436665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f693be2-946f-4db2-9797-69883e4e248a admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:52.437395 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f693be2-946f-4db2-9797-69883e4e248a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:52.438993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f693be2-946f-4db2-9797-69883e4e248a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:52.450336 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1177/2341] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:13:52.454083 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caa87b-48a1-4f42-8a84-ea3b0d065eac admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:52.464508 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caa87b-48a1-4f42-8a84-ea3b0d065eac admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:52.469069 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce200ac3-f00a-4b22-a215-c6d32c9195df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:52.469717 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce200ac3-f00a-4b22-a215-c6d32c9195df admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:52.470003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce200ac3-f00a-4b22-a215-c6d32c9195df admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:52.470276 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce200ac3-f00a-4b22-a215-c6d32c9195df admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:52.471419 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce200ac3-f00a-4b22-a215-c6d32c9195df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:52.473054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce200ac3-f00a-4b22-a215-c6d32c9195df admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:52.483112 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1165/2342] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:13:52.488110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f693be2-946f-4db2-9797-69883e4e248a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:52.498046 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f693be2-946f-4db2-9797-69883e4e248a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:52.503580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b3103-9901-4cf4-ae09-62b457754372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:52.504589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b3103-9901-4cf4-ae09-62b457754372 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:52.504883 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b3103-9901-4cf4-ae09-62b457754372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:52.505165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b3103-9901-4cf4-ae09-62b457754372 admin admin] PATH_INFO: `/v3/projects/d16a9bceaf834631ba6446a28ed17956/users/479d13a2a21a478eb3ecb67c94a20d1b/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:52.520663 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b3103-9901-4cf4-ae09-62b457754372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16a9bceaf834631ba6446a28ed17956, user_id=479d13a2a21a478eb3ecb67c94a20d1b, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:52.523392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b3103-9901-4cf4-ae09-62b457754372 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:52.532685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:52.546428 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1178/2343] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:13:52 2022] PUT /identity/v3/projects/d16a9bceaf834631ba6446a28ed17956/users/479d13a2a21a478eb3ecb67c94a20d1b/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:13:52.550524 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a83867-03ab-4d60-98fe-308d7be6372f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:52.550819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a83867-03ab-4d60-98fe-308d7be6372f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:52.551103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a83867-03ab-4d60-98fe-308d7be6372f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:52.580569 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b4a83867-03ab-4d60-98fe-308d7be6372f None None] MFA Rules not processed for user `479d13a2a21a478eb3ecb67c94a20d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:52.581702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b4a83867-03ab-4d60-98fe-308d7be6372f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:52.651124 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1166/2344] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:13:52 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:52.658656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b3103-9901-4cf4-ae09-62b457754372 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:52.725943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b3103-9901-4cf4-ae09-62b457754372 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:52.731724 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ece1b8-c645-44f6-ac78-2c9f78e9ffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:52.732431 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ece1b8-c645-44f6-ac78-2c9f78e9ffa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:52.732708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ece1b8-c645-44f6-ac78-2c9f78e9ffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:52.732987 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ece1b8-c645-44f6-ac78-2c9f78e9ffa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:52.733688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ece1b8-c645-44f6-ac78-2c9f78e9ffa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:52.735601 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ece1b8-c645-44f6-ac78-2c9f78e9ffa9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:52.761471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1179/2345] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:13:52 2022] POST /identity/v3/projects => generated 409 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:13:52.765157 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a83867-03ab-4d60-98fe-308d7be6372f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:52.779194 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a83867-03ab-4d60-98fe-308d7be6372f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:52.805433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:52.837129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb02e3-4428-41f7-bafa-223d050e6e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:52.837797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb02e3-4428-41f7-bafa-223d050e6e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:52.838083 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb02e3-4428-41f7-bafa-223d050e6e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:52.838362 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb02e3-4428-41f7-bafa-223d050e6e11 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:52.839063 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb02e3-4428-41f7-bafa-223d050e6e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:52.841042 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb02e3-4428-41f7-bafa-223d050e6e11 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:52.860281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1167/2346] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:13:52 2022] POST /identity/v3/users => generated 311 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:13:52.864936 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ece1b8-c645-44f6-ac78-2c9f78e9ffa9 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:52.875384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ece1b8-c645-44f6-ac78-2c9f78e9ffa9 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:52.880041 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264c467-7bf5-436d-8fc5-670c7b8a94cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:52.880690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264c467-7bf5-436d-8fc5-670c7b8a94cb admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:52.880977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264c467-7bf5-436d-8fc5-670c7b8a94cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:52.881256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264c467-7bf5-436d-8fc5-670c7b8a94cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:52.881987 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264c467-7bf5-436d-8fc5-670c7b8a94cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:52.883566 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264c467-7bf5-436d-8fc5-670c7b8a94cb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:52.894584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1180/2347] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:13:52.898843 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb02e3-4428-41f7-bafa-223d050e6e11 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:52.909583 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb02e3-4428-41f7-bafa-223d050e6e11 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:52.914149 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7178cfa-1c31-4501-bbe2-96abf2fb5f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:52.915615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7178cfa-1c31-4501-bbe2-96abf2fb5f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:52.916150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7178cfa-1c31-4501-bbe2-96abf2fb5f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:52.916643 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7178cfa-1c31-4501-bbe2-96abf2fb5f74 admin admin] PATH_INFO: `/v3/projects/01b94d4de55a4a26ac3deb1f756c3d07/users/0c0a198a860f46bf9449bd85189974b4/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:52.933008 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7178cfa-1c31-4501-bbe2-96abf2fb5f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b94d4de55a4a26ac3deb1f756c3d07, user_id=0c0a198a860f46bf9449bd85189974b4, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:52.935860 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7178cfa-1c31-4501-bbe2-96abf2fb5f74 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:52.949236 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1168/2348] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:13:52 2022] PUT /identity/v3/projects/01b94d4de55a4a26ac3deb1f756c3d07/users/0c0a198a860f46bf9449bd85189974b4/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:13:52.953347 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264c467-7bf5-436d-8fc5-670c7b8a94cb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:52.964424 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264c467-7bf5-436d-8fc5-670c7b8a94cb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:53.026457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab2f9f-a1be-4402-9593-f9dcdec72a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:53.027218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab2f9f-a1be-4402-9593-f9dcdec72a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:53.027604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab2f9f-a1be-4402-9593-f9dcdec72a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:53.027774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab2f9f-a1be-4402-9593-f9dcdec72a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:53.028682 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab2f9f-a1be-4402-9593-f9dcdec72a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:53.030358 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab2f9f-a1be-4402-9593-f9dcdec72a86 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:53.041567 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1181/2349] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:13:53.046114 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7178cfa-1c31-4501-bbe2-96abf2fb5f74 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:53.057126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7178cfa-1c31-4501-bbe2-96abf2fb5f74 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:53.061862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9719b79-d0de-4661-835c-adbb43ecfa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:53.062745 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9719b79-d0de-4661-835c-adbb43ecfa0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:53.063073 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9719b79-d0de-4661-835c-adbb43ecfa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:53.063348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9719b79-d0de-4661-835c-adbb43ecfa0c admin admin] PATH_INFO: `/v3/projects/01b94d4de55a4a26ac3deb1f756c3d07/users/0c0a198a860f46bf9449bd85189974b4/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:53.065583 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9719b79-d0de-4661-835c-adbb43ecfa0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b94d4de55a4a26ac3deb1f756c3d07, user_id=0c0a198a860f46bf9449bd85189974b4, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:53.068291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9719b79-d0de-4661-835c-adbb43ecfa0c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:53.078457 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1169/2350] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:13:53 2022] PUT /identity/v3/projects/01b94d4de55a4a26ac3deb1f756c3d07/users/0c0a198a860f46bf9449bd85189974b4/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:13:53.090224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f24e05-6785-4d58-a169-37c795086f44 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:53.090520 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f24e05-6785-4d58-a169-37c795086f44 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:53.090801 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f24e05-6785-4d58-a169-37c795086f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:53.118265 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-43f24e05-6785-4d58-a169-37c795086f44 None None] MFA Rules not processed for user `0c0a198a860f46bf9449bd85189974b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:53.119464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-43f24e05-6785-4d58-a169-37c795086f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:53.178749 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:53.189312 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1182/2351] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:13:53 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:53.199596 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9719b79-d0de-4661-835c-adbb43ecfa0c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:53.201345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e9719b79-d0de-4661-835c-adbb43ecfa0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:53.258904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9719b79-d0de-4661-835c-adbb43ecfa0c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:53.262523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9cccc-55dc-4536-b2b3-23d8bc2a997d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:53.263157 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9cccc-55dc-4536-b2b3-23d8bc2a997d service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:53.263443 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9cccc-55dc-4536-b2b3-23d8bc2a997d service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:53.263722 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9cccc-55dc-4536-b2b3-23d8bc2a997d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:53.273886 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9cccc-55dc-4536-b2b3-23d8bc2a997d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:53.275445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9cccc-55dc-4536-b2b3-23d8bc2a997d service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:53.285164 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1170/2352] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:13:53 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:13:53.432591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f24e05-6785-4d58-a169-37c795086f44 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:53.442679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f24e05-6785-4d58-a169-37c795086f44 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:53.446219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d6a15-d186-42c4-a4d2-6ed687577a0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:53.446874 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d6a15-d186-42c4-a4d2-6ed687577a0a service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:53.447163 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d6a15-d186-42c4-a4d2-6ed687577a0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:53.447446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d6a15-d186-42c4-a4d2-6ed687577a0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:53.509384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d6a15-d186-42c4-a4d2-6ed687577a0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:53.510957 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d6a15-d186-42c4-a4d2-6ed687577a0a service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:53.521566 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1183/2353] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:13:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:13:55.108573 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9cccc-55dc-4536-b2b3-23d8bc2a997d service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:55.110312 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8cc9cccc-55dc-4536-b2b3-23d8bc2a997d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:55.172462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9cccc-55dc-4536-b2b3-23d8bc2a997d service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:55.176875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ee3d8-aecb-4417-96f1-abd425e1101e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:55.177540 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ee3d8-aecb-4417-96f1-abd425e1101e service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:55.177833 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ee3d8-aecb-4417-96f1-abd425e1101e service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:55.178094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ee3d8-aecb-4417-96f1-abd425e1101e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:55.179996 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-198ee3d8-aecb-4417-96f1-abd425e1101e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:55.216365 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:55.248186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ee3d8-aecb-4417-96f1-abd425e1101e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:55.249631 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ee3d8-aecb-4417-96f1-abd425e1101e service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:55.260338 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1171/2354] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:13:58.451421 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d6a15-d186-42c4-a4d2-6ed687577a0a service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:58.452940 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-886d6a15-d186-42c4-a4d2-6ed687577a0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:58.467737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d6a15-d186-42c4-a4d2-6ed687577a0a service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:58.473381 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80fc30-7656-4052-a423-afda9ce8a901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:58.474288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80fc30-7656-4052-a423-afda9ce8a901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:58.474574 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80fc30-7656-4052-a423-afda9ce8a901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:58.474908 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80fc30-7656-4052-a423-afda9ce8a901 admin admin] PATH_INFO: `/v3/users/e12d075bc9144a5e8de3fe53004e9052` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:58.476132 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80fc30-7656-4052-a423-afda9ce8a901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e12d075bc9144a5e8de3fe53004e9052)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:58.478308 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80fc30-7656-4052-a423-afda9ce8a901 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:58.525482 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bd80fc30-7656-4052-a423-afda9ce8a901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e12d075bc9144a5e8de3fe53004e9052'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:58.532410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bd80fc30-7656-4052-a423-afda9ce8a901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e12d075bc9144a5e8de3fe53004e9052'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:58.544418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bd80fc30-7656-4052-a423-afda9ce8a901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e12d075bc9144a5e8de3fe53004e9052'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:58.545049 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bd80fc30-7656-4052-a423-afda9ce8a901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e12d075bc9144a5e8de3fe53004e9052'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:58.552175 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bd80fc30-7656-4052-a423-afda9ce8a901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e12d075bc9144a5e8de3fe53004e9052'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:58.558284 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1184/2355] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:13:58 2022] DELETE /identity/v3/users/e12d075bc9144a5e8de3fe53004e9052 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:13:58.733856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ee3d8-aecb-4417-96f1-abd425e1101e service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:58.744238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ee3d8-aecb-4417-96f1-abd425e1101e service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:58.811847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfa94b-63a1-4b82-a008-713d130fdcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:58.812792 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfa94b-63a1-4b82-a008-713d130fdcd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:58.813145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfa94b-63a1-4b82-a008-713d130fdcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:58.813538 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfa94b-63a1-4b82-a008-713d130fdcd7 admin admin] PATH_INFO: `/v3/projects/74054e993c3a4c8794bb96540281f87d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:58.815323 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfa94b-63a1-4b82-a008-713d130fdcd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74054e993c3a4c8794bb96540281f87d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:58.817399 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfa94b-63a1-4b82-a008-713d130fdcd7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:58.865473 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-94dfa94b-63a1-4b82-a008-713d130fdcd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74054e993c3a4c8794bb96540281f87d', 'request_id': 'req-94dfa94b-63a1-4b82-a008-713d130fdcd7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:58.876027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-94dfa94b-63a1-4b82-a008-713d130fdcd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74054e993c3a4c8794bb96540281f87d', 'request_id': 'req-94dfa94b-63a1-4b82-a008-713d130fdcd7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:58.883378 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-94dfa94b-63a1-4b82-a008-713d130fdcd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74054e993c3a4c8794bb96540281f87d', 'request_id': 'req-94dfa94b-63a1-4b82-a008-713d130fdcd7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:58.894089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-94dfa94b-63a1-4b82-a008-713d130fdcd7 admin admin] The token cache is being invalidate because project 74054e993c3a4c8794bb96540281f87d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:13:58.894414 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-94dfa94b-63a1-4b82-a008-713d130fdcd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:58.895059 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-94dfa94b-63a1-4b82-a008-713d130fdcd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:13:58.896649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1172/2356] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:13:58 2022] DELETE /identity/v3/projects/74054e993c3a4c8794bb96540281f87d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:13:58.901724 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e140236-4365-40dc-a317-b55e255cbf52 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:58.902020 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e140236-4365-40dc-a317-b55e255cbf52 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:58.902305 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e140236-4365-40dc-a317-b55e255cbf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:58.930730 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8e140236-4365-40dc-a317-b55e255cbf52 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:58.931987 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8e140236-4365-40dc-a317-b55e255cbf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:58.993896 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1185/2357] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:59.001671 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b32e3-6cb1-4275-ab13-f54b363ae58a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:59.002705 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b32e3-6cb1-4275-ab13-f54b363ae58a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:59.003047 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b32e3-6cb1-4275-ab13-f54b363ae58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:59.022232 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ce6b32e3-6cb1-4275-ab13-f54b363ae58a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:59.023789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ce6b32e3-6cb1-4275-ab13-f54b363ae58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:59.032045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1173/2358] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:59.036252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e140236-4365-40dc-a317-b55e255cbf52 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:59.045642 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e140236-4365-40dc-a317-b55e255cbf52 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:59.050950 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbeb93e-ad95-453c-ad90-65efe03e4111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:59.051606 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeb93e-ad95-453c-ad90-65efe03e4111 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:59.051933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeb93e-ad95-453c-ad90-65efe03e4111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:59.052209 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeb93e-ad95-453c-ad90-65efe03e4111 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:59.052939 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbeb93e-ad95-453c-ad90-65efe03e4111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:13:59.053247 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbeb93e-ad95-453c-ad90-65efe03e4111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:59.054847 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbeb93e-ad95-453c-ad90-65efe03e4111 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:59.056621 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:59.072371 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1186/2359] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:13:59.077282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b32e3-6cb1-4275-ab13-f54b363ae58a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:59.087205 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b32e3-6cb1-4275-ab13-f54b363ae58a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:59.094431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061e2ae-68b2-4bd7-a2c7-2682744a7cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:59.095122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061e2ae-68b2-4bd7-a2c7-2682744a7cba admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:59.095411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061e2ae-68b2-4bd7-a2c7-2682744a7cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:59.096470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061e2ae-68b2-4bd7-a2c7-2682744a7cba admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:59.097293 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061e2ae-68b2-4bd7-a2c7-2682744a7cba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:59.099116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061e2ae-68b2-4bd7-a2c7-2682744a7cba admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:59.128557 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1174/2360] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:13:59 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:13:59.132751 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbeb93e-ad95-453c-ad90-65efe03e4111 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:59.150826 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbeb93e-ad95-453c-ad90-65efe03e4111 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:59.231624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215a4fd-7b82-4add-bce9-cdc1d2632255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:59.232537 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215a4fd-7b82-4add-bce9-cdc1d2632255 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:59.232827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215a4fd-7b82-4add-bce9-cdc1d2632255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:59.233193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215a4fd-7b82-4add-bce9-cdc1d2632255 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:59.233872 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215a4fd-7b82-4add-bce9-cdc1d2632255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:59.236577 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215a4fd-7b82-4add-bce9-cdc1d2632255 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:59.260825 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1187/2361] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:13:59 2022] POST /identity/v3/users => generated 283 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:13:59.265205 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061e2ae-68b2-4bd7-a2c7-2682744a7cba admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:59.277292 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061e2ae-68b2-4bd7-a2c7-2682744a7cba admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:59.288698 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e627c7-a2a9-4e9d-bee5-a2f78e1f0a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:59.289461 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e627c7-a2a9-4e9d-bee5-a2f78e1f0a3a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:59.289824 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e627c7-a2a9-4e9d-bee5-a2f78e1f0a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:59.290179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e627c7-a2a9-4e9d-bee5-a2f78e1f0a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:59.291647 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e627c7-a2a9-4e9d-bee5-a2f78e1f0a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:59.293153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e627c7-a2a9-4e9d-bee5-a2f78e1f0a3a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:59.309017 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1175/2362] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:13:59.314531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215a4fd-7b82-4add-bce9-cdc1d2632255 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:59.331610 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215a4fd-7b82-4add-bce9-cdc1d2632255 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:59.337154 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a78d89-ede0-4563-a3f5-6ebfd2568f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:59.337854 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a78d89-ede0-4563-a3f5-6ebfd2568f20 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:59.338143 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a78d89-ede0-4563-a3f5-6ebfd2568f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:59.339256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a78d89-ede0-4563-a3f5-6ebfd2568f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:59.340130 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a78d89-ede0-4563-a3f5-6ebfd2568f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:59.342004 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a78d89-ede0-4563-a3f5-6ebfd2568f20 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:59.356140 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1188/2363] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:13:59.360052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e627c7-a2a9-4e9d-bee5-a2f78e1f0a3a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:59.371196 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e627c7-a2a9-4e9d-bee5-a2f78e1f0a3a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:59.375810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df2459-8580-4d91-8af5-c271817c2bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:59.376747 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df2459-8580-4d91-8af5-c271817c2bab admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:59.377598 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df2459-8580-4d91-8af5-c271817c2bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:59.377890 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df2459-8580-4d91-8af5-c271817c2bab admin admin] PATH_INFO: `/v3/projects/452f64f0fdc3461183e080eb963e4854/users/17d7b558f59d4c2d8f13251d6ff32edc/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:59.393464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df2459-8580-4d91-8af5-c271817c2bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=452f64f0fdc3461183e080eb963e4854, user_id=17d7b558f59d4c2d8f13251d6ff32edc, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:59.396133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df2459-8580-4d91-8af5-c271817c2bab admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:59.405087 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:59.412550 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1176/2364] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:13:59 2022] PUT /identity/v3/projects/452f64f0fdc3461183e080eb963e4854/users/17d7b558f59d4c2d8f13251d6ff32edc/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:13:59.424602 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bfe07-2a5b-4f00-a986-72c0aae3b16e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:59.424895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bfe07-2a5b-4f00-a986-72c0aae3b16e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:59.425176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bfe07-2a5b-4f00-a986-72c0aae3b16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:59.451793 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-334bfe07-2a5b-4f00-a986-72c0aae3b16e None None] MFA Rules not processed for user `17d7b558f59d4c2d8f13251d6ff32edc`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:59.453038 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-334bfe07-2a5b-4f00-a986-72c0aae3b16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:59.520938 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1189/2365] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:13:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:59.524917 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df2459-8580-4d91-8af5-c271817c2bab admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:59.594109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df2459-8580-4d91-8af5-c271817c2bab admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:59.600070 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e68f79-3af8-4be7-804a-24e41e69716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:59.600811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e68f79-3af8-4be7-804a-24e41e69716e admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:59.601097 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e68f79-3af8-4be7-804a-24e41e69716e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:59.601374 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e68f79-3af8-4be7-804a-24e41e69716e admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:59.602338 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e68f79-3af8-4be7-804a-24e41e69716e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:59.604431 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e68f79-3af8-4be7-804a-24e41e69716e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:59.629575 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1177/2366] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:13:59 2022] POST /identity/v3/projects => generated 353 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:13:59.633481 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bfe07-2a5b-4f00-a986-72c0aae3b16e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:59.644768 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bfe07-2a5b-4f00-a986-72c0aae3b16e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:59.701453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d9807-7403-46b7-95f4-8dd155afb21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:59.702120 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d9807-7403-46b7-95f4-8dd155afb21e admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:59.702404 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d9807-7403-46b7-95f4-8dd155afb21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:59.702678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d9807-7403-46b7-95f4-8dd155afb21e admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:59.703367 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d9807-7403-46b7-95f4-8dd155afb21e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:59.705814 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d9807-7403-46b7-95f4-8dd155afb21e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:59.713247 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:59.727025 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1190/2367] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:13:59 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:13:59.730950 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e68f79-3af8-4be7-804a-24e41e69716e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:59.741764 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e68f79-3af8-4be7-804a-24e41e69716e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:59.746467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f752a7-0392-495e-a1df-bedbb98d223b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:59.747131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f752a7-0392-495e-a1df-bedbb98d223b admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:59.747419 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f752a7-0392-495e-a1df-bedbb98d223b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:59.747722 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f752a7-0392-495e-a1df-bedbb98d223b admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:59.748494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f752a7-0392-495e-a1df-bedbb98d223b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:59.750123 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f752a7-0392-495e-a1df-bedbb98d223b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:59.761171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1178/2368] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:13:59.765284 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d9807-7403-46b7-95f4-8dd155afb21e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:59.776611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d9807-7403-46b7-95f4-8dd155afb21e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:59.781198 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a432336-f8c4-40bc-ad5b-a788d4040c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:59.782074 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a432336-f8c4-40bc-ad5b-a788d4040c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:59.782357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a432336-f8c4-40bc-ad5b-a788d4040c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:59.782634 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a432336-f8c4-40bc-ad5b-a788d4040c2c admin admin] PATH_INFO: `/v3/projects/7e982c1d7171404b9776c40dd2e705bb/users/236f0cd7efdd4f23965727571c92bd4f/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:59.798220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a432336-f8c4-40bc-ad5b-a788d4040c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e982c1d7171404b9776c40dd2e705bb, user_id=236f0cd7efdd4f23965727571c92bd4f, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:59.801402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a432336-f8c4-40bc-ad5b-a788d4040c2c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:59.814721 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1191/2369] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:13:59 2022] PUT /identity/v3/projects/7e982c1d7171404b9776c40dd2e705bb/users/236f0cd7efdd4f23965727571c92bd4f/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:13:59.818386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f752a7-0392-495e-a1df-bedbb98d223b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:59.828510 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f752a7-0392-495e-a1df-bedbb98d223b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:59.887167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340372a8-3035-4d28-931a-d77d100830cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:59.887913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340372a8-3035-4d28-931a-d77d100830cc admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:59.888206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340372a8-3035-4d28-931a-d77d100830cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:59.888484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340372a8-3035-4d28-931a-d77d100830cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:59.889213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340372a8-3035-4d28-931a-d77d100830cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:59.890817 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340372a8-3035-4d28-931a-d77d100830cc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:59.901409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1179/2370] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:13:59.906056 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a432336-f8c4-40bc-ad5b-a788d4040c2c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:59.917960 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a432336-f8c4-40bc-ad5b-a788d4040c2c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:59.922615 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ef5cd-3078-46c9-8d66-91ccfb6b8f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:59.923483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ef5cd-3078-46c9-8d66-91ccfb6b8f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:59.924770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ef5cd-3078-46c9-8d66-91ccfb6b8f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:59.925133 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ef5cd-3078-46c9-8d66-91ccfb6b8f02 admin admin] PATH_INFO: `/v3/projects/7e982c1d7171404b9776c40dd2e705bb/users/236f0cd7efdd4f23965727571c92bd4f/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:59.927182 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ef5cd-3078-46c9-8d66-91ccfb6b8f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e982c1d7171404b9776c40dd2e705bb, user_id=236f0cd7efdd4f23965727571c92bd4f, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:59.929952 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ef5cd-3078-46c9-8d66-91ccfb6b8f02 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:59.942509 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1192/2371] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:13:59 2022] PUT /identity/v3/projects/7e982c1d7171404b9776c40dd2e705bb/users/236f0cd7efdd4f23965727571c92bd4f/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:13:59.953781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3482f-3258-4d4e-bb29-8e515a68ed47 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:59.954089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3482f-3258-4d4e-bb29-8e515a68ed47 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:59.954369 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3482f-3258-4d4e-bb29-8e515a68ed47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:59.980973 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b9b3482f-3258-4d4e-bb29-8e515a68ed47 None None] MFA Rules not processed for user `236f0cd7efdd4f23965727571c92bd4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:59.982182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b9b3482f-3258-4d4e-bb29-8e515a68ed47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:00.043441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:00.056127 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1180/2372] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:13:59 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:00.067798 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ef5cd-3078-46c9-8d66-91ccfb6b8f02 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:00.069575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d29ef5cd-3078-46c9-8d66-91ccfb6b8f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:00.126499 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ef5cd-3078-46c9-8d66-91ccfb6b8f02 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:00.130201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d8b66-b4ce-42eb-820c-e5749b2976c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:00.130840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d8b66-b4ce-42eb-820c-e5749b2976c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:00.131126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d8b66-b4ce-42eb-820c-e5749b2976c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:00.131406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d8b66-b4ce-42eb-820c-e5749b2976c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:00.140454 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d8b66-b4ce-42eb-820c-e5749b2976c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:00.141879 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d8b66-b4ce-42eb-820c-e5749b2976c3 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:00.151428 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1193/2373] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:00 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:00.543606 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3482f-3258-4d4e-bb29-8e515a68ed47 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:00.605350 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3482f-3258-4d4e-bb29-8e515a68ed47 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:00.611978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22ac53-d218-478a-b514-adaea3124466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:00.612748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22ac53-d218-478a-b514-adaea3124466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:00.613030 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22ac53-d218-478a-b514-adaea3124466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:00.613306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22ac53-d218-478a-b514-adaea3124466 admin admin] PATH_INFO: `/v3/users/17d7b558f59d4c2d8f13251d6ff32edc` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:00.614816 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22ac53-d218-478a-b514-adaea3124466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d7b558f59d4c2d8f13251d6ff32edc)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:00.616801 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22ac53-d218-478a-b514-adaea3124466 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:00.666523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8c22ac53-d218-478a-b514-adaea3124466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d7b558f59d4c2d8f13251d6ff32edc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:00.675102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8c22ac53-d218-478a-b514-adaea3124466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d7b558f59d4c2d8f13251d6ff32edc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:00.691254 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8c22ac53-d218-478a-b514-adaea3124466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d7b558f59d4c2d8f13251d6ff32edc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:00.692004 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8c22ac53-d218-478a-b514-adaea3124466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d7b558f59d4c2d8f13251d6ff32edc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:00.692625 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8c22ac53-d218-478a-b514-adaea3124466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d7b558f59d4c2d8f13251d6ff32edc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:00.706860 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1181/2374] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:00 2022] DELETE /identity/v3/users/17d7b558f59d4c2d8f13251d6ff32edc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:00.711501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef5f7e-d4a3-422b-a76b-81d2e61f1b3c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:00.712052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef5f7e-d4a3-422b-a76b-81d2e61f1b3c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:00.712189 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef5f7e-d4a3-422b-a76b-81d2e61f1b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:00.732457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-12ef5f7e-d4a3-422b-a76b-81d2e61f1b3c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:00.733770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-12ef5f7e-d4a3-422b-a76b-81d2e61f1b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:00.793139 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1194/2375] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:00.803479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22ac53-d218-478a-b514-adaea3124466 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:00.804913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8c22ac53-d218-478a-b514-adaea3124466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:00.862146 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22ac53-d218-478a-b514-adaea3124466 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:00.865726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4ae84-7fc2-414a-99b7-21ec899aa0f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:00.866366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4ae84-7fc2-414a-99b7-21ec899aa0f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:00.866645 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4ae84-7fc2-414a-99b7-21ec899aa0f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:00.866924 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4ae84-7fc2-414a-99b7-21ec899aa0f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:00.875881 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4ae84-7fc2-414a-99b7-21ec899aa0f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:00.877608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4ae84-7fc2-414a-99b7-21ec899aa0f1 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:00.886811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1182/2376] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:01.160224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef5f7e-d4a3-422b-a76b-81d2e61f1b3c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:01.161647 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-12ef5f7e-d4a3-422b-a76b-81d2e61f1b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:01.173264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef5f7e-d4a3-422b-a76b-81d2e61f1b3c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:01.178656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766de38-d169-4e42-b2f8-883acd75314f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:01.179528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766de38-d169-4e42-b2f8-883acd75314f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:01.179792 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766de38-d169-4e42-b2f8-883acd75314f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:01.180726 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766de38-d169-4e42-b2f8-883acd75314f admin admin] PATH_INFO: `/v3/projects/452f64f0fdc3461183e080eb963e4854` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:01.181585 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766de38-d169-4e42-b2f8-883acd75314f admin admin] RBAC: Authorizing `identity:delete_project(project_id=452f64f0fdc3461183e080eb963e4854)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:01.183486 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766de38-d169-4e42-b2f8-883acd75314f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:01.236325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e766de38-d169-4e42-b2f8-883acd75314f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '452f64f0fdc3461183e080eb963e4854', 'request_id': 'req-e766de38-d169-4e42-b2f8-883acd75314f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:01.238253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:01.243397 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e766de38-d169-4e42-b2f8-883acd75314f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '452f64f0fdc3461183e080eb963e4854', 'request_id': 'req-e766de38-d169-4e42-b2f8-883acd75314f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:01.253380 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e766de38-d169-4e42-b2f8-883acd75314f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '452f64f0fdc3461183e080eb963e4854', 'request_id': 'req-e766de38-d169-4e42-b2f8-883acd75314f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:01.265191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e766de38-d169-4e42-b2f8-883acd75314f admin admin] The token cache is being invalidate because project 452f64f0fdc3461183e080eb963e4854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:01.265477 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e766de38-d169-4e42-b2f8-883acd75314f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:01.266097 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e766de38-d169-4e42-b2f8-883acd75314f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:01.268759 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1195/2377] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:01 2022] DELETE /identity/v3/projects/452f64f0fdc3461183e080eb963e4854 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:01.272673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4ae84-7fc2-414a-99b7-21ec899aa0f1 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:01.282177 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4ae84-7fc2-414a-99b7-21ec899aa0f1 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:01.293939 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:01.340054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3844e-bb7f-42f5-bcc0-db66e01a5b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:01.340913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3844e-bb7f-42f5-bcc0-db66e01a5b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:01.341197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3844e-bb7f-42f5-bcc0-db66e01a5b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:01.341467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3844e-bb7f-42f5-bcc0-db66e01a5b22 admin admin] PATH_INFO: `/v3/users/236f0cd7efdd4f23965727571c92bd4f` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:01.342631 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3844e-bb7f-42f5-bcc0-db66e01a5b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=236f0cd7efdd4f23965727571c92bd4f)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:01.344589 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3844e-bb7f-42f5-bcc0-db66e01a5b22 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:01.390069 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c2a3844e-bb7f-42f5-bcc0-db66e01a5b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236f0cd7efdd4f23965727571c92bd4f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:01.398386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c2a3844e-bb7f-42f5-bcc0-db66e01a5b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236f0cd7efdd4f23965727571c92bd4f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:01.411252 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c2a3844e-bb7f-42f5-bcc0-db66e01a5b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236f0cd7efdd4f23965727571c92bd4f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:01.411884 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c2a3844e-bb7f-42f5-bcc0-db66e01a5b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236f0cd7efdd4f23965727571c92bd4f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:01.412519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c2a3844e-bb7f-42f5-bcc0-db66e01a5b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236f0cd7efdd4f23965727571c92bd4f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:01.424429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1183/2378] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:01 2022] DELETE /identity/v3/users/236f0cd7efdd4f23965727571c92bd4f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:01.698354 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766de38-d169-4e42-b2f8-883acd75314f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:01.699811 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e766de38-d169-4e42-b2f8-883acd75314f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:01.714040 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766de38-d169-4e42-b2f8-883acd75314f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:01.776011 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f7a97-6402-4b81-9440-a67ce0b7c368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:01.777506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f7a97-6402-4b81-9440-a67ce0b7c368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:01.777506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f7a97-6402-4b81-9440-a67ce0b7c368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:01.777687 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f7a97-6402-4b81-9440-a67ce0b7c368 admin admin] PATH_INFO: `/v3/projects/7e982c1d7171404b9776c40dd2e705bb` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:01.778987 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f7a97-6402-4b81-9440-a67ce0b7c368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e982c1d7171404b9776c40dd2e705bb)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:01.780976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f7a97-6402-4b81-9440-a67ce0b7c368 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:01.830929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-051f7a97-6402-4b81-9440-a67ce0b7c368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e982c1d7171404b9776c40dd2e705bb', 'request_id': 'req-051f7a97-6402-4b81-9440-a67ce0b7c368'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:01.837368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-051f7a97-6402-4b81-9440-a67ce0b7c368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e982c1d7171404b9776c40dd2e705bb', 'request_id': 'req-051f7a97-6402-4b81-9440-a67ce0b7c368'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:01.846033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-051f7a97-6402-4b81-9440-a67ce0b7c368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e982c1d7171404b9776c40dd2e705bb', 'request_id': 'req-051f7a97-6402-4b81-9440-a67ce0b7c368'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:01.857785 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-051f7a97-6402-4b81-9440-a67ce0b7c368 admin admin] The token cache is being invalidate because project 7e982c1d7171404b9776c40dd2e705bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:01.858080 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-051f7a97-6402-4b81-9440-a67ce0b7c368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:01.858729 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-051f7a97-6402-4b81-9440-a67ce0b7c368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:01.860507 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1196/2379] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:01 2022] DELETE /identity/v3/projects/7e982c1d7171404b9776c40dd2e705bb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:01.866321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc34fd-341e-44a0-85fd-42e87bc47c73 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:01.867041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc34fd-341e-44a0-85fd-42e87bc47c73 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:01.867041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc34fd-341e-44a0-85fd-42e87bc47c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:01.889245 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-febc34fd-341e-44a0-85fd-42e87bc47c73 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:01.890472 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-febc34fd-341e-44a0-85fd-42e87bc47c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:01.913505 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f7a97-6402-4b81-9440-a67ce0b7c368 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:01.915187 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-051f7a97-6402-4b81-9440-a67ce0b7c368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:01.952211 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1184/2380] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:01.960840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf828860-eff1-4cde-a41e-4d7e91f361fb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:01.961132 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf828860-eff1-4cde-a41e-4d7e91f361fb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:01.961411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf828860-eff1-4cde-a41e-4d7e91f361fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:01.980342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-bf828860-eff1-4cde-a41e-4d7e91f361fb None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:01.981533 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bf828860-eff1-4cde-a41e-4d7e91f361fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:01.982523 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f7a97-6402-4b81-9440-a67ce0b7c368 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:01.987225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ff5a2-b7b2-471b-96f3-e76f288cd17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:01.988131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ff5a2-b7b2-471b-96f3-e76f288cd17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:01.988416 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ff5a2-b7b2-471b-96f3-e76f288cd17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:01.988702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ff5a2-b7b2-471b-96f3-e76f288cd17f admin admin] PATH_INFO: `/v3/users/479d13a2a21a478eb3ecb67c94a20d1b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:01.989897 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ff5a2-b7b2-471b-96f3-e76f288cd17f admin admin] RBAC: Authorizing `identity:delete_user(user_id=479d13a2a21a478eb3ecb67c94a20d1b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:01.990331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1185/2381] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:14:01.992000 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ff5a2-b7b2-471b-96f3-e76f288cd17f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:01.994200 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf828860-eff1-4cde-a41e-4d7e91f361fb None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:02.004159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf828860-eff1-4cde-a41e-4d7e91f361fb None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:02.005559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:02.021044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf983e-cfb6-4c13-a6d7-99ec86048daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:02.021753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf983e-cfb6-4c13-a6d7-99ec86048daa admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:02.022060 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf983e-cfb6-4c13-a6d7-99ec86048daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:02.022317 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf983e-cfb6-4c13-a6d7-99ec86048daa admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:02.023093 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf983e-cfb6-4c13-a6d7-99ec86048daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:14:02.023414 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf983e-cfb6-4c13-a6d7-99ec86048daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:02.025137 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf983e-cfb6-4c13-a6d7-99ec86048daa admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:02.039130 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1186/2382] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:14:02.041945 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bf6ff5a2-b7b2-471b-96f3-e76f288cd17f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '479d13a2a21a478eb3ecb67c94a20d1b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:02.043348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf983e-cfb6-4c13-a6d7-99ec86048daa admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:02.050795 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bf6ff5a2-b7b2-471b-96f3-e76f288cd17f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '479d13a2a21a478eb3ecb67c94a20d1b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:02.055165 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf983e-cfb6-4c13-a6d7-99ec86048daa admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:02.059953 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e054de1-526f-466e-b520-ab99fba0d9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:02.060612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e054de1-526f-466e-b520-ab99fba0d9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:02.060917 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e054de1-526f-466e-b520-ab99fba0d9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:02.061190 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e054de1-526f-466e-b520-ab99fba0d9b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:02.061881 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e054de1-526f-466e-b520-ab99fba0d9b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:02.063784 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e054de1-526f-466e-b520-ab99fba0d9b2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:02.066846 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bf6ff5a2-b7b2-471b-96f3-e76f288cd17f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '479d13a2a21a478eb3ecb67c94a20d1b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:02.067949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bf6ff5a2-b7b2-471b-96f3-e76f288cd17f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '479d13a2a21a478eb3ecb67c94a20d1b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:02.076499 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bf6ff5a2-b7b2-471b-96f3-e76f288cd17f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '479d13a2a21a478eb3ecb67c94a20d1b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:02.078123 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:02.084450 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1197/2383] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:01 2022] DELETE /identity/v3/users/479d13a2a21a478eb3ecb67c94a20d1b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:14:02.088663 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c948e7c-0c86-4524-972d-425dd6a13d3a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:02.089097 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c948e7c-0c86-4524-972d-425dd6a13d3a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:02.089498 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c948e7c-0c86-4524-972d-425dd6a13d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:02.096716 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1187/2384] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:02 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:14:02.100735 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e054de1-526f-466e-b520-ab99fba0d9b2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:02.102704 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7e054de1-526f-466e-b520-ab99fba0d9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:02.109317 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0c948e7c-0c86-4524-972d-425dd6a13d3a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:02.110557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0c948e7c-0c86-4524-972d-425dd6a13d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:02.170418 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e054de1-526f-466e-b520-ab99fba0d9b2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:02.171449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1198/2385] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:14:02.176467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31386d-a294-40d5-8c28-c3f54968da0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:02.176889 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31386d-a294-40d5-8c28-c3f54968da0f admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:02.177298 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31386d-a294-40d5-8c28-c3f54968da0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:02.177588 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31386d-a294-40d5-8c28-c3f54968da0f admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:02.178416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31386d-a294-40d5-8c28-c3f54968da0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:02.180389 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31386d-a294-40d5-8c28-c3f54968da0f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:02.182339 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c948e7c-0c86-4524-972d-425dd6a13d3a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:02.183762 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0c948e7c-0c86-4524-972d-425dd6a13d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:02.202973 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1188/2386] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:02 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:02.206867 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31386d-a294-40d5-8c28-c3f54968da0f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:02.217200 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31386d-a294-40d5-8c28-c3f54968da0f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:02.222338 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf31705-1b6c-4677-9699-8f6f9d885235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:02.222986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf31705-1b6c-4677-9699-8f6f9d885235 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:02.223278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf31705-1b6c-4677-9699-8f6f9d885235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:02.223561 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf31705-1b6c-4677-9699-8f6f9d885235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:02.224320 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf31705-1b6c-4677-9699-8f6f9d885235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:02.225922 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf31705-1b6c-4677-9699-8f6f9d885235 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:02.236809 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1189/2387] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:14:02.240780 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf31705-1b6c-4677-9699-8f6f9d885235 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:02.246908 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c948e7c-0c86-4524-972d-425dd6a13d3a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:02.250720 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558abf0-ec23-4fb7-96c3-736074deb955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:02.251294 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf31705-1b6c-4677-9699-8f6f9d885235 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:02.251434 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558abf0-ec23-4fb7-96c3-736074deb955 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:02.251663 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558abf0-ec23-4fb7-96c3-736074deb955 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:02.252522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558abf0-ec23-4fb7-96c3-736074deb955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:02.256902 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4dd82-62d0-4698-a7a9-a44e2e9bf05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:02.257553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4dd82-62d0-4698-a7a9-a44e2e9bf05c admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:02.257845 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4dd82-62d0-4698-a7a9-a44e2e9bf05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:02.258129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4dd82-62d0-4698-a7a9-a44e2e9bf05c admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:02.258851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4dd82-62d0-4698-a7a9-a44e2e9bf05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:02.260509 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4dd82-62d0-4698-a7a9-a44e2e9bf05c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:02.261673 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558abf0-ec23-4fb7-96c3-736074deb955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:02.263096 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558abf0-ec23-4fb7-96c3-736074deb955 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:02.270955 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1190/2388] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:14:02.273965 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1199/2389] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:14:02.274989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4dd82-62d0-4698-a7a9-a44e2e9bf05c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:02.287323 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4dd82-62d0-4698-a7a9-a44e2e9bf05c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:02.292307 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343efac-7aa5-43db-a706-4e89436460e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:02.293198 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343efac-7aa5-43db-a706-4e89436460e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:02.293483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343efac-7aa5-43db-a706-4e89436460e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:02.293764 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343efac-7aa5-43db-a706-4e89436460e3 admin admin] PATH_INFO: `/v3/projects/220259c00e5240c9ba8a71fe64de8d94/users/78e8e08bea6b4bf1be49c42b8cef678a/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:02.310175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343efac-7aa5-43db-a706-4e89436460e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=220259c00e5240c9ba8a71fe64de8d94, user_id=78e8e08bea6b4bf1be49c42b8cef678a, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:02.312901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343efac-7aa5-43db-a706-4e89436460e3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:02.336987 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1191/2390] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:02 2022] PUT /identity/v3/projects/220259c00e5240c9ba8a71fe64de8d94/users/78e8e08bea6b4bf1be49c42b8cef678a/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:02.349352 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbb7e5-6c6c-4708-afc1-3ed07b0dfdad None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:02.349824 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbb7e5-6c6c-4708-afc1-3ed07b0dfdad None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:02.350199 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbb7e5-6c6c-4708-afc1-3ed07b0dfdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:02.381627 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-72fbb7e5-6c6c-4708-afc1-3ed07b0dfdad None None] MFA Rules not processed for user `78e8e08bea6b4bf1be49c42b8cef678a`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:02.382856 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-72fbb7e5-6c6c-4708-afc1-3ed07b0dfdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:02.404300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:02.461398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1200/2391] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:02.465814 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343efac-7aa5-43db-a706-4e89436460e3 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:02.532529 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343efac-7aa5-43db-a706-4e89436460e3 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:02.538297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5cc3a-8a32-40ca-b16a-1b952d924976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:02.538994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5cc3a-8a32-40ca-b16a-1b952d924976 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:02.539318 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5cc3a-8a32-40ca-b16a-1b952d924976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:02.539655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5cc3a-8a32-40ca-b16a-1b952d924976 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:02.540542 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5cc3a-8a32-40ca-b16a-1b952d924976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:02.542686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5cc3a-8a32-40ca-b16a-1b952d924976 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:02.550364 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbb7e5-6c6c-4708-afc1-3ed07b0dfdad None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:02.552022 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-72fbb7e5-6c6c-4708-afc1-3ed07b0dfdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:02.575899 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1192/2392] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:02 2022] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:02.577733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5cc3a-8a32-40ca-b16a-1b952d924976 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:02.577891 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbb7e5-6c6c-4708-afc1-3ed07b0dfdad None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:02.605081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:02.637311 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f88c2-c4b3-4ce8-b4a1-d3cafbced172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:02.638234 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f88c2-c4b3-4ce8-b4a1-d3cafbced172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:02.638547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f88c2-c4b3-4ce8-b4a1-d3cafbced172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:02.638835 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f88c2-c4b3-4ce8-b4a1-d3cafbced172 admin admin] PATH_INFO: `/v3/projects/d16a9bceaf834631ba6446a28ed17956` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:02.640070 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f88c2-c4b3-4ce8-b4a1-d3cafbced172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d16a9bceaf834631ba6446a28ed17956)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:02.642012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f88c2-c4b3-4ce8-b4a1-d3cafbced172 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:02.648279 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5cc3a-8a32-40ca-b16a-1b952d924976 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:02.652920 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e46099-fd80-47a3-964f-569427e6920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:02.653582 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e46099-fd80-47a3-964f-569427e6920b admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:02.653871 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e46099-fd80-47a3-964f-569427e6920b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:02.654140 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e46099-fd80-47a3-964f-569427e6920b admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:02.654829 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e46099-fd80-47a3-964f-569427e6920b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:02.656777 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e46099-fd80-47a3-964f-569427e6920b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:02.681760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1193/2393] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:02 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:14:02.682780 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e46099-fd80-47a3-964f-569427e6920b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:02.691017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9b0f88c2-c4b3-4ce8-b4a1-d3cafbced172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd16a9bceaf834631ba6446a28ed17956', 'request_id': 'req-9b0f88c2-c4b3-4ce8-b4a1-d3cafbced172'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:02.693639 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e46099-fd80-47a3-964f-569427e6920b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:02.697397 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9b0f88c2-c4b3-4ce8-b4a1-d3cafbced172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd16a9bceaf834631ba6446a28ed17956', 'request_id': 'req-9b0f88c2-c4b3-4ce8-b4a1-d3cafbced172'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:02.705631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9b0f88c2-c4b3-4ce8-b4a1-d3cafbced172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd16a9bceaf834631ba6446a28ed17956', 'request_id': 'req-9b0f88c2-c4b3-4ce8-b4a1-d3cafbced172'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:02.717413 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9b0f88c2-c4b3-4ce8-b4a1-d3cafbced172 admin admin] The token cache is being invalidate because project d16a9bceaf834631ba6446a28ed17956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:02.718037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9b0f88c2-c4b3-4ce8-b4a1-d3cafbced172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:02.718254 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9b0f88c2-c4b3-4ce8-b4a1-d3cafbced172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:02.719906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1201/2394] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:02 2022] DELETE /identity/v3/projects/d16a9bceaf834631ba6446a28ed17956 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:02.725405 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f88c2-c4b3-4ce8-b4a1-d3cafbced172 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:02.727183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9b0f88c2-c4b3-4ce8-b4a1-d3cafbced172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:02.757960 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee02a1-5027-4764-b339-a935a478179f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:02.758677 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee02a1-5027-4764-b339-a935a478179f admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:02.758967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee02a1-5027-4764-b339-a935a478179f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:02.759389 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee02a1-5027-4764-b339-a935a478179f admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:02.760168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee02a1-5027-4764-b339-a935a478179f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:02.761782 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee02a1-5027-4764-b339-a935a478179f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:02.777228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1194/2395] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:02.781245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:02.781412 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee02a1-5027-4764-b339-a935a478179f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:02.784129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-37ee02a1-5027-4764-b339-a935a478179f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:02.795786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f88c2-c4b3-4ce8-b4a1-d3cafbced172 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:02.796909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee02a1-5027-4764-b339-a935a478179f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:02.801489 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebcfaf-a514-4318-b8ef-da7f4dfbad5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:02.802235 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a526bd-72e9-4f31-a72c-bd043bad5562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:02.802383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebcfaf-a514-4318-b8ef-da7f4dfbad5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:02.802630 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebcfaf-a514-4318-b8ef-da7f4dfbad5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:02.802906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebcfaf-a514-4318-b8ef-da7f4dfbad5f admin admin] PATH_INFO: `/v3/users/0c0a198a860f46bf9449bd85189974b4` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:02.803114 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a526bd-72e9-4f31-a72c-bd043bad5562 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:02.803404 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a526bd-72e9-4f31-a72c-bd043bad5562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:02.803686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a526bd-72e9-4f31-a72c-bd043bad5562 admin admin] PATH_INFO: `/v3/projects/1b6e059c95474ccaaab00e79a48ce49c/users/c540fef0d8704ae5ad607968985972da/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:02.804229 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebcfaf-a514-4318-b8ef-da7f4dfbad5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c0a198a860f46bf9449bd85189974b4)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:02.806217 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebcfaf-a514-4318-b8ef-da7f4dfbad5f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:02.819130 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a526bd-72e9-4f31-a72c-bd043bad5562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6e059c95474ccaaab00e79a48ce49c, user_id=c540fef0d8704ae5ad607968985972da, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:02.821841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a526bd-72e9-4f31-a72c-bd043bad5562 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:02.836069 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1195/2396] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:02 2022] PUT /identity/v3/projects/1b6e059c95474ccaaab00e79a48ce49c/users/c540fef0d8704ae5ad607968985972da/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:14:02.840189 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a526bd-72e9-4f31-a72c-bd043bad5562 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:02.854889 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-71ebcfaf-a514-4318-b8ef-da7f4dfbad5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c0a198a860f46bf9449bd85189974b4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:02.863421 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-71ebcfaf-a514-4318-b8ef-da7f4dfbad5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c0a198a860f46bf9449bd85189974b4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:02.877384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-71ebcfaf-a514-4318-b8ef-da7f4dfbad5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c0a198a860f46bf9449bd85189974b4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:02.878273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-71ebcfaf-a514-4318-b8ef-da7f4dfbad5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c0a198a860f46bf9449bd85189974b4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:02.886095 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-71ebcfaf-a514-4318-b8ef-da7f4dfbad5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c0a198a860f46bf9449bd85189974b4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:02.892526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1202/2397] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:02 2022] DELETE /identity/v3/users/0c0a198a860f46bf9449bd85189974b4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:02.905160 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a526bd-72e9-4f31-a72c-bd043bad5562 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:02.936727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:02.980327 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603e17d-7d74-4a09-b5bb-1c112fad7bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:02.980925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603e17d-7d74-4a09-b5bb-1c112fad7bab admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:02.981215 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603e17d-7d74-4a09-b5bb-1c112fad7bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:02.981493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603e17d-7d74-4a09-b5bb-1c112fad7bab admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:02.982224 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603e17d-7d74-4a09-b5bb-1c112fad7bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:02.983864 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603e17d-7d74-4a09-b5bb-1c112fad7bab admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:02.996041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1196/2398] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:14:03.000147 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebcfaf-a514-4318-b8ef-da7f4dfbad5f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:03.002281 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-71ebcfaf-a514-4318-b8ef-da7f4dfbad5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:03.015582 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebcfaf-a514-4318-b8ef-da7f4dfbad5f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:03.020985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546057a4-3199-48f8-b274-f69deddc2e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:03.021970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546057a4-3199-48f8-b274-f69deddc2e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:03.022329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546057a4-3199-48f8-b274-f69deddc2e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:03.022685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546057a4-3199-48f8-b274-f69deddc2e62 admin admin] PATH_INFO: `/v3/projects/1b6e059c95474ccaaab00e79a48ce49c/users/c540fef0d8704ae5ad607968985972da/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:03.024799 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546057a4-3199-48f8-b274-f69deddc2e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6e059c95474ccaaab00e79a48ce49c, user_id=c540fef0d8704ae5ad607968985972da, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:03.027525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546057a4-3199-48f8-b274-f69deddc2e62 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:03.038796 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1203/2399] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:02 2022] PUT /identity/v3/projects/1b6e059c95474ccaaab00e79a48ce49c/users/c540fef0d8704ae5ad607968985972da/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:03.049862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51afcf2-2a5a-4826-8240-ec7e3b2c0a6b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:03.050677 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51afcf2-2a5a-4826-8240-ec7e3b2c0a6b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:03.051039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51afcf2-2a5a-4826-8240-ec7e3b2c0a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:03.079629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d51afcf2-2a5a-4826-8240-ec7e3b2c0a6b None None] MFA Rules not processed for user `c540fef0d8704ae5ad607968985972da`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:03.080943 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d51afcf2-2a5a-4826-8240-ec7e3b2c0a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:03.151757 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1197/2400] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:03 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:03.165474 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546057a4-3199-48f8-b274-f69deddc2e62 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:03.167473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-546057a4-3199-48f8-b274-f69deddc2e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:03.178314 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51afcf2-2a5a-4826-8240-ec7e3b2c0a6b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:03.180261 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d51afcf2-2a5a-4826-8240-ec7e3b2c0a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:03.237785 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546057a4-3199-48f8-b274-f69deddc2e62 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:03.241487 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfda53-e306-47fd-9d07-fc79fc4c73ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:03.242156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfda53-e306-47fd-9d07-fc79fc4c73ec service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:03.242437 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfda53-e306-47fd-9d07-fc79fc4c73ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:03.242712 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfda53-e306-47fd-9d07-fc79fc4c73ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:03.251531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfda53-e306-47fd-9d07-fc79fc4c73ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:03.253426 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51afcf2-2a5a-4826-8240-ec7e3b2c0a6b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:03.253995 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfda53-e306-47fd-9d07-fc79fc4c73ec service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:03.258312 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c61fe1-ac23-459b-981c-cfbe39d597f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:03.259199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c61fe1-ac23-459b-981c-cfbe39d597f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:03.259486 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c61fe1-ac23-459b-981c-cfbe39d597f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:03.259765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c61fe1-ac23-459b-981c-cfbe39d597f2 admin admin] PATH_INFO: `/v3/projects/01b94d4de55a4a26ac3deb1f756c3d07` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:03.260989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c61fe1-ac23-459b-981c-cfbe39d597f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b94d4de55a4a26ac3deb1f756c3d07)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:03.262946 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c61fe1-ac23-459b-981c-cfbe39d597f2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:03.263794 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1204/2401] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:03 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:03.313036 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e1c61fe1-ac23-459b-981c-cfbe39d597f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b94d4de55a4a26ac3deb1f756c3d07', 'request_id': 'req-e1c61fe1-ac23-459b-981c-cfbe39d597f2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:03.317781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:03.321304 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e1c61fe1-ac23-459b-981c-cfbe39d597f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b94d4de55a4a26ac3deb1f756c3d07', 'request_id': 'req-e1c61fe1-ac23-459b-981c-cfbe39d597f2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:03.330687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e1c61fe1-ac23-459b-981c-cfbe39d597f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b94d4de55a4a26ac3deb1f756c3d07', 'request_id': 'req-e1c61fe1-ac23-459b-981c-cfbe39d597f2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:03.345285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfda53-e306-47fd-9d07-fc79fc4c73ec service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:03.347059 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d9cfda53-e306-47fd-9d07-fc79fc4c73ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:03.348119 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e1c61fe1-ac23-459b-981c-cfbe39d597f2 admin admin] The token cache is being invalidate because project 01b94d4de55a4a26ac3deb1f756c3d07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:03.348417 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e1c61fe1-ac23-459b-981c-cfbe39d597f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:03.349093 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e1c61fe1-ac23-459b-981c-cfbe39d597f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:03.354436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1198/2402] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:03 2022] DELETE /identity/v3/projects/01b94d4de55a4a26ac3deb1f756c3d07 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:14:03.355954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d62ef2-5614-4ee1-856b-05bc1b18c51f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:03.356256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d62ef2-5614-4ee1-856b-05bc1b18c51f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:03.356541 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d62ef2-5614-4ee1-856b-05bc1b18c51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:03.360662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfda53-e306-47fd-9d07-fc79fc4c73ec service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:03.379084 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-09d62ef2-5614-4ee1-856b-05bc1b18c51f None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:03.380372 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-09d62ef2-5614-4ee1-856b-05bc1b18c51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:03.422937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9450486-70c7-40e2-ac0a-0629999da56a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:03.424402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9450486-70c7-40e2-ac0a-0629999da56a service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:03.425039 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9450486-70c7-40e2-ac0a-0629999da56a service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:03.425438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9450486-70c7-40e2-ac0a-0629999da56a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:03.427563 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e9450486-70c7-40e2-ac0a-0629999da56a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:03.444064 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1199/2403] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:03.444967 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:03.453143 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd966bc-4adc-43a8-b710-b09d8eaed774 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:03.453685 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd966bc-4adc-43a8-b710-b09d8eaed774 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:03.453975 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd966bc-4adc-43a8-b710-b09d8eaed774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:03.473051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-acd966bc-4adc-43a8-b710-b09d8eaed774 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:03.474279 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-acd966bc-4adc-43a8-b710-b09d8eaed774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:03.483031 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1200/2404] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:03.487607 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd966bc-4adc-43a8-b710-b09d8eaed774 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:03.496760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd966bc-4adc-43a8-b710-b09d8eaed774 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:03.496906 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9450486-70c7-40e2-ac0a-0629999da56a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:03.498234 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9450486-70c7-40e2-ac0a-0629999da56a service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:03.501459 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd77ac4-87ef-4ff6-930f-c7d214336422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:03.503035 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd77ac4-87ef-4ff6-930f-c7d214336422 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:03.503810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd77ac4-87ef-4ff6-930f-c7d214336422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:03.503810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd77ac4-87ef-4ff6-930f-c7d214336422 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:03.504475 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd77ac4-87ef-4ff6-930f-c7d214336422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:14:03.504786 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd77ac4-87ef-4ff6-930f-c7d214336422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:03.506521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd77ac4-87ef-4ff6-930f-c7d214336422 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:03.508287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1205/2405] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:03 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:14:03.520577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1201/2406] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:14:03.524911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9450486-70c7-40e2-ac0a-0629999da56a service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:03.536584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9450486-70c7-40e2-ac0a-0629999da56a service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:03.541319 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d4e9d-03cd-409b-b48c-29f3fe3ae639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:03.542072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d4e9d-03cd-409b-b48c-29f3fe3ae639 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:03.542364 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d4e9d-03cd-409b-b48c-29f3fe3ae639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:03.542642 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d4e9d-03cd-409b-b48c-29f3fe3ae639 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:03.543458 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d4e9d-03cd-409b-b48c-29f3fe3ae639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:03.545409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d4e9d-03cd-409b-b48c-29f3fe3ae639 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:03.578944 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1206/2407] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:03 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:03.582472 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd77ac4-87ef-4ff6-930f-c7d214336422 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:03.593309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd77ac4-87ef-4ff6-930f-c7d214336422 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:03.658995 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb93b5f-41fe-4ab7-a9eb-11c4af78a751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:03.659680 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb93b5f-41fe-4ab7-a9eb-11c4af78a751 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:03.660000 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb93b5f-41fe-4ab7-a9eb-11c4af78a751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:03.660284 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb93b5f-41fe-4ab7-a9eb-11c4af78a751 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:03.660989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb93b5f-41fe-4ab7-a9eb-11c4af78a751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:03.662907 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb93b5f-41fe-4ab7-a9eb-11c4af78a751 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:03.682030 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1202/2408] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:03 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:14:03.686288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d4e9d-03cd-409b-b48c-29f3fe3ae639 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:03.697750 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d4e9d-03cd-409b-b48c-29f3fe3ae639 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:03.702570 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02d8d7-14bc-4c43-8b21-b12b5b922ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:03.703226 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02d8d7-14bc-4c43-8b21-b12b5b922ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:03.703510 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02d8d7-14bc-4c43-8b21-b12b5b922ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:03.703789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02d8d7-14bc-4c43-8b21-b12b5b922ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:03.704583 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02d8d7-14bc-4c43-8b21-b12b5b922ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:03.706798 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02d8d7-14bc-4c43-8b21-b12b5b922ef2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:03.718299 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1207/2409] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:03.723323 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb93b5f-41fe-4ab7-a9eb-11c4af78a751 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:03.733720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb93b5f-41fe-4ab7-a9eb-11c4af78a751 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:03.738556 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885c624-5801-4893-b5a0-811e213b660e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:03.739214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885c624-5801-4893-b5a0-811e213b660e admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:03.739505 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885c624-5801-4893-b5a0-811e213b660e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:03.739788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885c624-5801-4893-b5a0-811e213b660e admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:03.740549 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885c624-5801-4893-b5a0-811e213b660e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:03.742159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885c624-5801-4893-b5a0-811e213b660e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:03.752594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1203/2410] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:03.756674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02d8d7-14bc-4c43-8b21-b12b5b922ef2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:03.766862 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02d8d7-14bc-4c43-8b21-b12b5b922ef2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:03.775122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0342d7b-16b7-4eca-8da6-e2cd44e0c191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:03.775122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0342d7b-16b7-4eca-8da6-e2cd44e0c191 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:03.775122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0342d7b-16b7-4eca-8da6-e2cd44e0c191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:03.775122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0342d7b-16b7-4eca-8da6-e2cd44e0c191 admin admin] PATH_INFO: `/v3/projects/eda46a284b5f4c28a8d7458725a160bb/users/b45aca6ba9784a30a6b7e03a502c2d59/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:03.791158 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0342d7b-16b7-4eca-8da6-e2cd44e0c191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda46a284b5f4c28a8d7458725a160bb, user_id=b45aca6ba9784a30a6b7e03a502c2d59, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:03.793882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0342d7b-16b7-4eca-8da6-e2cd44e0c191 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:03.807750 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1208/2411] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:03 2022] PUT /identity/v3/projects/eda46a284b5f4c28a8d7458725a160bb/users/b45aca6ba9784a30a6b7e03a502c2d59/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:03.818328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c3b45-213c-422a-9c48-3fefa5f6806b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:03.818626 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c3b45-213c-422a-9c48-3fefa5f6806b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:03.818936 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c3b45-213c-422a-9c48-3fefa5f6806b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:03.845621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2b5c3b45-213c-422a-9c48-3fefa5f6806b None None] MFA Rules not processed for user `b45aca6ba9784a30a6b7e03a502c2d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:03.846699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2b5c3b45-213c-422a-9c48-3fefa5f6806b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:03.875839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:03.912457 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1204/2412] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:03.916933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0342d7b-16b7-4eca-8da6-e2cd44e0c191 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:03.978494 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0342d7b-16b7-4eca-8da6-e2cd44e0c191 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:03.983271 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb50b8-3fa6-4513-92e7-60e1767b9c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:03.983963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb50b8-3fa6-4513-92e7-60e1767b9c8b admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:03.984254 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb50b8-3fa6-4513-92e7-60e1767b9c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:03.984533 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb50b8-3fa6-4513-92e7-60e1767b9c8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:03.985240 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb50b8-3fa6-4513-92e7-60e1767b9c8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:03.987142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb50b8-3fa6-4513-92e7-60e1767b9c8b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:04.012094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1209/2413] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:03 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:04.016181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c3b45-213c-422a-9c48-3fefa5f6806b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:04.027388 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c3b45-213c-422a-9c48-3fefa5f6806b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:04.084064 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473e94c-73f9-48c6-a301-8a27de5a4ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:04.084737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473e94c-73f9-48c6-a301-8a27de5a4ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:04.085027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473e94c-73f9-48c6-a301-8a27de5a4ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:04.085317 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473e94c-73f9-48c6-a301-8a27de5a4ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:04.086010 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473e94c-73f9-48c6-a301-8a27de5a4ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:04.087989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473e94c-73f9-48c6-a301-8a27de5a4ee8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:04.108188 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1205/2414] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:04 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:04.113106 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb50b8-3fa6-4513-92e7-60e1767b9c8b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:04.123400 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb50b8-3fa6-4513-92e7-60e1767b9c8b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:04.128777 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743b234-5865-4e91-b9d0-6ee3e2ab2fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:04.129468 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743b234-5865-4e91-b9d0-6ee3e2ab2fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:04.129756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743b234-5865-4e91-b9d0-6ee3e2ab2fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:04.130039 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743b234-5865-4e91-b9d0-6ee3e2ab2fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:04.130778 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743b234-5865-4e91-b9d0-6ee3e2ab2fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:04.132412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743b234-5865-4e91-b9d0-6ee3e2ab2fa4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:04.142912 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1210/2415] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:14:04.146855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473e94c-73f9-48c6-a301-8a27de5a4ee8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:04.156760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473e94c-73f9-48c6-a301-8a27de5a4ee8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:04.161355 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e70b1-4a3a-4844-80b3-da7b7372c5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:04.162230 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e70b1-4a3a-4844-80b3-da7b7372c5ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:04.162519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e70b1-4a3a-4844-80b3-da7b7372c5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:04.162799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e70b1-4a3a-4844-80b3-da7b7372c5ec admin admin] PATH_INFO: `/v3/projects/81480052d301467ab1dc700f3205b893/users/19fbc448168c414da38996063dae2af0/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:04.177844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e70b1-4a3a-4844-80b3-da7b7372c5ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=81480052d301467ab1dc700f3205b893, user_id=19fbc448168c414da38996063dae2af0, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:04.180551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e70b1-4a3a-4844-80b3-da7b7372c5ec admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:04.194199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1206/2416] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:04 2022] PUT /identity/v3/projects/81480052d301467ab1dc700f3205b893/users/19fbc448168c414da38996063dae2af0/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:04.198218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743b234-5865-4e91-b9d0-6ee3e2ab2fa4 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:04.208033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743b234-5865-4e91-b9d0-6ee3e2ab2fa4 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:04.238467 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:04.266320 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454449a-d9a4-40e6-a51e-8de3bd11aed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:04.266916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454449a-d9a4-40e6-a51e-8de3bd11aed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:04.267239 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454449a-d9a4-40e6-a51e-8de3bd11aed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:04.267619 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454449a-d9a4-40e6-a51e-8de3bd11aed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:04.268378 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454449a-d9a4-40e6-a51e-8de3bd11aed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:04.269966 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454449a-d9a4-40e6-a51e-8de3bd11aed7 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:04.279441 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1211/2417] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:04.283568 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e70b1-4a3a-4844-80b3-da7b7372c5ec admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:04.294066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e70b1-4a3a-4844-80b3-da7b7372c5ec admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:04.299171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b78fa-472c-4e78-961e-5b7406c13210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:04.300116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b78fa-472c-4e78-961e-5b7406c13210 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:04.300410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b78fa-472c-4e78-961e-5b7406c13210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:04.300691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b78fa-472c-4e78-961e-5b7406c13210 admin admin] PATH_INFO: `/v3/projects/81480052d301467ab1dc700f3205b893/users/19fbc448168c414da38996063dae2af0/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:04.302657 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b78fa-472c-4e78-961e-5b7406c13210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81480052d301467ab1dc700f3205b893, user_id=19fbc448168c414da38996063dae2af0, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:04.305361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b78fa-472c-4e78-961e-5b7406c13210 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:04.316474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1207/2418] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:04 2022] PUT /identity/v3/projects/81480052d301467ab1dc700f3205b893/users/19fbc448168c414da38996063dae2af0/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:04.327791 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbc112-e927-4dba-b6b1-ac7ca7d0e64a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:04.328147 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbc112-e927-4dba-b6b1-ac7ca7d0e64a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:04.328437 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbc112-e927-4dba-b6b1-ac7ca7d0e64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:04.355095 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a0dbc112-e927-4dba-b6b1-ac7ca7d0e64a None None] MFA Rules not processed for user `19fbc448168c414da38996063dae2af0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:04.356329 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a0dbc112-e927-4dba-b6b1-ac7ca7d0e64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:04.426579 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1212/2419] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:04.437675 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b78fa-472c-4e78-961e-5b7406c13210 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:04.440064 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a89b78fa-472c-4e78-961e-5b7406c13210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:04.497788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b78fa-472c-4e78-961e-5b7406c13210 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:04.501422 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096cfd4-5684-4eff-97c8-ea12713032a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:04.502942 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096cfd4-5684-4eff-97c8-ea12713032a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:04.503226 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096cfd4-5684-4eff-97c8-ea12713032a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:04.503505 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096cfd4-5684-4eff-97c8-ea12713032a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:04.512944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096cfd4-5684-4eff-97c8-ea12713032a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:04.514394 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096cfd4-5684-4eff-97c8-ea12713032a9 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:04.524017 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1208/2420] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:04 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:04.606471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbc112-e927-4dba-b6b1-ac7ca7d0e64a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:04.616817 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbc112-e927-4dba-b6b1-ac7ca7d0e64a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:04.620504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6668b2-f23f-489d-8e4b-59906e1e7060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:04.621140 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6668b2-f23f-489d-8e4b-59906e1e7060 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:04.621439 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6668b2-f23f-489d-8e4b-59906e1e7060 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:04.621700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6668b2-f23f-489d-8e4b-59906e1e7060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:04.679426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6668b2-f23f-489d-8e4b-59906e1e7060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:04.680892 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6668b2-f23f-489d-8e4b-59906e1e7060 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:04.690623 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1213/2421] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:06.289137 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096cfd4-5684-4eff-97c8-ea12713032a9 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:06.290796 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e096cfd4-5684-4eff-97c8-ea12713032a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:06.338367 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:06.389574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096cfd4-5684-4eff-97c8-ea12713032a9 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:06.396923 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcee66-6b20-4d3d-9892-c6e2a7599059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:06.397822 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcee66-6b20-4d3d-9892-c6e2a7599059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:06.398091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcee66-6b20-4d3d-9892-c6e2a7599059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:06.398380 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcee66-6b20-4d3d-9892-c6e2a7599059 admin admin] PATH_INFO: `/v3/users/78e8e08bea6b4bf1be49c42b8cef678a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:06.399622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcee66-6b20-4d3d-9892-c6e2a7599059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78e8e08bea6b4bf1be49c42b8cef678a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:06.401599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcee66-6b20-4d3d-9892-c6e2a7599059 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:06.460857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f3bcee66-6b20-4d3d-9892-c6e2a7599059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78e8e08bea6b4bf1be49c42b8cef678a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:06.469557 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f3bcee66-6b20-4d3d-9892-c6e2a7599059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78e8e08bea6b4bf1be49c42b8cef678a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:06.484146 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f3bcee66-6b20-4d3d-9892-c6e2a7599059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78e8e08bea6b4bf1be49c42b8cef678a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:06.484862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f3bcee66-6b20-4d3d-9892-c6e2a7599059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78e8e08bea6b4bf1be49c42b8cef678a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:06.485479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f3bcee66-6b20-4d3d-9892-c6e2a7599059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78e8e08bea6b4bf1be49c42b8cef678a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:06.498944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1209/2422] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:06 2022] DELETE /identity/v3/users/78e8e08bea6b4bf1be49c42b8cef678a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:06.504985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90448a-c2f6-4462-b95c-d334b362939b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:06.505634 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90448a-c2f6-4462-b95c-d334b362939b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:06.505634 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90448a-c2f6-4462-b95c-d334b362939b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:06.524241 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8e90448a-c2f6-4462-b95c-d334b362939b None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:06.525771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8e90448a-c2f6-4462-b95c-d334b362939b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:06.588578 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:06.603871 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1214/2423] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:06.613187 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcee66-6b20-4d3d-9892-c6e2a7599059 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:06.614698 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f3bcee66-6b20-4d3d-9892-c6e2a7599059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:06.678330 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcee66-6b20-4d3d-9892-c6e2a7599059 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:06.682137 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76428d4a-b290-4d77-9e71-3151a16968bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:06.682792 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76428d4a-b290-4d77-9e71-3151a16968bd service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:06.683076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76428d4a-b290-4d77-9e71-3151a16968bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:06.683371 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76428d4a-b290-4d77-9e71-3151a16968bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:06.693775 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76428d4a-b290-4d77-9e71-3151a16968bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:06.695245 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76428d4a-b290-4d77-9e71-3151a16968bd service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:06.705834 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1210/2424] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:06.996720 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90448a-c2f6-4462-b95c-d334b362939b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:06.998214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8e90448a-c2f6-4462-b95c-d334b362939b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:07.040071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90448a-c2f6-4462-b95c-d334b362939b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:07.045084 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c824fca-9be8-48f2-b5fb-84c923a95d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:07.045931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c824fca-9be8-48f2-b5fb-84c923a95d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:07.046214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c824fca-9be8-48f2-b5fb-84c923a95d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:07.046517 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c824fca-9be8-48f2-b5fb-84c923a95d43 admin admin] PATH_INFO: `/v3/projects/220259c00e5240c9ba8a71fe64de8d94` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:07.047900 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c824fca-9be8-48f2-b5fb-84c923a95d43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=220259c00e5240c9ba8a71fe64de8d94)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:07.050315 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c824fca-9be8-48f2-b5fb-84c923a95d43 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:07.111853 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5c824fca-9be8-48f2-b5fb-84c923a95d43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '220259c00e5240c9ba8a71fe64de8d94', 'request_id': 'req-5c824fca-9be8-48f2-b5fb-84c923a95d43'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:07.118765 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5c824fca-9be8-48f2-b5fb-84c923a95d43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '220259c00e5240c9ba8a71fe64de8d94', 'request_id': 'req-5c824fca-9be8-48f2-b5fb-84c923a95d43'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:07.127861 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5c824fca-9be8-48f2-b5fb-84c923a95d43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '220259c00e5240c9ba8a71fe64de8d94', 'request_id': 'req-5c824fca-9be8-48f2-b5fb-84c923a95d43'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:07.139810 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5c824fca-9be8-48f2-b5fb-84c923a95d43 admin admin] The token cache is being invalidate because project 220259c00e5240c9ba8a71fe64de8d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:07.140142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5c824fca-9be8-48f2-b5fb-84c923a95d43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:07.140819 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5c824fca-9be8-48f2-b5fb-84c923a95d43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:07.142887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1215/2425] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:06 2022] DELETE /identity/v3/projects/220259c00e5240c9ba8a71fe64de8d94 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:07.146926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76428d4a-b290-4d77-9e71-3151a16968bd service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:07.157055 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76428d4a-b290-4d77-9e71-3151a16968bd service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:07.210089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:07.223265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c5c8b-9e2a-4607-9483-77df28a77322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:07.224591 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c5c8b-9e2a-4607-9483-77df28a77322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:07.224928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c5c8b-9e2a-4607-9483-77df28a77322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:07.225848 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c5c8b-9e2a-4607-9483-77df28a77322 admin admin] PATH_INFO: `/v3/users/c540fef0d8704ae5ad607968985972da` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:07.227535 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c5c8b-9e2a-4607-9483-77df28a77322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c540fef0d8704ae5ad607968985972da)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:07.229555 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c5c8b-9e2a-4607-9483-77df28a77322 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:07.282234 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e80c5c8b-9e2a-4607-9483-77df28a77322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c540fef0d8704ae5ad607968985972da'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:07.291168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e80c5c8b-9e2a-4607-9483-77df28a77322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c540fef0d8704ae5ad607968985972da'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:07.306003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e80c5c8b-9e2a-4607-9483-77df28a77322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c540fef0d8704ae5ad607968985972da'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:07.306690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e80c5c8b-9e2a-4607-9483-77df28a77322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c540fef0d8704ae5ad607968985972da'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:07.307343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e80c5c8b-9e2a-4607-9483-77df28a77322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c540fef0d8704ae5ad607968985972da'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:07.321548 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1211/2426] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:07 2022] DELETE /identity/v3/users/c540fef0d8704ae5ad607968985972da => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:07.608880 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c824fca-9be8-48f2-b5fb-84c923a95d43 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:07.610473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5c824fca-9be8-48f2-b5fb-84c923a95d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:07.624741 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c824fca-9be8-48f2-b5fb-84c923a95d43 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:07.691010 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd3811-75d4-4746-9bbe-7250d875ce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:07.691908 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd3811-75d4-4746-9bbe-7250d875ce98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:07.692198 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd3811-75d4-4746-9bbe-7250d875ce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:07.692480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd3811-75d4-4746-9bbe-7250d875ce98 admin admin] PATH_INFO: `/v3/projects/1b6e059c95474ccaaab00e79a48ce49c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:07.693674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd3811-75d4-4746-9bbe-7250d875ce98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6e059c95474ccaaab00e79a48ce49c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:07.695998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd3811-75d4-4746-9bbe-7250d875ce98 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:07.746499 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a5dd3811-75d4-4746-9bbe-7250d875ce98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6e059c95474ccaaab00e79a48ce49c', 'request_id': 'req-a5dd3811-75d4-4746-9bbe-7250d875ce98'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:07.756064 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a5dd3811-75d4-4746-9bbe-7250d875ce98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6e059c95474ccaaab00e79a48ce49c', 'request_id': 'req-a5dd3811-75d4-4746-9bbe-7250d875ce98'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:07.767014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a5dd3811-75d4-4746-9bbe-7250d875ce98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6e059c95474ccaaab00e79a48ce49c', 'request_id': 'req-a5dd3811-75d4-4746-9bbe-7250d875ce98'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:07.781843 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a5dd3811-75d4-4746-9bbe-7250d875ce98 admin admin] The token cache is being invalidate because project 1b6e059c95474ccaaab00e79a48ce49c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:07.782191 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a5dd3811-75d4-4746-9bbe-7250d875ce98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:07.783377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a5dd3811-75d4-4746-9bbe-7250d875ce98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:07.784992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1216/2427] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:07 2022] DELETE /identity/v3/projects/1b6e059c95474ccaaab00e79a48ce49c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:07.789774 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4814f-3c02-4ed4-afb8-17983978731b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:07.790144 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4814f-3c02-4ed4-afb8-17983978731b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:07.791129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4814f-3c02-4ed4-afb8-17983978731b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:07.809233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-85a4814f-3c02-4ed4-afb8-17983978731b None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:07.810297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-85a4814f-3c02-4ed4-afb8-17983978731b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:07.875857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1212/2428] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:07.883350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f951-d1f1-492d-bb3e-d1426e858368 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:07.883648 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f951-d1f1-492d-bb3e-d1426e858368 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:07.883974 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f951-d1f1-492d-bb3e-d1426e858368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:07.897740 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:07.905001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c0d2f951-d1f1-492d-bb3e-d1426e858368 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:07.907205 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c0d2f951-d1f1-492d-bb3e-d1426e858368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:07.921646 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1217/2429] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:07.925876 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4814f-3c02-4ed4-afb8-17983978731b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:07.936194 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4814f-3c02-4ed4-afb8-17983978731b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:07.941534 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d26b31-421e-40b1-bc85-1b9ca0c1f3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:07.942221 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d26b31-421e-40b1-bc85-1b9ca0c1f3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:07.942518 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d26b31-421e-40b1-bc85-1b9ca0c1f3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:07.942983 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d26b31-421e-40b1-bc85-1b9ca0c1f3b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:07.943756 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d26b31-421e-40b1-bc85-1b9ca0c1f3b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:14:07.944118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d26b31-421e-40b1-bc85-1b9ca0c1f3b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:07.945848 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d26b31-421e-40b1-bc85-1b9ca0c1f3b9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:07.961732 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1213/2430] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:14:07.962907 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2f951-d1f1-492d-bb3e-d1426e858368 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:07.973766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2f951-d1f1-492d-bb3e-d1426e858368 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:07.978813 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef00b48-84f8-4ec0-9e3f-cf7bf3af25d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:07.979553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef00b48-84f8-4ec0-9e3f-cf7bf3af25d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:07.979860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef00b48-84f8-4ec0-9e3f-cf7bf3af25d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:07.980145 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef00b48-84f8-4ec0-9e3f-cf7bf3af25d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:07.980843 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef00b48-84f8-4ec0-9e3f-cf7bf3af25d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:07.982729 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef00b48-84f8-4ec0-9e3f-cf7bf3af25d9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:08.013548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1218/2431] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:07 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:14:08.014549 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d26b31-421e-40b1-bc85-1b9ca0c1f3b9 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:08.026614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d26b31-421e-40b1-bc85-1b9ca0c1f3b9 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:08.084797 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:08.093824 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8a20f-142d-44bf-96eb-7658ba840826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:08.094327 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8a20f-142d-44bf-96eb-7658ba840826 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:08.094654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8a20f-142d-44bf-96eb-7658ba840826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:08.096012 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8a20f-142d-44bf-96eb-7658ba840826 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:08.096995 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8a20f-142d-44bf-96eb-7658ba840826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:08.099675 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8a20f-142d-44bf-96eb-7658ba840826 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:08.123605 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1214/2432] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:08 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:14:08.127215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef00b48-84f8-4ec0-9e3f-cf7bf3af25d9 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:08.138566 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef00b48-84f8-4ec0-9e3f-cf7bf3af25d9 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:08.147984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef6ff9-4519-4901-ade3-936e17bfc9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:08.148665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef6ff9-4519-4901-ade3-936e17bfc9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:08.149018 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef6ff9-4519-4901-ade3-936e17bfc9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:08.149327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef6ff9-4519-4901-ade3-936e17bfc9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:08.150163 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef6ff9-4519-4901-ade3-936e17bfc9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:08.151777 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef6ff9-4519-4901-ade3-936e17bfc9e9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:08.168891 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1219/2433] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:14:08.170464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8a20f-142d-44bf-96eb-7658ba840826 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:08.180633 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8a20f-142d-44bf-96eb-7658ba840826 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:08.185273 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e84fb5-ad13-4d10-8595-13554d702b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:08.185934 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e84fb5-ad13-4d10-8595-13554d702b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:08.186219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e84fb5-ad13-4d10-8595-13554d702b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:08.186494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e84fb5-ad13-4d10-8595-13554d702b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:08.187210 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e84fb5-ad13-4d10-8595-13554d702b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:08.188878 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e84fb5-ad13-4d10-8595-13554d702b7c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:08.199211 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1215/2434] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:08.203341 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef6ff9-4519-4901-ade3-936e17bfc9e9 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:08.214632 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef6ff9-4519-4901-ade3-936e17bfc9e9 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:08.219760 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018e3c3-bf92-407e-82a4-b8d1ed1c8d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:08.221615 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018e3c3-bf92-407e-82a4-b8d1ed1c8d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:08.221896 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018e3c3-bf92-407e-82a4-b8d1ed1c8d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:08.222172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018e3c3-bf92-407e-82a4-b8d1ed1c8d74 admin admin] PATH_INFO: `/v3/projects/7310df6faafa4c2ca3accf5a96d9f07e/users/f6fa47731ecc48f8b31abddb0d774038/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:08.238648 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018e3c3-bf92-407e-82a4-b8d1ed1c8d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7310df6faafa4c2ca3accf5a96d9f07e, user_id=f6fa47731ecc48f8b31abddb0d774038, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:08.241353 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018e3c3-bf92-407e-82a4-b8d1ed1c8d74 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:08.255574 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1220/2435] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:08 2022] PUT /identity/v3/projects/7310df6faafa4c2ca3accf5a96d9f07e/users/f6fa47731ecc48f8b31abddb0d774038/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:08.266706 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342dcc3-d81b-470a-b4c3-66b70693bbde None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:08.267159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342dcc3-d81b-470a-b4c3-66b70693bbde None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:08.268001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342dcc3-d81b-470a-b4c3-66b70693bbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:08.303870 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6342dcc3-d81b-470a-b4c3-66b70693bbde None None] MFA Rules not processed for user `f6fa47731ecc48f8b31abddb0d774038`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:08.305102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6342dcc3-d81b-470a-b4c3-66b70693bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:08.390404 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1216/2436] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:08.395720 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018e3c3-bf92-407e-82a4-b8d1ed1c8d74 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:08.462417 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018e3c3-bf92-407e-82a4-b8d1ed1c8d74 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:08.467293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da912a-c9c3-492a-b0c8-551ec4c2acbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:08.467994 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da912a-c9c3-492a-b0c8-551ec4c2acbb admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:08.468309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da912a-c9c3-492a-b0c8-551ec4c2acbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:08.468561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da912a-c9c3-492a-b0c8-551ec4c2acbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:08.469263 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da912a-c9c3-492a-b0c8-551ec4c2acbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:08.471178 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da912a-c9c3-492a-b0c8-551ec4c2acbb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:08.497718 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1221/2437] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:08 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:08.501069 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342dcc3-d81b-470a-b4c3-66b70693bbde None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:08.512436 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342dcc3-d81b-470a-b4c3-66b70693bbde None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:08.570384 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dafe37-54b0-4b69-a446-59e0f9a5c16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:08.571059 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dafe37-54b0-4b69-a446-59e0f9a5c16a admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:08.571348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dafe37-54b0-4b69-a446-59e0f9a5c16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:08.571661 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dafe37-54b0-4b69-a446-59e0f9a5c16a admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:08.572360 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dafe37-54b0-4b69-a446-59e0f9a5c16a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:08.574326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dafe37-54b0-4b69-a446-59e0f9a5c16a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:08.593619 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1217/2438] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:08 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:08.598201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da912a-c9c3-492a-b0c8-551ec4c2acbb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:08.608957 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da912a-c9c3-492a-b0c8-551ec4c2acbb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:08.615222 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51526dc6-6965-49ff-905d-2acac9a9b25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:08.616000 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51526dc6-6965-49ff-905d-2acac9a9b25a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:08.616399 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51526dc6-6965-49ff-905d-2acac9a9b25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:08.616698 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51526dc6-6965-49ff-905d-2acac9a9b25a admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:08.617533 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51526dc6-6965-49ff-905d-2acac9a9b25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:08.619407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51526dc6-6965-49ff-905d-2acac9a9b25a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:08.631479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1222/2439] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:08.635373 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dafe37-54b0-4b69-a446-59e0f9a5c16a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:08.645711 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dafe37-54b0-4b69-a446-59e0f9a5c16a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:08.652237 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc6d81-e4a5-4e5d-8e1e-a727972f026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:08.652985 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc6d81-e4a5-4e5d-8e1e-a727972f026f admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:08.653339 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc6d81-e4a5-4e5d-8e1e-a727972f026f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:08.653687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc6d81-e4a5-4e5d-8e1e-a727972f026f admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:08.654521 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc6d81-e4a5-4e5d-8e1e-a727972f026f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:08.656168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc6d81-e4a5-4e5d-8e1e-a727972f026f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:08.667630 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1218/2440] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:08.671796 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51526dc6-6965-49ff-905d-2acac9a9b25a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:08.682493 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51526dc6-6965-49ff-905d-2acac9a9b25a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:08.687154 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1b486-f194-4951-9ef7-f3470f66e929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:08.688064 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1b486-f194-4951-9ef7-f3470f66e929 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:08.688350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1b486-f194-4951-9ef7-f3470f66e929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:08.688633 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1b486-f194-4951-9ef7-f3470f66e929 admin admin] PATH_INFO: `/v3/projects/67efe92459aa4e45b19951ff5aa70d06/users/1ce85ded4a374bcb80b4774672709c40/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:08.703676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1b486-f194-4951-9ef7-f3470f66e929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67efe92459aa4e45b19951ff5aa70d06, user_id=1ce85ded4a374bcb80b4774672709c40, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:08.706530 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1b486-f194-4951-9ef7-f3470f66e929 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:08.719337 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1223/2441] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:08 2022] PUT /identity/v3/projects/67efe92459aa4e45b19951ff5aa70d06/users/1ce85ded4a374bcb80b4774672709c40/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:08.729772 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bc731-d4b2-4086-a156-f79b0e2ccd3b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:08.730063 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bc731-d4b2-4086-a156-f79b0e2ccd3b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:08.730340 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bc731-d4b2-4086-a156-f79b0e2ccd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:08.757750 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0b3bc731-d4b2-4086-a156-f79b0e2ccd3b None None] MFA Rules not processed for user `1ce85ded4a374bcb80b4774672709c40`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:08.758942 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0b3bc731-d4b2-4086-a156-f79b0e2ccd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:08.789763 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:08.825044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1219/2442] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:08.829559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1b486-f194-4951-9ef7-f3470f66e929 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:08.880570 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:08.891258 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1b486-f194-4951-9ef7-f3470f66e929 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:08.896232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806f77e-d445-42dc-8077-220750ed2712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:08.896889 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806f77e-d445-42dc-8077-220750ed2712 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:08.897178 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806f77e-d445-42dc-8077-220750ed2712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:08.897460 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806f77e-d445-42dc-8077-220750ed2712 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:08.898147 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806f77e-d445-42dc-8077-220750ed2712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:08.900098 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806f77e-d445-42dc-8077-220750ed2712 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:08.924803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1224/2443] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:08 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:08.928833 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bc731-d4b2-4086-a156-f79b0e2ccd3b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:08.939961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bc731-d4b2-4086-a156-f79b0e2ccd3b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:08.995718 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad5f09-595f-4057-9f8d-57726fcd8e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:08.996426 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad5f09-595f-4057-9f8d-57726fcd8e27 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:08.996714 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad5f09-595f-4057-9f8d-57726fcd8e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:08.996988 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad5f09-595f-4057-9f8d-57726fcd8e27 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:08.997704 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad5f09-595f-4057-9f8d-57726fcd8e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:08.999654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad5f09-595f-4057-9f8d-57726fcd8e27 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:09.019601 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1220/2444] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:08 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:14:09.023773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806f77e-d445-42dc-8077-220750ed2712 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:09.034479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806f77e-d445-42dc-8077-220750ed2712 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:09.039004 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e76ea9-52f7-46be-a423-4a7f0d6ade7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:09.039653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e76ea9-52f7-46be-a423-4a7f0d6ade7d admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:09.040001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e76ea9-52f7-46be-a423-4a7f0d6ade7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:09.040281 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e76ea9-52f7-46be-a423-4a7f0d6ade7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:09.041035 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e76ea9-52f7-46be-a423-4a7f0d6ade7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:09.042609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e76ea9-52f7-46be-a423-4a7f0d6ade7d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:09.053613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1225/2445] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:09.057688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad5f09-595f-4057-9f8d-57726fcd8e27 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:09.067928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad5f09-595f-4057-9f8d-57726fcd8e27 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:09.072558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8fe19-294c-4fc9-8066-f0c15b4d3456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:09.073430 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8fe19-294c-4fc9-8066-f0c15b4d3456 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:09.073744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8fe19-294c-4fc9-8066-f0c15b4d3456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:09.074028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8fe19-294c-4fc9-8066-f0c15b4d3456 admin admin] PATH_INFO: `/v3/projects/2d783a0d4084449a8ec8816b492555cf/users/467681d2f48c4496a6953aad68177e0c/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:09.088800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8fe19-294c-4fc9-8066-f0c15b4d3456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d783a0d4084449a8ec8816b492555cf, user_id=467681d2f48c4496a6953aad68177e0c, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:09.091463 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8fe19-294c-4fc9-8066-f0c15b4d3456 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:09.105462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1221/2446] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:09 2022] PUT /identity/v3/projects/2d783a0d4084449a8ec8816b492555cf/users/467681d2f48c4496a6953aad68177e0c/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:09.109492 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e76ea9-52f7-46be-a423-4a7f0d6ade7d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:09.120037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e76ea9-52f7-46be-a423-4a7f0d6ade7d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:09.176591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b773a-b48b-43a5-9550-4bd62b5d1d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:09.177253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b773a-b48b-43a5-9550-4bd62b5d1d75 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:09.177540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b773a-b48b-43a5-9550-4bd62b5d1d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:09.177814 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b773a-b48b-43a5-9550-4bd62b5d1d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:09.178541 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b773a-b48b-43a5-9550-4bd62b5d1d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:09.180161 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b773a-b48b-43a5-9550-4bd62b5d1d75 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:09.191884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1226/2447] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:09.196015 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8fe19-294c-4fc9-8066-f0c15b4d3456 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:09.206717 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8fe19-294c-4fc9-8066-f0c15b4d3456 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:09.211576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4511a0-1fc6-40cb-8a52-bc1b3614cd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:09.212524 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4511a0-1fc6-40cb-8a52-bc1b3614cd5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:09.212806 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4511a0-1fc6-40cb-8a52-bc1b3614cd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:09.213098 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4511a0-1fc6-40cb-8a52-bc1b3614cd5e admin admin] PATH_INFO: `/v3/projects/2d783a0d4084449a8ec8816b492555cf/users/467681d2f48c4496a6953aad68177e0c/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:09.215779 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4511a0-1fc6-40cb-8a52-bc1b3614cd5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d783a0d4084449a8ec8816b492555cf, user_id=467681d2f48c4496a6953aad68177e0c, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:09.218546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4511a0-1fc6-40cb-8a52-bc1b3614cd5e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:09.230425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1222/2448] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:09 2022] PUT /identity/v3/projects/2d783a0d4084449a8ec8816b492555cf/users/467681d2f48c4496a6953aad68177e0c/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:09.242341 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f07378-accb-4fd0-9dcf-1ebb40419d21 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:09.242688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f07378-accb-4fd0-9dcf-1ebb40419d21 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:09.242982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f07378-accb-4fd0-9dcf-1ebb40419d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:09.269130 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c8f07378-accb-4fd0-9dcf-1ebb40419d21 None None] MFA Rules not processed for user `467681d2f48c4496a6953aad68177e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:09.270357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c8f07378-accb-4fd0-9dcf-1ebb40419d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:09.338787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1227/2449] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:09.351427 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4511a0-1fc6-40cb-8a52-bc1b3614cd5e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:09.353500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-db4511a0-1fc6-40cb-8a52-bc1b3614cd5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:09.415961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4511a0-1fc6-40cb-8a52-bc1b3614cd5e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:09.420109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0dcba2-9773-4de6-b3d7-4a9c7a866871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:09.421199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dcba2-9773-4de6-b3d7-4a9c7a866871 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:09.421494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dcba2-9773-4de6-b3d7-4a9c7a866871 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:09.421930 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dcba2-9773-4de6-b3d7-4a9c7a866871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:09.432242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0dcba2-9773-4de6-b3d7-4a9c7a866871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:09.434537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0dcba2-9773-4de6-b3d7-4a9c7a866871 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:09.450285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1223/2450] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:09.499061 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f07378-accb-4fd0-9dcf-1ebb40419d21 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:09.509970 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f07378-accb-4fd0-9dcf-1ebb40419d21 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:09.513842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3efdcf-b538-4888-96ed-68e8721226fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:09.514525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3efdcf-b538-4888-96ed-68e8721226fb service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:09.514813 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3efdcf-b538-4888-96ed-68e8721226fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:09.515095 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3efdcf-b538-4888-96ed-68e8721226fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:09.566653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:09.582714 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3efdcf-b538-4888-96ed-68e8721226fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:09.584192 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3efdcf-b538-4888-96ed-68e8721226fb service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:09.594265 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1228/2451] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:09.688374 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0dcba2-9773-4de6-b3d7-4a9c7a866871 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:09.690480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ef0dcba2-9773-4de6-b3d7-4a9c7a866871 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:09.734978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:09.784229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0dcba2-9773-4de6-b3d7-4a9c7a866871 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:09.788823 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026657a8-5ee2-4ed0-80b2-a01ae8f0e620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:09.789703 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026657a8-5ee2-4ed0-80b2-a01ae8f0e620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:09.789989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026657a8-5ee2-4ed0-80b2-a01ae8f0e620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:09.790269 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026657a8-5ee2-4ed0-80b2-a01ae8f0e620 admin admin] PATH_INFO: `/v3/users/b45aca6ba9784a30a6b7e03a502c2d59` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:09.791462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026657a8-5ee2-4ed0-80b2-a01ae8f0e620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b45aca6ba9784a30a6b7e03a502c2d59)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:09.793439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026657a8-5ee2-4ed0-80b2-a01ae8f0e620 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:09.843940 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-026657a8-5ee2-4ed0-80b2-a01ae8f0e620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b45aca6ba9784a30a6b7e03a502c2d59'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:09.853412 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-026657a8-5ee2-4ed0-80b2-a01ae8f0e620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b45aca6ba9784a30a6b7e03a502c2d59'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:09.868854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-026657a8-5ee2-4ed0-80b2-a01ae8f0e620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b45aca6ba9784a30a6b7e03a502c2d59'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:09.869471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-026657a8-5ee2-4ed0-80b2-a01ae8f0e620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b45aca6ba9784a30a6b7e03a502c2d59'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:09.870258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-026657a8-5ee2-4ed0-80b2-a01ae8f0e620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b45aca6ba9784a30a6b7e03a502c2d59'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:09.889481 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1224/2452] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:09 2022] DELETE /identity/v3/users/b45aca6ba9784a30a6b7e03a502c2d59 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:09.894578 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf733ad2-37ae-49f7-b9e8-6da088544854 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:09.895057 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf733ad2-37ae-49f7-b9e8-6da088544854 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:09.895208 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf733ad2-37ae-49f7-b9e8-6da088544854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:09.913105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-bf733ad2-37ae-49f7-b9e8-6da088544854 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:09.914310 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bf733ad2-37ae-49f7-b9e8-6da088544854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:09.980621 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1229/2453] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:09.992073 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026657a8-5ee2-4ed0-80b2-a01ae8f0e620 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:09.993571 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-026657a8-5ee2-4ed0-80b2-a01ae8f0e620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:10.060156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026657a8-5ee2-4ed0-80b2-a01ae8f0e620 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:10.064434 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa539918-3ecc-4b68-a546-f5e7de5d4f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:10.065323 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa539918-3ecc-4b68-a546-f5e7de5d4f82 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:10.065611 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa539918-3ecc-4b68-a546-f5e7de5d4f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:10.065894 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa539918-3ecc-4b68-a546-f5e7de5d4f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:10.075562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa539918-3ecc-4b68-a546-f5e7de5d4f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:10.077069 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa539918-3ecc-4b68-a546-f5e7de5d4f82 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:10.087330 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1225/2454] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:10.377526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf733ad2-37ae-49f7-b9e8-6da088544854 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:10.378982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bf733ad2-37ae-49f7-b9e8-6da088544854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:10.390933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf733ad2-37ae-49f7-b9e8-6da088544854 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:10.396314 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e938f5-e373-4b47-8cb5-83c51d5be769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:10.397192 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e938f5-e373-4b47-8cb5-83c51d5be769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:10.397474 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e938f5-e373-4b47-8cb5-83c51d5be769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:10.397777 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e938f5-e373-4b47-8cb5-83c51d5be769 admin admin] PATH_INFO: `/v3/projects/eda46a284b5f4c28a8d7458725a160bb` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:10.398997 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e938f5-e373-4b47-8cb5-83c51d5be769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eda46a284b5f4c28a8d7458725a160bb)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:10.400961 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e938f5-e373-4b47-8cb5-83c51d5be769 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:10.455908 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-70e938f5-e373-4b47-8cb5-83c51d5be769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda46a284b5f4c28a8d7458725a160bb', 'request_id': 'req-70e938f5-e373-4b47-8cb5-83c51d5be769'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:10.462804 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-70e938f5-e373-4b47-8cb5-83c51d5be769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda46a284b5f4c28a8d7458725a160bb', 'request_id': 'req-70e938f5-e373-4b47-8cb5-83c51d5be769'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:10.471690 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-70e938f5-e373-4b47-8cb5-83c51d5be769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda46a284b5f4c28a8d7458725a160bb', 'request_id': 'req-70e938f5-e373-4b47-8cb5-83c51d5be769'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:10.486021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-70e938f5-e373-4b47-8cb5-83c51d5be769 admin admin] The token cache is being invalidate because project eda46a284b5f4c28a8d7458725a160bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:10.486463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-70e938f5-e373-4b47-8cb5-83c51d5be769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:10.487201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-70e938f5-e373-4b47-8cb5-83c51d5be769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:10.489075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1230/2455] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:10 2022] DELETE /identity/v3/projects/eda46a284b5f4c28a8d7458725a160bb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:10.493139 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa539918-3ecc-4b68-a546-f5e7de5d4f82 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:10.504049 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa539918-3ecc-4b68-a546-f5e7de5d4f82 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:10.559042 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:10.574363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f2bed-539f-48bb-94cd-926a502f4144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:10.575248 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f2bed-539f-48bb-94cd-926a502f4144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:10.575558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f2bed-539f-48bb-94cd-926a502f4144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:10.575865 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f2bed-539f-48bb-94cd-926a502f4144 admin admin] PATH_INFO: `/v3/users/19fbc448168c414da38996063dae2af0` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:10.577054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f2bed-539f-48bb-94cd-926a502f4144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19fbc448168c414da38996063dae2af0)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:10.579001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f2bed-539f-48bb-94cd-926a502f4144 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:10.630267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5e6f2bed-539f-48bb-94cd-926a502f4144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19fbc448168c414da38996063dae2af0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:10.638259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5e6f2bed-539f-48bb-94cd-926a502f4144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19fbc448168c414da38996063dae2af0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:10.651145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5e6f2bed-539f-48bb-94cd-926a502f4144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19fbc448168c414da38996063dae2af0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:10.651904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5e6f2bed-539f-48bb-94cd-926a502f4144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19fbc448168c414da38996063dae2af0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:10.652525 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5e6f2bed-539f-48bb-94cd-926a502f4144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19fbc448168c414da38996063dae2af0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:10.665641 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1226/2456] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:10 2022] DELETE /identity/v3/users/19fbc448168c414da38996063dae2af0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:10.951918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e938f5-e373-4b47-8cb5-83c51d5be769 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:10.953921 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-70e938f5-e373-4b47-8cb5-83c51d5be769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:10.971218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e938f5-e373-4b47-8cb5-83c51d5be769 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:11.046343 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2865c-d307-4819-958f-0cad8cdde262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:11.047295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2865c-d307-4819-958f-0cad8cdde262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:11.047635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2865c-d307-4819-958f-0cad8cdde262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:11.048014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2865c-d307-4819-958f-0cad8cdde262 admin admin] PATH_INFO: `/v3/projects/81480052d301467ab1dc700f3205b893` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:11.050450 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2865c-d307-4819-958f-0cad8cdde262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81480052d301467ab1dc700f3205b893)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:11.052892 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2865c-d307-4819-958f-0cad8cdde262 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:11.066469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:11.114604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d2e2865c-d307-4819-958f-0cad8cdde262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81480052d301467ab1dc700f3205b893', 'request_id': 'req-d2e2865c-d307-4819-958f-0cad8cdde262'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:11.122015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d2e2865c-d307-4819-958f-0cad8cdde262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81480052d301467ab1dc700f3205b893', 'request_id': 'req-d2e2865c-d307-4819-958f-0cad8cdde262'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:11.132989 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d2e2865c-d307-4819-958f-0cad8cdde262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81480052d301467ab1dc700f3205b893', 'request_id': 'req-d2e2865c-d307-4819-958f-0cad8cdde262'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:11.146214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d2e2865c-d307-4819-958f-0cad8cdde262 admin admin] The token cache is being invalidate because project 81480052d301467ab1dc700f3205b893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:11.146822 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d2e2865c-d307-4819-958f-0cad8cdde262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:11.147399 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d2e2865c-d307-4819-958f-0cad8cdde262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:11.149505 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1231/2457] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:10 2022] DELETE /identity/v3/projects/81480052d301467ab1dc700f3205b893 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:11.157385 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1aaab-08c9-4994-ae03-2cc2533cf030 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:11.157757 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1aaab-08c9-4994-ae03-2cc2533cf030 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:11.158720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1aaab-08c9-4994-ae03-2cc2533cf030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:11.177467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-aaf1aaab-08c9-4994-ae03-2cc2533cf030 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:11.178666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-aaf1aaab-08c9-4994-ae03-2cc2533cf030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:11.257788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1227/2458] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:11.270895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6053223-cd53-4e78-8c6d-3a53c69843bd None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:11.270895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6053223-cd53-4e78-8c6d-3a53c69843bd None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:11.270895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6053223-cd53-4e78-8c6d-3a53c69843bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:11.301190 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e6053223-cd53-4e78-8c6d-3a53c69843bd None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:11.305855 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e6053223-cd53-4e78-8c6d-3a53c69843bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:11.311223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1232/2459] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:14:11.315903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1aaab-08c9-4994-ae03-2cc2533cf030 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:11.329954 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1aaab-08c9-4994-ae03-2cc2533cf030 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:11.336853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed74ff5-8037-471b-a890-27c771aed261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:11.337604 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed74ff5-8037-471b-a890-27c771aed261 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:11.338169 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed74ff5-8037-471b-a890-27c771aed261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:11.338288 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed74ff5-8037-471b-a890-27c771aed261 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:11.339114 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed74ff5-8037-471b-a890-27c771aed261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:14:11.339469 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed74ff5-8037-471b-a890-27c771aed261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:11.341192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed74ff5-8037-471b-a890-27c771aed261 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:11.359165 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1228/2460] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:14:11.364574 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6053223-cd53-4e78-8c6d-3a53c69843bd None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:11.376039 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6053223-cd53-4e78-8c6d-3a53c69843bd None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:11.382395 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9b16c-077c-4b41-9622-df1e84766d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:11.383184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9b16c-077c-4b41-9622-df1e84766d14 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:11.383595 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9b16c-077c-4b41-9622-df1e84766d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:11.384021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9b16c-077c-4b41-9622-df1e84766d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:11.384872 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9b16c-077c-4b41-9622-df1e84766d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:11.387091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9b16c-077c-4b41-9622-df1e84766d14 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:11.420501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1233/2461] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:11 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:11.424574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed74ff5-8037-471b-a890-27c771aed261 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:11.436811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed74ff5-8037-471b-a890-27c771aed261 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:11.504334 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:11.512745 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ddec7-cf91-47d7-a19d-ec561aec70ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:11.513437 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ddec7-cf91-47d7-a19d-ec561aec70ab admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:11.513709 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ddec7-cf91-47d7-a19d-ec561aec70ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:11.513991 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ddec7-cf91-47d7-a19d-ec561aec70ab admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:11.514697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ddec7-cf91-47d7-a19d-ec561aec70ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:11.516761 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ddec7-cf91-47d7-a19d-ec561aec70ab admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:11.543561 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1229/2462] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:11 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:11.544859 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9b16c-077c-4b41-9622-df1e84766d14 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:11.555638 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9b16c-077c-4b41-9622-df1e84766d14 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:11.560304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c2cff-8c4c-40c8-b689-d107e653b7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:11.560954 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c2cff-8c4c-40c8-b689-d107e653b7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:11.561240 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c2cff-8c4c-40c8-b689-d107e653b7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:11.561515 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c2cff-8c4c-40c8-b689-d107e653b7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:11.562244 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c2cff-8c4c-40c8-b689-d107e653b7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:11.563861 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c2cff-8c4c-40c8-b689-d107e653b7b2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:11.574415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1234/2463] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:11.578397 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ddec7-cf91-47d7-a19d-ec561aec70ab admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:11.588499 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ddec7-cf91-47d7-a19d-ec561aec70ab admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:11.593141 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a225c-8891-4c1a-b351-793f123eca4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:11.593799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a225c-8891-4c1a-b351-793f123eca4a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:11.594086 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a225c-8891-4c1a-b351-793f123eca4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:11.594366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a225c-8891-4c1a-b351-793f123eca4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:11.595606 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a225c-8891-4c1a-b351-793f123eca4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:11.597231 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a225c-8891-4c1a-b351-793f123eca4a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:11.607194 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1230/2464] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:11.611949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c2cff-8c4c-40c8-b689-d107e653b7b2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:11.621717 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c2cff-8c4c-40c8-b689-d107e653b7b2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:11.626629 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a9985-0a83-43e6-89ba-7aef9b4b65be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:11.627546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a9985-0a83-43e6-89ba-7aef9b4b65be admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:11.627863 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a9985-0a83-43e6-89ba-7aef9b4b65be admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:11.628151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a9985-0a83-43e6-89ba-7aef9b4b65be admin admin] PATH_INFO: `/v3/projects/cd1f7d3f6294439090a64d1b442e0789/users/91cb81b73de1405899bfa73cecb8e1ae/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:11.643127 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a9985-0a83-43e6-89ba-7aef9b4b65be admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1f7d3f6294439090a64d1b442e0789, user_id=91cb81b73de1405899bfa73cecb8e1ae, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:11.645788 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a9985-0a83-43e6-89ba-7aef9b4b65be admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:11.659267 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1235/2465] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:11 2022] PUT /identity/v3/projects/cd1f7d3f6294439090a64d1b442e0789/users/91cb81b73de1405899bfa73cecb8e1ae/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:11.664425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294e794-0630-4f8c-b29d-22f88dc3db59 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:11.664723 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294e794-0630-4f8c-b29d-22f88dc3db59 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:11.665007 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294e794-0630-4f8c-b29d-22f88dc3db59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:11.682717 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2294e794-0630-4f8c-b29d-22f88dc3db59 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:11.683976 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2294e794-0630-4f8c-b29d-22f88dc3db59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:11.746177 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1231/2466] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:11.756203 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a9985-0a83-43e6-89ba-7aef9b4b65be admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:11.757924 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-233a9985-0a83-43e6-89ba-7aef9b4b65be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:11.817892 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a9985-0a83-43e6-89ba-7aef9b4b65be admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:11.821775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5df353-f05a-4f14-b7bc-8812860a11c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:11.822496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5df353-f05a-4f14-b7bc-8812860a11c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:11.822756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5df353-f05a-4f14-b7bc-8812860a11c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:11.823012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5df353-f05a-4f14-b7bc-8812860a11c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:11.833769 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5df353-f05a-4f14-b7bc-8812860a11c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:11.835304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5df353-f05a-4f14-b7bc-8812860a11c9 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:11.845712 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1236/2467] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:12.647731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294e794-0630-4f8c-b29d-22f88dc3db59 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:12.649646 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2294e794-0630-4f8c-b29d-22f88dc3db59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:12.662937 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294e794-0630-4f8c-b29d-22f88dc3db59 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:12.668462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ded4c0-90fc-4f25-81d7-58e93b490105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:12.669407 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ded4c0-90fc-4f25-81d7-58e93b490105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:12.669698 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ded4c0-90fc-4f25-81d7-58e93b490105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:12.669978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ded4c0-90fc-4f25-81d7-58e93b490105 admin admin] PATH_INFO: `/v3/users/f6fa47731ecc48f8b31abddb0d774038` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:12.671222 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ded4c0-90fc-4f25-81d7-58e93b490105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6fa47731ecc48f8b31abddb0d774038)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:12.674165 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ded4c0-90fc-4f25-81d7-58e93b490105 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:12.729509 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b1ded4c0-90fc-4f25-81d7-58e93b490105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6fa47731ecc48f8b31abddb0d774038'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:12.746233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b1ded4c0-90fc-4f25-81d7-58e93b490105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6fa47731ecc48f8b31abddb0d774038'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:12.767938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b1ded4c0-90fc-4f25-81d7-58e93b490105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6fa47731ecc48f8b31abddb0d774038'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:12.767938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b1ded4c0-90fc-4f25-81d7-58e93b490105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6fa47731ecc48f8b31abddb0d774038'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:12.767938 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b1ded4c0-90fc-4f25-81d7-58e93b490105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6fa47731ecc48f8b31abddb0d774038'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:12.803423 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1232/2468] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:12 2022] DELETE /identity/v3/users/f6fa47731ecc48f8b31abddb0d774038 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:14:12.805016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1c874-8239-423b-98e8-729c388f9514 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:12.805489 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1c874-8239-423b-98e8-729c388f9514 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:12.805612 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1c874-8239-423b-98e8-729c388f9514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:12.825808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e0e1c874-8239-423b-98e8-729c388f9514 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:12.827248 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e0e1c874-8239-423b-98e8-729c388f9514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:12.870028 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:12.902849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1237/2469] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:12.913597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ded4c0-90fc-4f25-81d7-58e93b490105 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:12.915217 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b1ded4c0-90fc-4f25-81d7-58e93b490105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:12.987688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:12.993249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ded4c0-90fc-4f25-81d7-58e93b490105 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:12.999890 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f3f72-92f7-4f65-83a6-7abdb8c2972f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:13.000923 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f3f72-92f7-4f65-83a6-7abdb8c2972f service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:13.002565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f3f72-92f7-4f65-83a6-7abdb8c2972f service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:13.003456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f3f72-92f7-4f65-83a6-7abdb8c2972f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:13.014032 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f3f72-92f7-4f65-83a6-7abdb8c2972f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:13.015726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f3f72-92f7-4f65-83a6-7abdb8c2972f service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:13.027649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1233/2470] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:13.354370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1c874-8239-423b-98e8-729c388f9514 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:13.356011 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e0e1c874-8239-423b-98e8-729c388f9514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:13.392361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1c874-8239-423b-98e8-729c388f9514 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:13.408002 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4488e50-6bb5-45be-9dc6-dca347ee1eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:13.410305 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4488e50-6bb5-45be-9dc6-dca347ee1eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:13.415228 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4488e50-6bb5-45be-9dc6-dca347ee1eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:13.415540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4488e50-6bb5-45be-9dc6-dca347ee1eb0 admin admin] PATH_INFO: `/v3/projects/7310df6faafa4c2ca3accf5a96d9f07e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:13.416949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4488e50-6bb5-45be-9dc6-dca347ee1eb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7310df6faafa4c2ca3accf5a96d9f07e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:13.418943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4488e50-6bb5-45be-9dc6-dca347ee1eb0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:13.504813 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b4488e50-6bb5-45be-9dc6-dca347ee1eb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7310df6faafa4c2ca3accf5a96d9f07e', 'request_id': 'req-b4488e50-6bb5-45be-9dc6-dca347ee1eb0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:13.511306 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b4488e50-6bb5-45be-9dc6-dca347ee1eb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7310df6faafa4c2ca3accf5a96d9f07e', 'request_id': 'req-b4488e50-6bb5-45be-9dc6-dca347ee1eb0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:13.524223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b4488e50-6bb5-45be-9dc6-dca347ee1eb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7310df6faafa4c2ca3accf5a96d9f07e', 'request_id': 'req-b4488e50-6bb5-45be-9dc6-dca347ee1eb0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:13.539861 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b4488e50-6bb5-45be-9dc6-dca347ee1eb0 admin admin] The token cache is being invalidate because project 7310df6faafa4c2ca3accf5a96d9f07e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:13.540388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b4488e50-6bb5-45be-9dc6-dca347ee1eb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:13.541138 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b4488e50-6bb5-45be-9dc6-dca347ee1eb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:13.542979 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1238/2471] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:13 2022] DELETE /identity/v3/projects/7310df6faafa4c2ca3accf5a96d9f07e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:13.546835 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f3f72-92f7-4f65-83a6-7abdb8c2972f service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:13.559119 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f3f72-92f7-4f65-83a6-7abdb8c2972f service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:13.625584 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31369d80-1910-4771-bf3f-92ccb7aac30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:13.626867 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31369d80-1910-4771-bf3f-92ccb7aac30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:13.627266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31369d80-1910-4771-bf3f-92ccb7aac30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:13.627732 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31369d80-1910-4771-bf3f-92ccb7aac30d admin admin] PATH_INFO: `/v3/users/1ce85ded4a374bcb80b4774672709c40` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:13.629157 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31369d80-1910-4771-bf3f-92ccb7aac30d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ce85ded4a374bcb80b4774672709c40)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:13.631479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31369d80-1910-4771-bf3f-92ccb7aac30d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:13.687140 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-31369d80-1910-4771-bf3f-92ccb7aac30d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ce85ded4a374bcb80b4774672709c40'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:13.700110 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-31369d80-1910-4771-bf3f-92ccb7aac30d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ce85ded4a374bcb80b4774672709c40'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:13.715228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-31369d80-1910-4771-bf3f-92ccb7aac30d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ce85ded4a374bcb80b4774672709c40'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:13.716006 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-31369d80-1910-4771-bf3f-92ccb7aac30d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ce85ded4a374bcb80b4774672709c40'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:13.716618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-31369d80-1910-4771-bf3f-92ccb7aac30d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ce85ded4a374bcb80b4774672709c40'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:13.733196 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1234/2472] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:13 2022] DELETE /identity/v3/users/1ce85ded4a374bcb80b4774672709c40 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:14:14.595761 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4488e50-6bb5-45be-9dc6-dca347ee1eb0 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:14.599610 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b4488e50-6bb5-45be-9dc6-dca347ee1eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:14.637575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4488e50-6bb5-45be-9dc6-dca347ee1eb0 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:14.813463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb533390-c938-457c-ad7d-e16d16472577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:14.815802 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb533390-c938-457c-ad7d-e16d16472577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:14.816790 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb533390-c938-457c-ad7d-e16d16472577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:14.816790 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb533390-c938-457c-ad7d-e16d16472577 admin admin] PATH_INFO: `/v3/projects/67efe92459aa4e45b19951ff5aa70d06` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:14.821390 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb533390-c938-457c-ad7d-e16d16472577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67efe92459aa4e45b19951ff5aa70d06)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:14.827285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb533390-c938-457c-ad7d-e16d16472577 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:14.927772 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bb533390-c938-457c-ad7d-e16d16472577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67efe92459aa4e45b19951ff5aa70d06', 'request_id': 'req-bb533390-c938-457c-ad7d-e16d16472577'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:14.944820 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bb533390-c938-457c-ad7d-e16d16472577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67efe92459aa4e45b19951ff5aa70d06', 'request_id': 'req-bb533390-c938-457c-ad7d-e16d16472577'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:14.963203 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bb533390-c938-457c-ad7d-e16d16472577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67efe92459aa4e45b19951ff5aa70d06', 'request_id': 'req-bb533390-c938-457c-ad7d-e16d16472577'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:14.969989 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:14.985601 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bb533390-c938-457c-ad7d-e16d16472577 admin admin] The token cache is being invalidate because project 67efe92459aa4e45b19951ff5aa70d06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:14.995283 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bb533390-c938-457c-ad7d-e16d16472577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:15.003467 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bb533390-c938-457c-ad7d-e16d16472577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:15.005611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1239/2473] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:14 2022] DELETE /identity/v3/projects/67efe92459aa4e45b19951ff5aa70d06 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:15.010048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31369d80-1910-4771-bf3f-92ccb7aac30d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:15.011516 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-31369d80-1910-4771-bf3f-92ccb7aac30d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:15.046967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31369d80-1910-4771-bf3f-92ccb7aac30d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:15.187026 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2dbd7-5a03-49fb-8d3f-52bb4cd13ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:15.189728 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2dbd7-5a03-49fb-8d3f-52bb4cd13ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:15.191684 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2dbd7-5a03-49fb-8d3f-52bb4cd13ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:15.192078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2dbd7-5a03-49fb-8d3f-52bb4cd13ffe admin admin] PATH_INFO: `/v3/users/467681d2f48c4496a6953aad68177e0c` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:15.194428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2dbd7-5a03-49fb-8d3f-52bb4cd13ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=467681d2f48c4496a6953aad68177e0c)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:15.199390 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2dbd7-5a03-49fb-8d3f-52bb4cd13ffe admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:15.222941 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:15.307048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-19b2dbd7-5a03-49fb-8d3f-52bb4cd13ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '467681d2f48c4496a6953aad68177e0c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:15.331970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-19b2dbd7-5a03-49fb-8d3f-52bb4cd13ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '467681d2f48c4496a6953aad68177e0c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:15.360325 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-19b2dbd7-5a03-49fb-8d3f-52bb4cd13ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '467681d2f48c4496a6953aad68177e0c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:15.365923 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-19b2dbd7-5a03-49fb-8d3f-52bb4cd13ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '467681d2f48c4496a6953aad68177e0c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:15.366784 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-19b2dbd7-5a03-49fb-8d3f-52bb4cd13ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '467681d2f48c4496a6953aad68177e0c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:15.393057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1235/2474] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:15 2022] DELETE /identity/v3/users/467681d2f48c4496a6953aad68177e0c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:15.877079 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb533390-c938-457c-ad7d-e16d16472577 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:15.878860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bb533390-c938-457c-ad7d-e16d16472577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:15.910092 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb533390-c938-457c-ad7d-e16d16472577 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:16.035375 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1ff0d-b4a1-4bd1-8981-dd75b49932d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:16.036671 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1ff0d-b4a1-4bd1-8981-dd75b49932d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:16.037182 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1ff0d-b4a1-4bd1-8981-dd75b49932d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:16.038101 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1ff0d-b4a1-4bd1-8981-dd75b49932d9 admin admin] PATH_INFO: `/v3/projects/2d783a0d4084449a8ec8816b492555cf` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:16.039538 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1ff0d-b4a1-4bd1-8981-dd75b49932d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d783a0d4084449a8ec8816b492555cf)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:16.041898 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1ff0d-b4a1-4bd1-8981-dd75b49932d9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:16.123859 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a1f1ff0d-b4a1-4bd1-8981-dd75b49932d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d783a0d4084449a8ec8816b492555cf', 'request_id': 'req-a1f1ff0d-b4a1-4bd1-8981-dd75b49932d9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:16.144483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a1f1ff0d-b4a1-4bd1-8981-dd75b49932d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d783a0d4084449a8ec8816b492555cf', 'request_id': 'req-a1f1ff0d-b4a1-4bd1-8981-dd75b49932d9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:16.156943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a1f1ff0d-b4a1-4bd1-8981-dd75b49932d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d783a0d4084449a8ec8816b492555cf', 'request_id': 'req-a1f1ff0d-b4a1-4bd1-8981-dd75b49932d9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:16.174116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a1f1ff0d-b4a1-4bd1-8981-dd75b49932d9 admin admin] The token cache is being invalidate because project 2d783a0d4084449a8ec8816b492555cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:16.174525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a1f1ff0d-b4a1-4bd1-8981-dd75b49932d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:16.175322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a1f1ff0d-b4a1-4bd1-8981-dd75b49932d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:16.177078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1240/2475] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:15 2022] DELETE /identity/v3/projects/2d783a0d4084449a8ec8816b492555cf => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:14:16.183335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2508180-d705-400e-8a24-ef2eaa500f7a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:16.183867 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2508180-d705-400e-8a24-ef2eaa500f7a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:16.184141 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2508180-d705-400e-8a24-ef2eaa500f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:16.205786 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e2508180-d705-400e-8a24-ef2eaa500f7a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:16.207174 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e2508180-d705-400e-8a24-ef2eaa500f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:16.283616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1236/2476] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:16.292239 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df9c30-729b-44cd-a94e-66c44672ab30 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:16.292535 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df9c30-729b-44cd-a94e-66c44672ab30 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:16.292938 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df9c30-729b-44cd-a94e-66c44672ab30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:16.319713 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b9df9c30-729b-44cd-a94e-66c44672ab30 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:16.321975 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b9df9c30-729b-44cd-a94e-66c44672ab30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:16.331019 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1241/2477] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:16.335181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2508180-d705-400e-8a24-ef2eaa500f7a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:16.345686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2508180-d705-400e-8a24-ef2eaa500f7a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:16.351854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5717cc-256e-424e-b866-4f70dccdca53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:16.352720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5717cc-256e-424e-b866-4f70dccdca53 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:16.353012 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5717cc-256e-424e-b866-4f70dccdca53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:16.353290 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5717cc-256e-424e-b866-4f70dccdca53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:16.354031 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5717cc-256e-424e-b866-4f70dccdca53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:14:16.354823 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5717cc-256e-424e-b866-4f70dccdca53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:16.356158 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5717cc-256e-424e-b866-4f70dccdca53 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:16.369828 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1237/2478] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:14:16.374306 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df9c30-729b-44cd-a94e-66c44672ab30 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:16.385453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df9c30-729b-44cd-a94e-66c44672ab30 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:16.390452 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807220f1-3597-4cc7-b33e-2850dcd5de56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:16.391110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807220f1-3597-4cc7-b33e-2850dcd5de56 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:16.391372 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807220f1-3597-4cc7-b33e-2850dcd5de56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:16.391703 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807220f1-3597-4cc7-b33e-2850dcd5de56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:16.393278 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807220f1-3597-4cc7-b33e-2850dcd5de56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:16.395392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807220f1-3597-4cc7-b33e-2850dcd5de56 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:16.434823 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1242/2479] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:16 2022] POST /identity/v3/projects => generated 359 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:16.435879 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5717cc-256e-424e-b866-4f70dccdca53 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:16.450796 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5717cc-256e-424e-b866-4f70dccdca53 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:16.554048 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdebc6-6459-49fe-b4ca-b5316728e075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:16.554860 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdebc6-6459-49fe-b4ca-b5316728e075 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:16.555150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdebc6-6459-49fe-b4ca-b5316728e075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:16.555429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdebc6-6459-49fe-b4ca-b5316728e075 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:16.557000 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdebc6-6459-49fe-b4ca-b5316728e075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:16.561542 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdebc6-6459-49fe-b4ca-b5316728e075 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:16.594482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1238/2480] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:16 2022] POST /identity/v3/users => generated 280 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:14:16.598806 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807220f1-3597-4cc7-b33e-2850dcd5de56 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:16.615142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807220f1-3597-4cc7-b33e-2850dcd5de56 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:16.623949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8baaa-768d-46ec-9e87-d4866b1f5322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:16.625125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8baaa-768d-46ec-9e87-d4866b1f5322 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:16.625125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8baaa-768d-46ec-9e87-d4866b1f5322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:16.625391 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8baaa-768d-46ec-9e87-d4866b1f5322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:16.625928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8baaa-768d-46ec-9e87-d4866b1f5322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:16.627856 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8baaa-768d-46ec-9e87-d4866b1f5322 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:16.646209 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1243/2481] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:14:16.650609 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdebc6-6459-49fe-b4ca-b5316728e075 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:16.659738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:16.665093 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdebc6-6459-49fe-b4ca-b5316728e075 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:16.672295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e0d99-d48b-43f3-abe4-b77c52da6d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:16.673046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e0d99-d48b-43f3-abe4-b77c52da6d3f admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:16.676467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e0d99-d48b-43f3-abe4-b77c52da6d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:16.678645 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e0d99-d48b-43f3-abe4-b77c52da6d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:16.680061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e0d99-d48b-43f3-abe4-b77c52da6d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:16.682369 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e0d99-d48b-43f3-abe4-b77c52da6d3f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:16.717352 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1239/2482] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:16.719168 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8baaa-768d-46ec-9e87-d4866b1f5322 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:16.741836 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8baaa-768d-46ec-9e87-d4866b1f5322 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:16.748272 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daf9e5-5bc4-4c8d-8acd-94506dfe8f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:16.749323 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daf9e5-5bc4-4c8d-8acd-94506dfe8f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:16.749790 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daf9e5-5bc4-4c8d-8acd-94506dfe8f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:16.750197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daf9e5-5bc4-4c8d-8acd-94506dfe8f29 admin admin] PATH_INFO: `/v3/projects/e77641661cdf445f8e012f0d2236cbfd/users/618859ef3a8b4aada2e21f9023dd9d63/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:16.789154 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43daf9e5-5bc4-4c8d-8acd-94506dfe8f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e77641661cdf445f8e012f0d2236cbfd, user_id=618859ef3a8b4aada2e21f9023dd9d63, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:16.792812 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43daf9e5-5bc4-4c8d-8acd-94506dfe8f29 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:16.822528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1244/2483] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:16 2022] PUT /identity/v3/projects/e77641661cdf445f8e012f0d2236cbfd/users/618859ef3a8b4aada2e21f9023dd9d63/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:16.835429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83574bf4-778c-42af-a822-706255163c9f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:16.835961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83574bf4-778c-42af-a822-706255163c9f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:16.836433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83574bf4-778c-42af-a822-706255163c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:16.884920 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-83574bf4-778c-42af-a822-706255163c9f None None] MFA Rules not processed for user `618859ef3a8b4aada2e21f9023dd9d63`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:16.886167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-83574bf4-778c-42af-a822-706255163c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:16.983482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1240/2484] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:16 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:17.047724 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daf9e5-5bc4-4c8d-8acd-94506dfe8f29 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:17.051106 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-43daf9e5-5bc4-4c8d-8acd-94506dfe8f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:17.078145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb25641-beb8-4f6b-aec9-4d0746fdcd82 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:17.078552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb25641-beb8-4f6b-aec9-4d0746fdcd82 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:17.078675 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb25641-beb8-4f6b-aec9-4d0746fdcd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:17.135496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:17.140230 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6eb25641-beb8-4f6b-aec9-4d0746fdcd82 None None] MFA Rules not processed for user `91cb81b73de1405899bfa73cecb8e1ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:17.141623 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6eb25641-beb8-4f6b-aec9-4d0746fdcd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:17.211285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daf9e5-5bc4-4c8d-8acd-94506dfe8f29 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:17.217444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b861c13-66ea-4acf-902d-549582623f4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:17.218612 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b861c13-66ea-4acf-902d-549582623f4f service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:17.219094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b861c13-66ea-4acf-902d-549582623f4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:17.220846 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b861c13-66ea-4acf-902d-549582623f4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:17.233050 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b861c13-66ea-4acf-902d-549582623f4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:17.237367 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b861c13-66ea-4acf-902d-549582623f4f service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:17.244141 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1241/2485] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:17.245992 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb25641-beb8-4f6b-aec9-4d0746fdcd82 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:17.247974 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6eb25641-beb8-4f6b-aec9-4d0746fdcd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:17.254410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1245/2486] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:17 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:17.271757 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b861c13-66ea-4acf-902d-549582623f4f service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:17.347737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb25641-beb8-4f6b-aec9-4d0746fdcd82 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:17.353911 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ab3c7-24dd-4f6d-924f-6b5a428fca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:17.355912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ab3c7-24dd-4f6d-924f-6b5a428fca7b admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:17.356204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ab3c7-24dd-4f6d-924f-6b5a428fca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:17.356485 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ab3c7-24dd-4f6d-924f-6b5a428fca7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:17.357201 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ab3c7-24dd-4f6d-924f-6b5a428fca7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:17.359523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ab3c7-24dd-4f6d-924f-6b5a428fca7b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:17.364631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b861c13-66ea-4acf-902d-549582623f4f service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:17.371332 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec738fcc-7824-4e64-8861-e71de6daaf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:17.372417 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec738fcc-7824-4e64-8861-e71de6daaf8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:17.372720 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec738fcc-7824-4e64-8861-e71de6daaf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:17.373005 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec738fcc-7824-4e64-8861-e71de6daaf8f admin admin] PATH_INFO: `/v3/users/618859ef3a8b4aada2e21f9023dd9d63` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:17.374248 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec738fcc-7824-4e64-8861-e71de6daaf8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=618859ef3a8b4aada2e21f9023dd9d63)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:17.377166 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec738fcc-7824-4e64-8861-e71de6daaf8f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:17.386017 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:17.404337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1242/2487] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:17 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:17.408441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ab3c7-24dd-4f6d-924f-6b5a428fca7b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:17.457443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ec738fcc-7824-4e64-8861-e71de6daaf8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '618859ef3a8b4aada2e21f9023dd9d63'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:17.472233 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ec738fcc-7824-4e64-8861-e71de6daaf8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '618859ef3a8b4aada2e21f9023dd9d63'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:17.494052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ab3c7-24dd-4f6d-924f-6b5a428fca7b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:17.496774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ec738fcc-7824-4e64-8861-e71de6daaf8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '618859ef3a8b4aada2e21f9023dd9d63'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:17.498001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ec738fcc-7824-4e64-8861-e71de6daaf8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '618859ef3a8b4aada2e21f9023dd9d63'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:17.502112 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705d754-98aa-4cc0-b3dc-5685ef93385e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:17.502406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705d754-98aa-4cc0-b3dc-5685ef93385e admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:17.502647 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705d754-98aa-4cc0-b3dc-5685ef93385e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:17.502812 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705d754-98aa-4cc0-b3dc-5685ef93385e admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:17.503617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705d754-98aa-4cc0-b3dc-5685ef93385e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:17.505585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705d754-98aa-4cc0-b3dc-5685ef93385e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:17.509140 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ec738fcc-7824-4e64-8861-e71de6daaf8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '618859ef3a8b4aada2e21f9023dd9d63'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:17.516153 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1246/2488] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:17 2022] DELETE /identity/v3/users/618859ef3a8b4aada2e21f9023dd9d63 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:17.523274 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0598fc-9499-46cf-bc22-47a604d516ff None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:17.523569 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0598fc-9499-46cf-bc22-47a604d516ff None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:17.524029 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0598fc-9499-46cf-bc22-47a604d516ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:17.536114 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1243/2489] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:17 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:17.540585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705d754-98aa-4cc0-b3dc-5685ef93385e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:17.543089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8705d754-98aa-4cc0-b3dc-5685ef93385e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:17.547233 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ce0598fc-9499-46cf-bc22-47a604d516ff None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:17.549074 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ce0598fc-9499-46cf-bc22-47a604d516ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:17.558451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705d754-98aa-4cc0-b3dc-5685ef93385e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:17.602756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:17.633277 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1247/2490] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:17.640445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741d229-7b9b-4b7e-b203-1859abaf2af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:17.641180 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741d229-7b9b-4b7e-b203-1859abaf2af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:17.641470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741d229-7b9b-4b7e-b203-1859abaf2af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:17.642012 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741d229-7b9b-4b7e-b203-1859abaf2af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:17.642585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741d229-7b9b-4b7e-b203-1859abaf2af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:17.644248 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741d229-7b9b-4b7e-b203-1859abaf2af5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:17.649542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0598fc-9499-46cf-bc22-47a604d516ff None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:17.651198 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ce0598fc-9499-46cf-bc22-47a604d516ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:17.656870 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1244/2491] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:17.660789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741d229-7b9b-4b7e-b203-1859abaf2af5 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:17.674830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741d229-7b9b-4b7e-b203-1859abaf2af5 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:17.680351 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e65758-0575-4465-bb95-67c35e8bda1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:17.681258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e65758-0575-4465-bb95-67c35e8bda1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:17.681546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e65758-0575-4465-bb95-67c35e8bda1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:17.681825 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e65758-0575-4465-bb95-67c35e8bda1a admin admin] PATH_INFO: `/v3/projects/4b5006e8f57a488fa7f3003d29882663/users/c6f69c6cfffb49d7ae3181cfa6216d59/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:17.698933 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e65758-0575-4465-bb95-67c35e8bda1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5006e8f57a488fa7f3003d29882663, user_id=c6f69c6cfffb49d7ae3181cfa6216d59, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:17.702065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e65758-0575-4465-bb95-67c35e8bda1a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:17.728501 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1245/2492] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:17 2022] PUT /identity/v3/projects/4b5006e8f57a488fa7f3003d29882663/users/c6f69c6cfffb49d7ae3181cfa6216d59/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:14:17.734473 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e65758-0575-4465-bb95-67c35e8bda1a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:17.746459 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0598fc-9499-46cf-bc22-47a604d516ff None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:17.812450 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54893d-8f45-4f54-8ca3-0c651ab066f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:17.813112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54893d-8f45-4f54-8ca3-0c651ab066f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:17.813400 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54893d-8f45-4f54-8ca3-0c651ab066f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:17.814258 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54893d-8f45-4f54-8ca3-0c651ab066f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:17.829454 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e65758-0575-4465-bb95-67c35e8bda1a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:17.835861 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f15d5-c990-4d25-bd56-8debc69ca4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:17.836629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f15d5-c990-4d25-bd56-8debc69ca4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:17.836994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f15d5-c990-4d25-bd56-8debc69ca4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:17.837174 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f15d5-c990-4d25-bd56-8debc69ca4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:17.837911 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f15d5-c990-4d25-bd56-8debc69ca4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:17.839904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f15d5-c990-4d25-bd56-8debc69ca4b6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:17.842360 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:17.857642 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1246/2493] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:17.862578 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f15d5-c990-4d25-bd56-8debc69ca4b6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:17.880569 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f15d5-c990-4d25-bd56-8debc69ca4b6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:17.889177 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b4ca3-955d-4587-8ef2-b55fb56f33d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:17.890149 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b4ca3-955d-4587-8ef2-b55fb56f33d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:17.890450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b4ca3-955d-4587-8ef2-b55fb56f33d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:17.890710 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b4ca3-955d-4587-8ef2-b55fb56f33d0 admin admin] PATH_INFO: `/v3/projects/4b5006e8f57a488fa7f3003d29882663/users/c6f69c6cfffb49d7ae3181cfa6216d59/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:17.893135 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b4ca3-955d-4587-8ef2-b55fb56f33d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5006e8f57a488fa7f3003d29882663, user_id=c6f69c6cfffb49d7ae3181cfa6216d59, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:17.896281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b4ca3-955d-4587-8ef2-b55fb56f33d0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:17.901964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54893d-8f45-4f54-8ca3-0c651ab066f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:17.903919 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54893d-8f45-4f54-8ca3-0c651ab066f0 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:17.913266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1247/2494] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:17 2022] PUT /identity/v3/projects/4b5006e8f57a488fa7f3003d29882663/users/c6f69c6cfffb49d7ae3181cfa6216d59/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:17.915655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1248/2495] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:14:18.321235 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b4ca3-955d-4587-8ef2-b55fb56f33d0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:18.323289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-237b4ca3-955d-4587-8ef2-b55fb56f33d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:18.430907 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b4ca3-955d-4587-8ef2-b55fb56f33d0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:18.439686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53074236-6312-41d8-bb8a-510a3174b785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:18.441381 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53074236-6312-41d8-bb8a-510a3174b785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:18.441814 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53074236-6312-41d8-bb8a-510a3174b785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:18.442172 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53074236-6312-41d8-bb8a-510a3174b785 admin admin] PATH_INFO: `/v3/projects/e77641661cdf445f8e012f0d2236cbfd` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:18.443559 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53074236-6312-41d8-bb8a-510a3174b785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e77641661cdf445f8e012f0d2236cbfd)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:18.446446 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53074236-6312-41d8-bb8a-510a3174b785 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:18.513504 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-53074236-6312-41d8-bb8a-510a3174b785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e77641661cdf445f8e012f0d2236cbfd', 'request_id': 'req-53074236-6312-41d8-bb8a-510a3174b785'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:18.522324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-53074236-6312-41d8-bb8a-510a3174b785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e77641661cdf445f8e012f0d2236cbfd', 'request_id': 'req-53074236-6312-41d8-bb8a-510a3174b785'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:18.529202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-53074236-6312-41d8-bb8a-510a3174b785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e77641661cdf445f8e012f0d2236cbfd', 'request_id': 'req-53074236-6312-41d8-bb8a-510a3174b785'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:18.541763 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-53074236-6312-41d8-bb8a-510a3174b785 admin admin] The token cache is being invalidate because project e77641661cdf445f8e012f0d2236cbfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:18.542052 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-53074236-6312-41d8-bb8a-510a3174b785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:18.542702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-53074236-6312-41d8-bb8a-510a3174b785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:18.544335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1248/2496] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:18 2022] DELETE /identity/v3/projects/e77641661cdf445f8e012f0d2236cbfd => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:18.549333 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8416e-7142-4953-bbb6-89410d5ae4df None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:18.550162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8416e-7142-4953-bbb6-89410d5ae4df None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:18.550452 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8416e-7142-4953-bbb6-89410d5ae4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:18.568628 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8ea8416e-7142-4953-bbb6-89410d5ae4df None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:18.569923 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8ea8416e-7142-4953-bbb6-89410d5ae4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:18.630128 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:18.651029 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1249/2497] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:18.660880 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13cf7a-66c8-46d7-8022-f7f3a80b6438 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:18.661241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13cf7a-66c8-46d7-8022-f7f3a80b6438 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:18.662284 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13cf7a-66c8-46d7-8022-f7f3a80b6438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:18.686325 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5b13cf7a-66c8-46d7-8022-f7f3a80b6438 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:18.687537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5b13cf7a-66c8-46d7-8022-f7f3a80b6438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:18.708422 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1249/2498] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:18.709750 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8416e-7142-4953-bbb6-89410d5ae4df None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:18.723583 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8416e-7142-4953-bbb6-89410d5ae4df None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:18.728966 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf4aaa-64fa-4b24-a2a9-2bcc7ef78b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:18.730172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf4aaa-64fa-4b24-a2a9-2bcc7ef78b81 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:18.730525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf4aaa-64fa-4b24-a2a9-2bcc7ef78b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:18.730992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf4aaa-64fa-4b24-a2a9-2bcc7ef78b81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:18.731737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf4aaa-64fa-4b24-a2a9-2bcc7ef78b81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:14:18.732228 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf4aaa-64fa-4b24-a2a9-2bcc7ef78b81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:18.734026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf4aaa-64fa-4b24-a2a9-2bcc7ef78b81 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:18.750468 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1250/2499] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:14:18.760749 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13cf7a-66c8-46d7-8022-f7f3a80b6438 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:18.780776 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13cf7a-66c8-46d7-8022-f7f3a80b6438 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:18.786267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcb984-ed69-4b30-b639-73bdd2111244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:18.786978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcb984-ed69-4b30-b639-73bdd2111244 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:18.787262 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcb984-ed69-4b30-b639-73bdd2111244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:18.787544 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcb984-ed69-4b30-b639-73bdd2111244 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:18.788368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcb984-ed69-4b30-b639-73bdd2111244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:18.790221 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcb984-ed69-4b30-b639-73bdd2111244 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:18.823941 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1250/2500] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:18 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:18.827894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf4aaa-64fa-4b24-a2a9-2bcc7ef78b81 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:18.839185 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf4aaa-64fa-4b24-a2a9-2bcc7ef78b81 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:18.926231 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d29eb-4f80-43f3-b2b8-448b1488eb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:18.926987 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d29eb-4f80-43f3-b2b8-448b1488eb77 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:18.927377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d29eb-4f80-43f3-b2b8-448b1488eb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:18.927766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d29eb-4f80-43f3-b2b8-448b1488eb77 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:18.928813 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d29eb-4f80-43f3-b2b8-448b1488eb77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:18.931748 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d29eb-4f80-43f3-b2b8-448b1488eb77 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:18.964504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1251/2501] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:18 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:14:18.966104 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcb984-ed69-4b30-b639-73bdd2111244 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:18.984533 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcb984-ed69-4b30-b639-73bdd2111244 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:18.990424 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7f22f-6683-4b21-bee4-03e2c795e3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:18.991119 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7f22f-6683-4b21-bee4-03e2c795e3ce admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:18.991507 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7f22f-6683-4b21-bee4-03e2c795e3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:18.993465 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7f22f-6683-4b21-bee4-03e2c795e3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:18.994288 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7f22f-6683-4b21-bee4-03e2c795e3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:18.995966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7f22f-6683-4b21-bee4-03e2c795e3ce admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:19.013981 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1251/2502] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:19.020654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d29eb-4f80-43f3-b2b8-448b1488eb77 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:19.037216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d29eb-4f80-43f3-b2b8-448b1488eb77 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:19.044086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecffd8d-268d-406f-aed8-666c42a5bba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:19.045571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecffd8d-268d-406f-aed8-666c42a5bba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:19.046467 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecffd8d-268d-406f-aed8-666c42a5bba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:19.046787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecffd8d-268d-406f-aed8-666c42a5bba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:19.047547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecffd8d-268d-406f-aed8-666c42a5bba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:19.049327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecffd8d-268d-406f-aed8-666c42a5bba4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:19.073597 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1252/2503] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:19.074978 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7f22f-6683-4b21-bee4-03e2c795e3ce admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:19.087657 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7f22f-6683-4b21-bee4-03e2c795e3ce admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:19.092998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3dca9-9345-4e89-b57a-9cfc52ac0237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:19.093914 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3dca9-9345-4e89-b57a-9cfc52ac0237 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:19.094207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3dca9-9345-4e89-b57a-9cfc52ac0237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:19.094828 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3dca9-9345-4e89-b57a-9cfc52ac0237 admin admin] PATH_INFO: `/v3/projects/ec81f9cac7314bbaa600271f94163d73/users/315da98b2e7e45e3b46febc71bc754d6/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:19.115406 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3dca9-9345-4e89-b57a-9cfc52ac0237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec81f9cac7314bbaa600271f94163d73, user_id=315da98b2e7e45e3b46febc71bc754d6, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:19.118285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3dca9-9345-4e89-b57a-9cfc52ac0237 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:19.134871 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1252/2504] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:19 2022] PUT /identity/v3/projects/ec81f9cac7314bbaa600271f94163d73/users/315da98b2e7e45e3b46febc71bc754d6/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:14:19.145400 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d33d5-7c21-4342-aeb3-169febcc713d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:19.145708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d33d5-7c21-4342-aeb3-169febcc713d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:19.145996 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d33d5-7c21-4342-aeb3-169febcc713d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:19.177468 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0c2d33d5-7c21-4342-aeb3-169febcc713d None None] MFA Rules not processed for user `315da98b2e7e45e3b46febc71bc754d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:19.178581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0c2d33d5-7c21-4342-aeb3-169febcc713d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:19.279968 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1253/2505] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:19.290512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3dca9-9345-4e89-b57a-9cfc52ac0237 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:19.292895 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-aac3dca9-9345-4e89-b57a-9cfc52ac0237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:19.308649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:19.384990 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3dca9-9345-4e89-b57a-9cfc52ac0237 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:19.390015 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af2699-4bf2-4f94-96bf-0d13e59d3b43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:19.391015 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af2699-4bf2-4f94-96bf-0d13e59d3b43 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:19.391254 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af2699-4bf2-4f94-96bf-0d13e59d3b43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:19.392242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af2699-4bf2-4f94-96bf-0d13e59d3b43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:19.402727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af2699-4bf2-4f94-96bf-0d13e59d3b43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:19.404346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af2699-4bf2-4f94-96bf-0d13e59d3b43 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:19.429014 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1253/2506] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:21.345387 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d33d5-7c21-4342-aeb3-169febcc713d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:21.347655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0c2d33d5-7c21-4342-aeb3-169febcc713d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:21.414216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:21.436800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d33d5-7c21-4342-aeb3-169febcc713d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:21.461904 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4809b3c-7d64-4457-9f2a-4db8095a15ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:21.463295 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4809b3c-7d64-4457-9f2a-4db8095a15ac service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:21.463588 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4809b3c-7d64-4457-9f2a-4db8095a15ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:21.463884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4809b3c-7d64-4457-9f2a-4db8095a15ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:21.472737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a4809b3c-7d64-4457-9f2a-4db8095a15ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:21.600418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4809b3c-7d64-4457-9f2a-4db8095a15ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:21.603388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4809b3c-7d64-4457-9f2a-4db8095a15ac service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:21.619240 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1254/2507] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:14:23.338328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af2699-4bf2-4f94-96bf-0d13e59d3b43 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:23.357687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af2699-4bf2-4f94-96bf-0d13e59d3b43 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:23.368275 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eaf8e6-928f-4494-b366-fba1a70cd2b1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:23.368745 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eaf8e6-928f-4494-b366-fba1a70cd2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:23.369564 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eaf8e6-928f-4494-b366-fba1a70cd2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:23.375365 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140e758-5e8c-4cd0-8619-13a9d26060e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:23.377199 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140e758-5e8c-4cd0-8619-13a9d26060e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:23.377500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140e758-5e8c-4cd0-8619-13a9d26060e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:23.377780 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140e758-5e8c-4cd0-8619-13a9d26060e2 admin admin] PATH_INFO: `/v3/users/315da98b2e7e45e3b46febc71bc754d6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:23.380732 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140e758-5e8c-4cd0-8619-13a9d26060e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=315da98b2e7e45e3b46febc71bc754d6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:23.384010 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140e758-5e8c-4cd0-8619-13a9d26060e2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:23.425871 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-86eaf8e6-928f-4494-b366-fba1a70cd2b1 None None] MFA Rules not processed for user `c6f69c6cfffb49d7ae3181cfa6216d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:23.432619 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-86eaf8e6-928f-4494-b366-fba1a70cd2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:23.490846 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6140e758-5e8c-4cd0-8619-13a9d26060e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '315da98b2e7e45e3b46febc71bc754d6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:23.500260 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6140e758-5e8c-4cd0-8619-13a9d26060e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '315da98b2e7e45e3b46febc71bc754d6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:23.518033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6140e758-5e8c-4cd0-8619-13a9d26060e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '315da98b2e7e45e3b46febc71bc754d6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:23.518711 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6140e758-5e8c-4cd0-8619-13a9d26060e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '315da98b2e7e45e3b46febc71bc754d6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:23.519428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6140e758-5e8c-4cd0-8619-13a9d26060e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '315da98b2e7e45e3b46febc71bc754d6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:23.527262 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1255/2508] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:23.535193 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1254/2509] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:23 2022] DELETE /identity/v3/users/315da98b2e7e45e3b46febc71bc754d6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:23.536469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eaf8e6-928f-4494-b366-fba1a70cd2b1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:23.537880 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-86eaf8e6-928f-4494-b366-fba1a70cd2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:23.539631 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d88c4-973e-422c-a4cd-4a38c14964c3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:23.540212 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d88c4-973e-422c-a4cd-4a38c14964c3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:23.540714 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d88c4-973e-422c-a4cd-4a38c14964c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:23.566707 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-af2d88c4-973e-422c-a4cd-4a38c14964c3 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:23.570109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-af2d88c4-973e-422c-a4cd-4a38c14964c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:23.666522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eaf8e6-928f-4494-b366-fba1a70cd2b1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:23.695839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1255/2510] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:23.696256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:23.702029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d88c4-973e-422c-a4cd-4a38c14964c3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:23.704296 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-af2d88c4-973e-422c-a4cd-4a38c14964c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:23.743637 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:23.811366 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c1a62-3631-4628-b7c3-d46874418739 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ffa6d38c01f4820a705c06991654bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:23.812072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c1a62-3631-4628-b7c3-d46874418739 service glance] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:23.812361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c1a62-3631-4628-b7c3-d46874418739 service glance] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:23.812781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c1a62-3631-4628-b7c3-d46874418739 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:23.820792 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-940c1a62-3631-4628-b7c3-d46874418739 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:23.861128 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d88c4-973e-422c-a4cd-4a38c14964c3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:23.880675 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b63e39-56fd-4ad3-b556-beded0a1b7ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:23.882042 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b63e39-56fd-4ad3-b556-beded0a1b7ea service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:23.886124 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b63e39-56fd-4ad3-b556-beded0a1b7ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:23.889641 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b63e39-56fd-4ad3-b556-beded0a1b7ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:23.912642 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b63e39-56fd-4ad3-b556-beded0a1b7ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:23.917434 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b63e39-56fd-4ad3-b556-beded0a1b7ea service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:23.937438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c1a62-3631-4628-b7c3-d46874418739 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:23.939656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c1a62-3631-4628-b7c3-d46874418739 service glance] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:23.957456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1256/2511] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:23.964984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1256/2512] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:24.108831 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92e282-2083-4b0c-a199-3b872c14c88b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:24.108831 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92e282-2083-4b0c-a199-3b872c14c88b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:24.109275 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92e282-2083-4b0c-a199-3b872c14c88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:24.138944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ad92e282-2083-4b0c-a199-3b872c14c88b None None] MFA Rules not processed for user `a63dd78421064bbe838b1ed0261c13bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:24.142771 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ad92e282-2083-4b0c-a199-3b872c14c88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:24.273305 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1257/2513] 10.222.0.41 () {58 vars in 1009 bytes} [Mon May 30 12:14:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:24.301400 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c1a62-3631-4628-b7c3-d46874418739 service glance] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:24.302869 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-940c1a62-3631-4628-b7c3-d46874418739 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:24.447854 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c1a62-3631-4628-b7c3-d46874418739 service glance] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:24.464256 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507240a-36bf-4b92-9c4d-85cac3406b82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e5f980cdb74227bb31c7e7e5eab74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:24.465212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507240a-36bf-4b92-9c4d-85cac3406b82 service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:24.465756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507240a-36bf-4b92-9c4d-85cac3406b82 service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:24.466206 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507240a-36bf-4b92-9c4d-85cac3406b82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:24.489053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507240a-36bf-4b92-9c4d-85cac3406b82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:24.490696 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507240a-36bf-4b92-9c4d-85cac3406b82 service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:24.514285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1257/2514] 10.222.0.41 () {60 vars in 1384 bytes} [Mon May 30 12:14:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:14:24.652410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92e282-2083-4b0c-a199-3b872c14c88b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:24.655781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ad92e282-2083-4b0c-a199-3b872c14c88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:24.677218 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92e282-2083-4b0c-a199-3b872c14c88b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:24.683685 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e889dd-af78-4d1f-9cb3-3f760a711efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:24.685220 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e889dd-af78-4d1f-9cb3-3f760a711efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:24.685813 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e889dd-af78-4d1f-9cb3-3f760a711efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:24.686500 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e889dd-af78-4d1f-9cb3-3f760a711efd admin admin] PATH_INFO: `/v3/projects/ec81f9cac7314bbaa600271f94163d73` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:24.688638 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e889dd-af78-4d1f-9cb3-3f760a711efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec81f9cac7314bbaa600271f94163d73)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:24.691581 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e889dd-af78-4d1f-9cb3-3f760a711efd admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:24.803914 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a9e889dd-af78-4d1f-9cb3-3f760a711efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec81f9cac7314bbaa600271f94163d73', 'request_id': 'req-a9e889dd-af78-4d1f-9cb3-3f760a711efd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:24.824055 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a9e889dd-af78-4d1f-9cb3-3f760a711efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec81f9cac7314bbaa600271f94163d73', 'request_id': 'req-a9e889dd-af78-4d1f-9cb3-3f760a711efd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:24.842028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a9e889dd-af78-4d1f-9cb3-3f760a711efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec81f9cac7314bbaa600271f94163d73', 'request_id': 'req-a9e889dd-af78-4d1f-9cb3-3f760a711efd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:24.873837 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a9e889dd-af78-4d1f-9cb3-3f760a711efd admin admin] The token cache is being invalidate because project ec81f9cac7314bbaa600271f94163d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:24.874536 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a9e889dd-af78-4d1f-9cb3-3f760a711efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:24.875454 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a9e889dd-af78-4d1f-9cb3-3f760a711efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:24.884469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efe563-c359-4a75-88f2-88059310099c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:24.885110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efe563-c359-4a75-88f2-88059310099c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:24.885539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efe563-c359-4a75-88f2-88059310099c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:24.887049 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1258/2515] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:24 2022] DELETE /identity/v3/projects/ec81f9cac7314bbaa600271f94163d73 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:24.912784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a1efe563-c359-4a75-88f2-88059310099c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:24.914460 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a1efe563-c359-4a75-88f2-88059310099c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:24.990735 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:25.010588 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1258/2516] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:25.019429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34570c5-ab24-42d9-a4ee-b8da2317700c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:25.019727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34570c5-ab24-42d9-a4ee-b8da2317700c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:25.020049 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34570c5-ab24-42d9-a4ee-b8da2317700c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:25.043022 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c34570c5-ab24-42d9-a4ee-b8da2317700c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:25.044610 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c34570c5-ab24-42d9-a4ee-b8da2317700c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:25.055083 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1259/2517] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:25.060322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efe563-c359-4a75-88f2-88059310099c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:25.085516 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efe563-c359-4a75-88f2-88059310099c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:25.092322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f672ec-2067-4459-816b-99517e5908ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:25.093432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f672ec-2067-4459-816b-99517e5908ed admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:25.093880 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f672ec-2067-4459-816b-99517e5908ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:25.094314 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f672ec-2067-4459-816b-99517e5908ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:25.095949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f672ec-2067-4459-816b-99517e5908ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:14:25.096454 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f672ec-2067-4459-816b-99517e5908ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:25.098245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f672ec-2067-4459-816b-99517e5908ed admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:25.117769 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1259/2518] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:14:25.119454 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34570c5-ab24-42d9-a4ee-b8da2317700c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:25.132023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34570c5-ab24-42d9-a4ee-b8da2317700c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:25.137253 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b83cb6-f42c-4f86-8a55-35e9a1e0d18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:25.138053 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b83cb6-f42c-4f86-8a55-35e9a1e0d18d admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:25.138486 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b83cb6-f42c-4f86-8a55-35e9a1e0d18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:25.138904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b83cb6-f42c-4f86-8a55-35e9a1e0d18d admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:25.139705 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b83cb6-f42c-4f86-8a55-35e9a1e0d18d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:25.148238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b83cb6-f42c-4f86-8a55-35e9a1e0d18d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:25.222609 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1260/2519] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:25 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:25.226470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f672ec-2067-4459-816b-99517e5908ed admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:25.241207 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f672ec-2067-4459-816b-99517e5908ed admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:25.410818 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74fc02-262b-4b49-8bb4-b447d28e2d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:25.411920 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74fc02-262b-4b49-8bb4-b447d28e2d30 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:25.412393 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74fc02-262b-4b49-8bb4-b447d28e2d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:25.412851 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74fc02-262b-4b49-8bb4-b447d28e2d30 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:25.413748 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74fc02-262b-4b49-8bb4-b447d28e2d30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:25.416303 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74fc02-262b-4b49-8bb4-b447d28e2d30 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:25.453835 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1260/2520] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:25 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:25.458878 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b83cb6-f42c-4f86-8a55-35e9a1e0d18d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:25.481812 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b83cb6-f42c-4f86-8a55-35e9a1e0d18d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:25.489734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484b73e-d0d9-4c7b-bb72-ee9e2d187ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:25.491219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484b73e-d0d9-4c7b-bb72-ee9e2d187ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:25.491925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484b73e-d0d9-4c7b-bb72-ee9e2d187ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:25.492593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484b73e-d0d9-4c7b-bb72-ee9e2d187ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:25.494946 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484b73e-d0d9-4c7b-bb72-ee9e2d187ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:25.497149 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484b73e-d0d9-4c7b-bb72-ee9e2d187ac4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:25.524042 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1261/2521] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:25.525040 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74fc02-262b-4b49-8bb4-b447d28e2d30 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:25.537189 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74fc02-262b-4b49-8bb4-b447d28e2d30 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:25.553075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94460b12-27cc-475f-a5b0-65bd8c320439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:25.553766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94460b12-27cc-475f-a5b0-65bd8c320439 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:25.554056 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94460b12-27cc-475f-a5b0-65bd8c320439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:25.554341 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94460b12-27cc-475f-a5b0-65bd8c320439 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:25.555088 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94460b12-27cc-475f-a5b0-65bd8c320439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:25.556743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94460b12-27cc-475f-a5b0-65bd8c320439 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:25.577954 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1261/2522] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:25.582776 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484b73e-d0d9-4c7b-bb72-ee9e2d187ac4 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:25.598828 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484b73e-d0d9-4c7b-bb72-ee9e2d187ac4 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:25.604916 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687693a-d555-4f0c-90b8-91da3abcd446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:25.606904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687693a-d555-4f0c-90b8-91da3abcd446 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:25.607301 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687693a-d555-4f0c-90b8-91da3abcd446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:25.607654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687693a-d555-4f0c-90b8-91da3abcd446 admin admin] PATH_INFO: `/v3/projects/8f385ffe68b34bc4a89643d0841d9330/users/48d3696971854a11bf530f0c57c72b9f/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:25.631112 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:25.636870 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687693a-d555-4f0c-90b8-91da3abcd446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f385ffe68b34bc4a89643d0841d9330, user_id=48d3696971854a11bf530f0c57c72b9f, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:25.640174 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687693a-d555-4f0c-90b8-91da3abcd446 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:25.672432 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1262/2523] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:25 2022] PUT /identity/v3/projects/8f385ffe68b34bc4a89643d0841d9330/users/48d3696971854a11bf530f0c57c72b9f/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:25.757509 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61325800-a536-4e8c-a417-2bab85c8ebe7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:25.758055 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61325800-a536-4e8c-a417-2bab85c8ebe7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:25.758576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61325800-a536-4e8c-a417-2bab85c8ebe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:25.829324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-61325800-a536-4e8c-a417-2bab85c8ebe7 None None] MFA Rules not processed for user `48d3696971854a11bf530f0c57c72b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:25.833382 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-61325800-a536-4e8c-a417-2bab85c8ebe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:26.028286 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1262/2524] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:26.033615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687693a-d555-4f0c-90b8-91da3abcd446 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:26.221699 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687693a-d555-4f0c-90b8-91da3abcd446 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:26.232597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda698ac-d345-4359-b272-195679691af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:26.233290 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda698ac-d345-4359-b272-195679691af4 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:26.234711 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda698ac-d345-4359-b272-195679691af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:26.234996 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda698ac-d345-4359-b272-195679691af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:26.235775 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda698ac-d345-4359-b272-195679691af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:26.245096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda698ac-d345-4359-b272-195679691af4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:26.365989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1263/2525] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:26 2022] POST /identity/v3/projects => generated 383 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:26.367278 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61325800-a536-4e8c-a417-2bab85c8ebe7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:26.414311 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61325800-a536-4e8c-a417-2bab85c8ebe7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:26.590144 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:26.607996 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be42530-7b2e-4c4c-8b64-a9a6015894ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:26.608881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be42530-7b2e-4c4c-8b64-a9a6015894ec admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:26.609309 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be42530-7b2e-4c4c-8b64-a9a6015894ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:26.609679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be42530-7b2e-4c4c-8b64-a9a6015894ec admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:26.611095 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be42530-7b2e-4c4c-8b64-a9a6015894ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:26.615146 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be42530-7b2e-4c4c-8b64-a9a6015894ec admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:26.681334 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1263/2526] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:26 2022] POST /identity/v3/users => generated 292 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:26.685299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda698ac-d345-4359-b272-195679691af4 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:26.704496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda698ac-d345-4359-b272-195679691af4 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:26.731127 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9640b06-f664-40c7-8744-502338326186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:26.731879 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9640b06-f664-40c7-8744-502338326186 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:26.732182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9640b06-f664-40c7-8744-502338326186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:26.732456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9640b06-f664-40c7-8744-502338326186 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:26.733220 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9640b06-f664-40c7-8744-502338326186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:26.734878 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9640b06-f664-40c7-8744-502338326186 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:26.799554 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1264/2527] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:14:26.803882 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be42530-7b2e-4c4c-8b64-a9a6015894ec admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:26.826160 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be42530-7b2e-4c4c-8b64-a9a6015894ec admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:26.864651 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56afe0-8283-4bb9-bd95-1bbf4fc7b2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:26.865349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56afe0-8283-4bb9-bd95-1bbf4fc7b2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:26.865638 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56afe0-8283-4bb9-bd95-1bbf4fc7b2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:26.865912 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56afe0-8283-4bb9-bd95-1bbf4fc7b2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:26.866658 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56afe0-8283-4bb9-bd95-1bbf4fc7b2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:26.868323 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56afe0-8283-4bb9-bd95-1bbf4fc7b2d9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:26.890370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1264/2528] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:26.892194 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9640b06-f664-40c7-8744-502338326186 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:26.905326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9640b06-f664-40c7-8744-502338326186 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:26.914662 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baa4ff-20f5-42cf-bd4d-3b18103cd2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:26.915683 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa4ff-20f5-42cf-bd4d-3b18103cd2a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:26.916063 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa4ff-20f5-42cf-bd4d-3b18103cd2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:26.916418 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa4ff-20f5-42cf-bd4d-3b18103cd2a7 admin admin] PATH_INFO: `/v3/projects/e5d2491f95cb454b9e9d86bf3dd7622f/users/a8fde143c1d649d18f2bac0abb87cd4f/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:26.940816 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baa4ff-20f5-42cf-bd4d-3b18103cd2a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d2491f95cb454b9e9d86bf3dd7622f, user_id=a8fde143c1d649d18f2bac0abb87cd4f, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:26.945215 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baa4ff-20f5-42cf-bd4d-3b18103cd2a7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:26.969328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1265/2529] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:26 2022] PUT /identity/v3/projects/e5d2491f95cb454b9e9d86bf3dd7622f/users/a8fde143c1d649d18f2bac0abb87cd4f/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:26.980863 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e3570-b99c-4598-b022-6be2ca268f5d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:26.981159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e3570-b99c-4598-b022-6be2ca268f5d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:26.981444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e3570-b99c-4598-b022-6be2ca268f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:27.038116 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-aa3e3570-b99c-4598-b022-6be2ca268f5d None None] MFA Rules not processed for user `a8fde143c1d649d18f2bac0abb87cd4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:27.041565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-aa3e3570-b99c-4598-b022-6be2ca268f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:27.120325 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baa4ff-20f5-42cf-bd4d-3b18103cd2a7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:27.122943 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c4baa4ff-20f5-42cf-bd4d-3b18103cd2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:27.162802 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1265/2530] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:27.166704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e3570-b99c-4598-b022-6be2ca268f5d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:27.241193 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baa4ff-20f5-42cf-bd4d-3b18103cd2a7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:27.247719 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abc36c-3ec4-46ce-bd86-ad9e795dce30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b43eb1a0ac4db5adee3512453459aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:27.248411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abc36c-3ec4-46ce-bd86-ad9e795dce30 service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:27.248752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abc36c-3ec4-46ce-bd86-ad9e795dce30 service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:27.248956 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abc36c-3ec4-46ce-bd86-ad9e795dce30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:27.251744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-19abc36c-3ec4-46ce-bd86-ad9e795dce30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:27.256007 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e3570-b99c-4598-b022-6be2ca268f5d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:27.260750 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a476b-33b5-48b2-a209-2642e69da49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:27.261424 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a476b-33b5-48b2-a209-2642e69da49f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:27.261713 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a476b-33b5-48b2-a209-2642e69da49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:27.262012 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a476b-33b5-48b2-a209-2642e69da49f admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:27.262713 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a476b-33b5-48b2-a209-2642e69da49f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:27.264680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a476b-33b5-48b2-a209-2642e69da49f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:27.265740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abc36c-3ec4-46ce-bd86-ad9e795dce30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:27.268319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abc36c-3ec4-46ce-bd86-ad9e795dce30 service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:27.284985 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1266/2531] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:14:27.286154 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abc36c-3ec4-46ce-bd86-ad9e795dce30 service placement] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:27.288949 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-19abc36c-3ec4-46ce-bd86-ad9e795dce30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:27.300852 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1266/2532] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:27 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:27.301854 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a476b-33b5-48b2-a209-2642e69da49f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:27.321468 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abc36c-3ec4-46ce-bd86-ad9e795dce30 service placement] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:27.366654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:27.372654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:27.393792 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a476b-33b5-48b2-a209-2642e69da49f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:27.399063 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e854b76-2296-4334-a6dc-07720fb4943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:27.399742 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e854b76-2296-4334-a6dc-07720fb4943b admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:27.400172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e854b76-2296-4334-a6dc-07720fb4943b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:27.400459 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e854b76-2296-4334-a6dc-07720fb4943b admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:27.401271 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e854b76-2296-4334-a6dc-07720fb4943b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:27.403327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e854b76-2296-4334-a6dc-07720fb4943b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:27.407803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cbe0c-5749-49d6-8261-72d964016931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:27.409050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cbe0c-5749-49d6-8261-72d964016931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:27.409050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cbe0c-5749-49d6-8261-72d964016931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:27.409237 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cbe0c-5749-49d6-8261-72d964016931 admin admin] PATH_INFO: `/v3/users/5ee1e385f10e4ed4849ef2febc22e497` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:27.410580 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cbe0c-5749-49d6-8261-72d964016931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee1e385f10e4ed4849ef2febc22e497)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:27.412541 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cbe0c-5749-49d6-8261-72d964016931 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:27.437502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1267/2533] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:27 2022] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:27.439807 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e854b76-2296-4334-a6dc-07720fb4943b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:27.450197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e854b76-2296-4334-a6dc-07720fb4943b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:27.458758 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25164e68-f7c1-4602-adc5-bda9b755070b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:27.459579 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25164e68-f7c1-4602-adc5-bda9b755070b admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:27.459929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25164e68-f7c1-4602-adc5-bda9b755070b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:27.460252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25164e68-f7c1-4602-adc5-bda9b755070b admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:27.461105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25164e68-f7c1-4602-adc5-bda9b755070b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:27.462817 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25164e68-f7c1-4602-adc5-bda9b755070b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:27.475895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1268/2534] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:14:27.479656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25164e68-f7c1-4602-adc5-bda9b755070b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:27.481701 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-493cbe0c-5749-49d6-8261-72d964016931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee1e385f10e4ed4849ef2febc22e497'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:27.493124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25164e68-f7c1-4602-adc5-bda9b755070b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:27.493689 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-493cbe0c-5749-49d6-8261-72d964016931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee1e385f10e4ed4849ef2febc22e497'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:27.498771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738c849-abab-48f0-8eca-7ef7e6b08852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:27.499756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738c849-abab-48f0-8eca-7ef7e6b08852 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:27.500171 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738c849-abab-48f0-8eca-7ef7e6b08852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:27.500520 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738c849-abab-48f0-8eca-7ef7e6b08852 admin admin] PATH_INFO: `/v3/projects/b130c9a5451741179a9953e2bd97873d/users/d5558a2741b64d6facd02f007313eed8/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:27.513829 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-493cbe0c-5749-49d6-8261-72d964016931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee1e385f10e4ed4849ef2febc22e497'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:27.515092 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-493cbe0c-5749-49d6-8261-72d964016931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee1e385f10e4ed4849ef2febc22e497'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:27.516387 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-493cbe0c-5749-49d6-8261-72d964016931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee1e385f10e4ed4849ef2febc22e497'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:27.519081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738c849-abab-48f0-8eca-7ef7e6b08852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b130c9a5451741179a9953e2bd97873d, user_id=d5558a2741b64d6facd02f007313eed8, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:27.521925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738c849-abab-48f0-8eca-7ef7e6b08852 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:27.537117 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1267/2535] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:27 2022] DELETE /identity/v3/users/5ee1e385f10e4ed4849ef2febc22e497 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:27.539366 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1269/2536] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:27 2022] PUT /identity/v3/projects/b130c9a5451741179a9953e2bd97873d/users/d5558a2741b64d6facd02f007313eed8/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:14:27.543005 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cbe0c-5749-49d6-8261-72d964016931 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:27.545120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-493cbe0c-5749-49d6-8261-72d964016931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:27.653083 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cbe0c-5749-49d6-8261-72d964016931 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:27.664927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d6dea-7220-4dbb-b425-27304d2e4708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:27.665778 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d6dea-7220-4dbb-b425-27304d2e4708 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:27.666135 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d6dea-7220-4dbb-b425-27304d2e4708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:27.666482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d6dea-7220-4dbb-b425-27304d2e4708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:27.667356 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d6dea-7220-4dbb-b425-27304d2e4708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:27.671923 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d6dea-7220-4dbb-b425-27304d2e4708 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:27.690948 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738c849-abab-48f0-8eca-7ef7e6b08852 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:27.694139 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1268/2537] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:27.813575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738c849-abab-48f0-8eca-7ef7e6b08852 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:27.822469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c1bd0-daac-4b9a-8780-60f90b90a9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:27.823997 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c1bd0-daac-4b9a-8780-60f90b90a9c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:27.824357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c1bd0-daac-4b9a-8780-60f90b90a9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:27.824536 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c1bd0-daac-4b9a-8780-60f90b90a9c6 admin admin] PATH_INFO: `/v3/projects/b130c9a5451741179a9953e2bd97873d/users/d5558a2741b64d6facd02f007313eed8/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:27.828463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c1bd0-daac-4b9a-8780-60f90b90a9c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b130c9a5451741179a9953e2bd97873d, user_id=d5558a2741b64d6facd02f007313eed8, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:27.831195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c1bd0-daac-4b9a-8780-60f90b90a9c6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:27.854003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1270/2538] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:27 2022] PUT /identity/v3/projects/b130c9a5451741179a9953e2bd97873d/users/d5558a2741b64d6facd02f007313eed8/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:14:27.859553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c06c60-112b-4eb0-bef3-19f6c1523803 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:27.862022 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c06c60-112b-4eb0-bef3-19f6c1523803 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:27.862022 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c06c60-112b-4eb0-bef3-19f6c1523803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:27.882053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c1bd0-daac-4b9a-8780-60f90b90a9c6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:27.883856 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-859c1bd0-daac-4b9a-8780-60f90b90a9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:27.947535 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-24c06c60-112b-4eb0-bef3-19f6c1523803 None None] MFA Rules not processed for user `d5558a2741b64d6facd02f007313eed8`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:27.948983 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-24c06c60-112b-4eb0-bef3-19f6c1523803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:28.005154 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c1bd0-daac-4b9a-8780-60f90b90a9c6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:28.010521 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227aabea-06f4-42ef-9788-54ae2a6e26f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:28.013146 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227aabea-06f4-42ef-9788-54ae2a6e26f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:28.013434 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227aabea-06f4-42ef-9788-54ae2a6e26f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:28.013716 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227aabea-06f4-42ef-9788-54ae2a6e26f3 admin admin] PATH_INFO: `/v3/projects/63d6c4272b654ba18d854527b14b1a88` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:28.015247 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227aabea-06f4-42ef-9788-54ae2a6e26f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63d6c4272b654ba18d854527b14b1a88)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:28.019101 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227aabea-06f4-42ef-9788-54ae2a6e26f3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:28.059466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:28.102107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:28.118602 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-227aabea-06f4-42ef-9788-54ae2a6e26f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63d6c4272b654ba18d854527b14b1a88', 'request_id': 'req-227aabea-06f4-42ef-9788-54ae2a6e26f3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:28.128700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-227aabea-06f4-42ef-9788-54ae2a6e26f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63d6c4272b654ba18d854527b14b1a88', 'request_id': 'req-227aabea-06f4-42ef-9788-54ae2a6e26f3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:28.150213 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1269/2539] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:28.163976 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c06c60-112b-4eb0-bef3-19f6c1523803 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:28.164855 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-227aabea-06f4-42ef-9788-54ae2a6e26f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63d6c4272b654ba18d854527b14b1a88', 'request_id': 'req-227aabea-06f4-42ef-9788-54ae2a6e26f3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:28.165603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-24c06c60-112b-4eb0-bef3-19f6c1523803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:28.183550 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-227aabea-06f4-42ef-9788-54ae2a6e26f3 admin admin] The token cache is being invalidate because project 63d6c4272b654ba18d854527b14b1a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:28.183986 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-227aabea-06f4-42ef-9788-54ae2a6e26f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:28.185184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-227aabea-06f4-42ef-9788-54ae2a6e26f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:28.191285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1271/2540] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:27 2022] DELETE /identity/v3/projects/63d6c4272b654ba18d854527b14b1a88 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:14:28.206061 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4133ddb-220a-4f8f-a5cc-a2bf747bc149 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:28.206568 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4133ddb-220a-4f8f-a5cc-a2bf747bc149 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:28.207029 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4133ddb-220a-4f8f-a5cc-a2bf747bc149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:28.230789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b4133ddb-220a-4f8f-a5cc-a2bf747bc149 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:28.232675 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b4133ddb-220a-4f8f-a5cc-a2bf747bc149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:28.270980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c06c60-112b-4eb0-bef3-19f6c1523803 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:28.318534 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1272/2541] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:28.339749 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b76b2-39a6-4a41-b576-18e31ccaf522 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:28.340346 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b76b2-39a6-4a41-b576-18e31ccaf522 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:28.342216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b76b2-39a6-4a41-b576-18e31ccaf522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:28.359782 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47336060-91d6-464f-abdb-ce4ec1d08d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:28.361165 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47336060-91d6-464f-abdb-ce4ec1d08d2d service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:28.364737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47336060-91d6-464f-abdb-ce4ec1d08d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:28.365104 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47336060-91d6-464f-abdb-ce4ec1d08d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:28.368591 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-47336060-91d6-464f-abdb-ce4ec1d08d2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:28.373050 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f75b76b2-39a6-4a41-b576-18e31ccaf522 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:28.374490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f75b76b2-39a6-4a41-b576-18e31ccaf522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:28.383931 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1273/2542] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:28.388563 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b76b2-39a6-4a41-b576-18e31ccaf522 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:28.403995 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b76b2-39a6-4a41-b576-18e31ccaf522 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:28.410157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c5ac3-ca25-4a11-bc2d-0932a42b4604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:28.410845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c5ac3-ca25-4a11-bc2d-0932a42b4604 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:28.411126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c5ac3-ca25-4a11-bc2d-0932a42b4604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:28.411936 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c5ac3-ca25-4a11-bc2d-0932a42b4604 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:28.412189 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c5ac3-ca25-4a11-bc2d-0932a42b4604 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:14:28.412502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c5ac3-ca25-4a11-bc2d-0932a42b4604 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:28.415222 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c5ac3-ca25-4a11-bc2d-0932a42b4604 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:28.430273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1274/2543] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:14:28.436162 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c5ac3-ca25-4a11-bc2d-0932a42b4604 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:28.465254 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c5ac3-ca25-4a11-bc2d-0932a42b4604 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:28.495870 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b4e4b-3053-48e2-948d-ce342c642037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:28.496818 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b4e4b-3053-48e2-948d-ce342c642037 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:28.497107 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b4e4b-3053-48e2-948d-ce342c642037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:28.497503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b4e4b-3053-48e2-948d-ce342c642037 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:28.498312 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b4e4b-3053-48e2-948d-ce342c642037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:28.500634 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b4e4b-3053-48e2-948d-ce342c642037 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:28.503480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47336060-91d6-464f-abdb-ce4ec1d08d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:28.505296 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47336060-91d6-464f-abdb-ce4ec1d08d2d service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:28.525062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1270/2544] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:28.553443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1275/2545] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:28 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:28.557720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47336060-91d6-464f-abdb-ce4ec1d08d2d service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:28.573957 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47336060-91d6-464f-abdb-ce4ec1d08d2d service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:28.678529 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:28.729472 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ceb15-7d00-48c5-a7e3-1b01e5c85c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:28.730289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ceb15-7d00-48c5-a7e3-1b01e5c85c4b admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:28.730674 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ceb15-7d00-48c5-a7e3-1b01e5c85c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:28.730967 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ceb15-7d00-48c5-a7e3-1b01e5c85c4b admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:28.731804 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ceb15-7d00-48c5-a7e3-1b01e5c85c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:28.737840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ceb15-7d00-48c5-a7e3-1b01e5c85c4b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:28.792272 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1271/2546] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:28 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:28.797232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b4e4b-3053-48e2-948d-ce342c642037 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:28.817363 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b4e4b-3053-48e2-948d-ce342c642037 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:28.827356 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc385b03-7398-48ef-b3fd-15ed8df2a11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:28.828356 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc385b03-7398-48ef-b3fd-15ed8df2a11a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:28.830397 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc385b03-7398-48ef-b3fd-15ed8df2a11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:28.830850 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc385b03-7398-48ef-b3fd-15ed8df2a11a admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:28.831745 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc385b03-7398-48ef-b3fd-15ed8df2a11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:28.833631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc385b03-7398-48ef-b3fd-15ed8df2a11a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:28.846223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1276/2547] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:28.850717 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ceb15-7d00-48c5-a7e3-1b01e5c85c4b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:28.863469 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ceb15-7d00-48c5-a7e3-1b01e5c85c4b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:28.868945 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a3d65-18ed-49da-a0eb-e8d9006bad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:28.869933 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a3d65-18ed-49da-a0eb-e8d9006bad6b admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:28.870398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a3d65-18ed-49da-a0eb-e8d9006bad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:28.870969 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a3d65-18ed-49da-a0eb-e8d9006bad6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:28.872041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a3d65-18ed-49da-a0eb-e8d9006bad6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:28.873958 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a3d65-18ed-49da-a0eb-e8d9006bad6b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:28.893570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1272/2548] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:28.898357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc385b03-7398-48ef-b3fd-15ed8df2a11a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:28.911849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc385b03-7398-48ef-b3fd-15ed8df2a11a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:28.929971 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650bee2-1674-48d8-b0b2-f1bbbaba1968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:28.930881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650bee2-1674-48d8-b0b2-f1bbbaba1968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:28.931167 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650bee2-1674-48d8-b0b2-f1bbbaba1968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:28.932276 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650bee2-1674-48d8-b0b2-f1bbbaba1968 admin admin] PATH_INFO: `/v3/projects/c13d53c508704087b72fe29e7e4000de/users/bfcae08b804b4250ad00ccc88fba3812/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:28.997886 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650bee2-1674-48d8-b0b2-f1bbbaba1968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13d53c508704087b72fe29e7e4000de, user_id=bfcae08b804b4250ad00ccc88fba3812, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:29.000610 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650bee2-1674-48d8-b0b2-f1bbbaba1968 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:29.034242 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1277/2549] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:28 2022] PUT /identity/v3/projects/c13d53c508704087b72fe29e7e4000de/users/bfcae08b804b4250ad00ccc88fba3812/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:29.034999 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4e8b4-3aca-4176-bbf8-8c099f245690 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:29.035425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4e8b4-3aca-4176-bbf8-8c099f245690 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:29.035809 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4e8b4-3aca-4176-bbf8-8c099f245690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:29.098129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f4c4e8b4-3aca-4176-bbf8-8c099f245690 None None] MFA Rules not processed for user `bfcae08b804b4250ad00ccc88fba3812`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:29.099472 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f4c4e8b4-3aca-4176-bbf8-8c099f245690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:29.241482 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1273/2550] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:14:29.254897 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650bee2-1674-48d8-b0b2-f1bbbaba1968 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:29.257366 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e650bee2-1674-48d8-b0b2-f1bbbaba1968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:29.389108 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:29.444201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650bee2-1674-48d8-b0b2-f1bbbaba1968 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:29.466800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a46177-6255-40e9-bb46-0e4c3a1698e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:29.467495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a46177-6255-40e9-bb46-0e4c3a1698e9 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:29.467787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a46177-6255-40e9-bb46-0e4c3a1698e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:29.468099 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a46177-6255-40e9-bb46-0e4c3a1698e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:29.485745 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a46177-6255-40e9-bb46-0e4c3a1698e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:29.497356 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a46177-6255-40e9-bb46-0e4c3a1698e9 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:29.536800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1278/2551] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:30.763751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4e8b4-3aca-4176-bbf8-8c099f245690 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:30.765808 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f4c4e8b4-3aca-4176-bbf8-8c099f245690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:30.919396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4e8b4-3aca-4176-bbf8-8c099f245690 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:30.924011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5422e05-5c4c-4b41-928b-923d9416b626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:30.924598 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5422e05-5c4c-4b41-928b-923d9416b626 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:30.924884 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5422e05-5c4c-4b41-928b-923d9416b626 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:30.925166 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5422e05-5c4c-4b41-928b-923d9416b626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:30.935791 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c5422e05-5c4c-4b41-928b-923d9416b626 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:31.049784 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5422e05-5c4c-4b41-928b-923d9416b626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:31.055110 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5422e05-5c4c-4b41-928b-923d9416b626 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:31.087141 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1274/2552] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:32.192073 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a46177-6255-40e9-bb46-0e4c3a1698e9 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:32.194412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-73a46177-6255-40e9-bb46-0e4c3a1698e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:32.229971 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a46177-6255-40e9-bb46-0e4c3a1698e9 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:32.241705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a9487-21fc-4f47-ad7e-c7c6394f3e2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:32.242654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a9487-21fc-4f47-ad7e-c7c6394f3e2a service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:32.243094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a9487-21fc-4f47-ad7e-c7c6394f3e2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:32.243535 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a9487-21fc-4f47-ad7e-c7c6394f3e2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:32.256026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-fc2a9487-21fc-4f47-ad7e-c7c6394f3e2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:32.396366 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a9487-21fc-4f47-ad7e-c7c6394f3e2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:32.398186 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a9487-21fc-4f47-ad7e-c7c6394f3e2a service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:32.416502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1279/2553] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:33.105830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5422e05-5c4c-4b41-928b-923d9416b626 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:33.113047 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:33.255066 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5422e05-5c4c-4b41-928b-923d9416b626 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:33.260029 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61ce72-5856-4815-8d79-87c5a8174db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:33.260944 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61ce72-5856-4815-8d79-87c5a8174db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:33.261227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61ce72-5856-4815-8d79-87c5a8174db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:33.261536 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61ce72-5856-4815-8d79-87c5a8174db0 admin admin] PATH_INFO: `/v3/users/bfcae08b804b4250ad00ccc88fba3812` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:33.262787 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61ce72-5856-4815-8d79-87c5a8174db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfcae08b804b4250ad00ccc88fba3812)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:33.264857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61ce72-5856-4815-8d79-87c5a8174db0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:33.332912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6c61ce72-5856-4815-8d79-87c5a8174db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfcae08b804b4250ad00ccc88fba3812'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:33.350027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6c61ce72-5856-4815-8d79-87c5a8174db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfcae08b804b4250ad00ccc88fba3812'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:33.370605 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6c61ce72-5856-4815-8d79-87c5a8174db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfcae08b804b4250ad00ccc88fba3812'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:33.371533 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6c61ce72-5856-4815-8d79-87c5a8174db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfcae08b804b4250ad00ccc88fba3812'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:33.372279 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6c61ce72-5856-4815-8d79-87c5a8174db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfcae08b804b4250ad00ccc88fba3812'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:33.396639 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1275/2554] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:33 2022] DELETE /identity/v3/users/bfcae08b804b4250ad00ccc88fba3812 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:33.401245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a38e4-e5cc-4de8-8891-713997826319 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:33.402083 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a38e4-e5cc-4de8-8891-713997826319 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:33.402367 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a38e4-e5cc-4de8-8891-713997826319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:33.440053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-408a38e4-e5cc-4de8-8891-713997826319 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:33.441670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-408a38e4-e5cc-4de8-8891-713997826319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:33.545766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1280/2555] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:33.557150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61ce72-5856-4815-8d79-87c5a8174db0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:33.558920 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6c61ce72-5856-4815-8d79-87c5a8174db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:33.634910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61ce72-5856-4815-8d79-87c5a8174db0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:33.643617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1a4fd-1f4d-410a-9a97-974e0c1b9b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:33.643966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1a4fd-1f4d-410a-9a97-974e0c1b9b61 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:33.644255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1a4fd-1f4d-410a-9a97-974e0c1b9b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:33.644628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1a4fd-1f4d-410a-9a97-974e0c1b9b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:33.660434 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1a4fd-1f4d-410a-9a97-974e0c1b9b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:33.661968 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1a4fd-1f4d-410a-9a97-974e0c1b9b61 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:33.692178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1276/2556] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:34.128257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a38e4-e5cc-4de8-8891-713997826319 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:34.130069 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-408a38e4-e5cc-4de8-8891-713997826319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:34.145610 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a38e4-e5cc-4de8-8891-713997826319 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:34.165516 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61a338-42d9-4b33-ba7c-6020418c5c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:34.166660 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61a338-42d9-4b33-ba7c-6020418c5c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:34.166996 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61a338-42d9-4b33-ba7c-6020418c5c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:34.167424 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61a338-42d9-4b33-ba7c-6020418c5c5d admin admin] PATH_INFO: `/v3/projects/c13d53c508704087b72fe29e7e4000de` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:34.168716 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61a338-42d9-4b33-ba7c-6020418c5c5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13d53c508704087b72fe29e7e4000de)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:34.170799 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61a338-42d9-4b33-ba7c-6020418c5c5d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:34.230285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bc61a338-42d9-4b33-ba7c-6020418c5c5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13d53c508704087b72fe29e7e4000de', 'request_id': 'req-bc61a338-42d9-4b33-ba7c-6020418c5c5d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:34.241129 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bc61a338-42d9-4b33-ba7c-6020418c5c5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13d53c508704087b72fe29e7e4000de', 'request_id': 'req-bc61a338-42d9-4b33-ba7c-6020418c5c5d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:34.253973 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bc61a338-42d9-4b33-ba7c-6020418c5c5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13d53c508704087b72fe29e7e4000de', 'request_id': 'req-bc61a338-42d9-4b33-ba7c-6020418c5c5d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:34.259285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:34.273419 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bc61a338-42d9-4b33-ba7c-6020418c5c5d admin admin] The token cache is being invalidate because project c13d53c508704087b72fe29e7e4000de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:34.273842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bc61a338-42d9-4b33-ba7c-6020418c5c5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:34.274384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bc61a338-42d9-4b33-ba7c-6020418c5c5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:34.280214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1281/2557] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:34 2022] DELETE /identity/v3/projects/c13d53c508704087b72fe29e7e4000de => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:34.285247 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e923f84-da47-436f-9823-7958cb633329 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:34.286381 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e923f84-da47-436f-9823-7958cb633329 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:34.286962 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e923f84-da47-436f-9823-7958cb633329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:34.313674 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0e923f84-da47-436f-9823-7958cb633329 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:34.313674 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0e923f84-da47-436f-9823-7958cb633329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:34.338887 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:34.405875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1277/2558] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:34.414785 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fb58b-45a9-4a75-a6ec-79558d4fe561 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:34.415374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fb58b-45a9-4a75-a6ec-79558d4fe561 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:34.415472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fb58b-45a9-4a75-a6ec-79558d4fe561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:34.440986 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6f4fb58b-45a9-4a75-a6ec-79558d4fe561 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:34.442407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6f4fb58b-45a9-4a75-a6ec-79558d4fe561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:34.452180 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1282/2559] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:14:34.457206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e923f84-da47-436f-9823-7958cb633329 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:34.468566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e923f84-da47-436f-9823-7958cb633329 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:34.474519 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5435e-2550-4784-8045-1ac1b51d7abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:34.475212 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5435e-2550-4784-8045-1ac1b51d7abf admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:34.475682 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5435e-2550-4784-8045-1ac1b51d7abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:34.476448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5435e-2550-4784-8045-1ac1b51d7abf admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:34.477217 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5435e-2550-4784-8045-1ac1b51d7abf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:14:34.477752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5435e-2550-4784-8045-1ac1b51d7abf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:34.479782 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5435e-2550-4784-8045-1ac1b51d7abf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:34.500102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1278/2560] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:14:34.505198 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fb58b-45a9-4a75-a6ec-79558d4fe561 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:34.525866 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fb58b-45a9-4a75-a6ec-79558d4fe561 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:34.533126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75291402-991a-4423-b6df-6ce8c2e3e4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:34.534182 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75291402-991a-4423-b6df-6ce8c2e3e4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:34.534707 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75291402-991a-4423-b6df-6ce8c2e3e4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:34.535049 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75291402-991a-4423-b6df-6ce8c2e3e4d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:34.536153 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75291402-991a-4423-b6df-6ce8c2e3e4d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:34.538252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75291402-991a-4423-b6df-6ce8c2e3e4d2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:34.570145 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1283/2561] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:34 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:34.577824 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5435e-2550-4784-8045-1ac1b51d7abf admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:34.592417 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5435e-2550-4784-8045-1ac1b51d7abf admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:34.670844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fcf60-a415-468c-a12b-980aa7a305cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:34.671581 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fcf60-a415-468c-a12b-980aa7a305cc admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:34.671843 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fcf60-a415-468c-a12b-980aa7a305cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:34.672122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fcf60-a415-468c-a12b-980aa7a305cc admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:34.673415 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fcf60-a415-468c-a12b-980aa7a305cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:34.675495 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fcf60-a415-468c-a12b-980aa7a305cc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:34.700757 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1279/2562] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:34 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:14:34.702611 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75291402-991a-4423-b6df-6ce8c2e3e4d2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:34.716302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75291402-991a-4423-b6df-6ce8c2e3e4d2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:34.724054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e208f-20aa-456a-ad79-5b3f3d0a9476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:34.724358 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e208f-20aa-456a-ad79-5b3f3d0a9476 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:34.724652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e208f-20aa-456a-ad79-5b3f3d0a9476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:34.724954 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e208f-20aa-456a-ad79-5b3f3d0a9476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:34.725726 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e208f-20aa-456a-ad79-5b3f3d0a9476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:34.727709 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e208f-20aa-456a-ad79-5b3f3d0a9476 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:34.743067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1284/2563] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:14:34.744807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fcf60-a415-468c-a12b-980aa7a305cc admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:34.756114 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fcf60-a415-468c-a12b-980aa7a305cc admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:34.763269 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd139b9e-c076-4d4a-86b8-a418202dbc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:34.764446 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd139b9e-c076-4d4a-86b8-a418202dbc04 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:34.764742 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd139b9e-c076-4d4a-86b8-a418202dbc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:34.765020 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd139b9e-c076-4d4a-86b8-a418202dbc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:34.765769 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd139b9e-c076-4d4a-86b8-a418202dbc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:34.767451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd139b9e-c076-4d4a-86b8-a418202dbc04 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:34.783108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1280/2564] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:34.786856 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e208f-20aa-456a-ad79-5b3f3d0a9476 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:34.800571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e208f-20aa-456a-ad79-5b3f3d0a9476 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:34.805722 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7695a50-3a2d-4501-8fb4-99521750907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:34.806398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7695a50-3a2d-4501-8fb4-99521750907f admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:34.806672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7695a50-3a2d-4501-8fb4-99521750907f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:34.807027 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7695a50-3a2d-4501-8fb4-99521750907f admin admin] PATH_INFO: `/v3/projects/9dce504c42f349ab9e1e5407883f9572/users/28abe6472b0f42b78912fc7c2b41bcaf/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:34.826300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7695a50-3a2d-4501-8fb4-99521750907f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dce504c42f349ab9e1e5407883f9572, user_id=28abe6472b0f42b78912fc7c2b41bcaf, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:34.829864 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7695a50-3a2d-4501-8fb4-99521750907f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:34.855889 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1285/2565] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:34 2022] PUT /identity/v3/projects/9dce504c42f349ab9e1e5407883f9572/users/28abe6472b0f42b78912fc7c2b41bcaf/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:34.858471 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a86247-6e2f-4f23-a0bb-ea1d36227126 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:34.858946 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a86247-6e2f-4f23-a0bb-ea1d36227126 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:34.859329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a86247-6e2f-4f23-a0bb-ea1d36227126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:34.890404 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-35a86247-6e2f-4f23-a0bb-ea1d36227126 None None] MFA Rules not processed for user `28abe6472b0f42b78912fc7c2b41bcaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:34.892820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-35a86247-6e2f-4f23-a0bb-ea1d36227126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:34.968715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1281/2566] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:34.974726 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7695a50-3a2d-4501-8fb4-99521750907f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:35.044207 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7695a50-3a2d-4501-8fb4-99521750907f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:35.049645 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead4108-42f1-4ea4-9cfa-690e666c125f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:35.050303 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead4108-42f1-4ea4-9cfa-690e666c125f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:35.050587 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead4108-42f1-4ea4-9cfa-690e666c125f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:35.050862 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead4108-42f1-4ea4-9cfa-690e666c125f admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:35.051553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead4108-42f1-4ea4-9cfa-690e666c125f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:35.053494 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead4108-42f1-4ea4-9cfa-690e666c125f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:35.104288 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1286/2567] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:34 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:35.105877 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a86247-6e2f-4f23-a0bb-ea1d36227126 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:35.127638 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a86247-6e2f-4f23-a0bb-ea1d36227126 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:35.154986 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:35.212210 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70f79c-5cda-45cb-81bf-aa1b0353c165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:35.212947 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70f79c-5cda-45cb-81bf-aa1b0353c165 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:35.213242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70f79c-5cda-45cb-81bf-aa1b0353c165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:35.213523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70f79c-5cda-45cb-81bf-aa1b0353c165 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:35.215714 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70f79c-5cda-45cb-81bf-aa1b0353c165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:35.217374 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70f79c-5cda-45cb-81bf-aa1b0353c165 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:35.248026 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1282/2568] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:35 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:35.252121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead4108-42f1-4ea4-9cfa-690e666c125f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:35.270623 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead4108-42f1-4ea4-9cfa-690e666c125f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:35.278540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f0be5-7b4c-49b2-a216-80fb07cfeac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:35.279446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f0be5-7b4c-49b2-a216-80fb07cfeac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:35.282624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f0be5-7b4c-49b2-a216-80fb07cfeac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:35.283201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f0be5-7b4c-49b2-a216-80fb07cfeac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:35.284313 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f0be5-7b4c-49b2-a216-80fb07cfeac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:35.286546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f0be5-7b4c-49b2-a216-80fb07cfeac5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:35.301238 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1287/2569] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:35.305736 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70f79c-5cda-45cb-81bf-aa1b0353c165 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:35.318246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70f79c-5cda-45cb-81bf-aa1b0353c165 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:35.326727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb03ea-c99c-4b95-8973-815420921fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:35.327844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb03ea-c99c-4b95-8973-815420921fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:35.328216 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb03ea-c99c-4b95-8973-815420921fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:35.328517 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb03ea-c99c-4b95-8973-815420921fc3 admin admin] PATH_INFO: `/v3/projects/b594024075ef4328b9971e3075a157d6/users/4793f8c91eff4adc9dc54a5f477571b6/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:35.350319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb03ea-c99c-4b95-8973-815420921fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b594024075ef4328b9971e3075a157d6, user_id=4793f8c91eff4adc9dc54a5f477571b6, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:35.353928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb03ea-c99c-4b95-8973-815420921fc3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:35.377302 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1283/2570] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:35 2022] PUT /identity/v3/projects/b594024075ef4328b9971e3075a157d6/users/4793f8c91eff4adc9dc54a5f477571b6/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:35.381023 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f0be5-7b4c-49b2-a216-80fb07cfeac5 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:35.396519 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f0be5-7b4c-49b2-a216-80fb07cfeac5 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:35.504300 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5d872-7bea-4a28-9e79-8be3a1b4a8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:35.505183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5d872-7bea-4a28-9e79-8be3a1b4a8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:35.505503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5d872-7bea-4a28-9e79-8be3a1b4a8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:35.505876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5d872-7bea-4a28-9e79-8be3a1b4a8e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:35.506692 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5d872-7bea-4a28-9e79-8be3a1b4a8e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:35.508463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5d872-7bea-4a28-9e79-8be3a1b4a8e5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:35.522658 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:35.537008 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1288/2571] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:35.541649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb03ea-c99c-4b95-8973-815420921fc3 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:35.566088 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb03ea-c99c-4b95-8973-815420921fc3 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:35.591362 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05aa274-5ce5-442b-b98a-5570abd58236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:35.592329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05aa274-5ce5-442b-b98a-5570abd58236 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:35.592617 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05aa274-5ce5-442b-b98a-5570abd58236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:35.595054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05aa274-5ce5-442b-b98a-5570abd58236 admin admin] PATH_INFO: `/v3/projects/b594024075ef4328b9971e3075a157d6/users/4793f8c91eff4adc9dc54a5f477571b6/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:35.612079 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05aa274-5ce5-442b-b98a-5570abd58236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b594024075ef4328b9971e3075a157d6, user_id=4793f8c91eff4adc9dc54a5f477571b6, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:35.612079 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05aa274-5ce5-442b-b98a-5570abd58236 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:35.634238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1284/2572] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:35 2022] PUT /identity/v3/projects/b594024075ef4328b9971e3075a157d6/users/4793f8c91eff4adc9dc54a5f477571b6/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:35.653358 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc31fb0-e0b1-45c7-8614-3032f4d093df None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:35.653836 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc31fb0-e0b1-45c7-8614-3032f4d093df None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:35.654114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc31fb0-e0b1-45c7-8614-3032f4d093df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:35.654531 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05aa274-5ce5-442b-b98a-5570abd58236 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:35.656484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d05aa274-5ce5-442b-b98a-5570abd58236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:35.685188 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-cbc31fb0-e0b1-45c7-8614-3032f4d093df None None] MFA Rules not processed for user `4793f8c91eff4adc9dc54a5f477571b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:35.686531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cbc31fb0-e0b1-45c7-8614-3032f4d093df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:35.744913 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05aa274-5ce5-442b-b98a-5570abd58236 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:35.749773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930230e-2508-4b41-9305-eb1cbe360696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:35.752165 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930230e-2508-4b41-9305-eb1cbe360696 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:35.752621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930230e-2508-4b41-9305-eb1cbe360696 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:35.753242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930230e-2508-4b41-9305-eb1cbe360696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:35.755284 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a930230e-2508-4b41-9305-eb1cbe360696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:35.791803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1289/2573] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:35.807109 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc31fb0-e0b1-45c7-8614-3032f4d093df None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:35.809645 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cbc31fb0-e0b1-45c7-8614-3032f4d093df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:35.858869 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930230e-2508-4b41-9305-eb1cbe360696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:35.861275 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930230e-2508-4b41-9305-eb1cbe360696 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:35.887237 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc31fb0-e0b1-45c7-8614-3032f4d093df None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:35.888298 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1285/2574] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:35.893817 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1f476-0caf-497b-ba59-828b6c225e00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:35.894894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1f476-0caf-497b-ba59-828b6c225e00 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:35.895333 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1f476-0caf-497b-ba59-828b6c225e00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:35.895796 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1f476-0caf-497b-ba59-828b6c225e00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:35.907374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1f476-0caf-497b-ba59-828b6c225e00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:35.909911 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1f476-0caf-497b-ba59-828b6c225e00 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:35.932530 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1290/2575] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:36.030533 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930230e-2508-4b41-9305-eb1cbe360696 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:36.042464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930230e-2508-4b41-9305-eb1cbe360696 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:36.058894 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff592f-eb70-4b8c-84ad-e743cf90d9db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:36.059730 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff592f-eb70-4b8c-84ad-e743cf90d9db service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:36.060127 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff592f-eb70-4b8c-84ad-e743cf90d9db service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:36.060513 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff592f-eb70-4b8c-84ad-e743cf90d9db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:36.088151 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:36.139966 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff592f-eb70-4b8c-84ad-e743cf90d9db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:36.141726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff592f-eb70-4b8c-84ad-e743cf90d9db service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:36.151929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1286/2576] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:36.674139 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1f476-0caf-497b-ba59-828b6c225e00 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:36.675585 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-01a1f476-0caf-497b-ba59-828b6c225e00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:36.691052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1f476-0caf-497b-ba59-828b6c225e00 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:36.695674 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763f13e-c5a5-484d-99d1-e48742c3c021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:36.696655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763f13e-c5a5-484d-99d1-e48742c3c021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:36.696933 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763f13e-c5a5-484d-99d1-e48742c3c021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:36.697212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763f13e-c5a5-484d-99d1-e48742c3c021 admin admin] PATH_INFO: `/v3/users/48d3696971854a11bf530f0c57c72b9f` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:36.698406 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763f13e-c5a5-484d-99d1-e48742c3c021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d3696971854a11bf530f0c57c72b9f)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:36.700370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763f13e-c5a5-484d-99d1-e48742c3c021 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:36.784480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3763f13e-c5a5-484d-99d1-e48742c3c021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d3696971854a11bf530f0c57c72b9f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:36.797855 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3763f13e-c5a5-484d-99d1-e48742c3c021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d3696971854a11bf530f0c57c72b9f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:36.813676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3763f13e-c5a5-484d-99d1-e48742c3c021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d3696971854a11bf530f0c57c72b9f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:36.814708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3763f13e-c5a5-484d-99d1-e48742c3c021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d3696971854a11bf530f0c57c72b9f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:36.822504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3763f13e-c5a5-484d-99d1-e48742c3c021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d3696971854a11bf530f0c57c72b9f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:36.826449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:36.838251 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1291/2577] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:36 2022] DELETE /identity/v3/users/48d3696971854a11bf530f0c57c72b9f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:36.850243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e707acb-858d-4b3f-9ced-7a10ccc04cdd None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:36.850798 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e707acb-858d-4b3f-9ced-7a10ccc04cdd None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:36.850798 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e707acb-858d-4b3f-9ced-7a10ccc04cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:36.874929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6e707acb-858d-4b3f-9ced-7a10ccc04cdd None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:36.876505 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6e707acb-858d-4b3f-9ced-7a10ccc04cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:36.964499 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1287/2578] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:36.999616 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763f13e-c5a5-484d-99d1-e48742c3c021 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:37.002033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3763f13e-c5a5-484d-99d1-e48742c3c021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:37.111655 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763f13e-c5a5-484d-99d1-e48742c3c021 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:37.116263 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce6aeb-3541-423b-872d-390a63dc8707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:37.117215 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce6aeb-3541-423b-872d-390a63dc8707 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:37.117828 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce6aeb-3541-423b-872d-390a63dc8707 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:37.118322 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce6aeb-3541-423b-872d-390a63dc8707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:37.131934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce6aeb-3541-423b-872d-390a63dc8707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:37.133974 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce6aeb-3541-423b-872d-390a63dc8707 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:37.158557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1292/2579] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:14:37.665197 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e707acb-858d-4b3f-9ced-7a10ccc04cdd None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:37.666742 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6e707acb-858d-4b3f-9ced-7a10ccc04cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:37.680705 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e707acb-858d-4b3f-9ced-7a10ccc04cdd None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:37.686323 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c46841-ef6c-4f73-a6ef-c4f656da15aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:37.687666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c46841-ef6c-4f73-a6ef-c4f656da15aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:37.687666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c46841-ef6c-4f73-a6ef-c4f656da15aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:37.688096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c46841-ef6c-4f73-a6ef-c4f656da15aa admin admin] PATH_INFO: `/v3/projects/8f385ffe68b34bc4a89643d0841d9330` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:37.690041 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c46841-ef6c-4f73-a6ef-c4f656da15aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f385ffe68b34bc4a89643d0841d9330)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:37.697126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c46841-ef6c-4f73-a6ef-c4f656da15aa admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:37.814892 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c8c46841-ef6c-4f73-a6ef-c4f656da15aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f385ffe68b34bc4a89643d0841d9330', 'request_id': 'req-c8c46841-ef6c-4f73-a6ef-c4f656da15aa'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:37.848121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c8c46841-ef6c-4f73-a6ef-c4f656da15aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f385ffe68b34bc4a89643d0841d9330', 'request_id': 'req-c8c46841-ef6c-4f73-a6ef-c4f656da15aa'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:37.857205 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c8c46841-ef6c-4f73-a6ef-c4f656da15aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f385ffe68b34bc4a89643d0841d9330', 'request_id': 'req-c8c46841-ef6c-4f73-a6ef-c4f656da15aa'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:37.896444 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c8c46841-ef6c-4f73-a6ef-c4f656da15aa admin admin] The token cache is being invalidate because project 8f385ffe68b34bc4a89643d0841d9330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:37.897628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c8c46841-ef6c-4f73-a6ef-c4f656da15aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:37.900419 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c8c46841-ef6c-4f73-a6ef-c4f656da15aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:37.905582 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1288/2580] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:37 2022] DELETE /identity/v3/projects/8f385ffe68b34bc4a89643d0841d9330 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:37.917457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce6aeb-3541-423b-872d-390a63dc8707 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:37.937945 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce6aeb-3541-423b-872d-390a63dc8707 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:38.075479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc231ca-cd89-4551-8f3f-209fc651e0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:38.076711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc231ca-cd89-4551-8f3f-209fc651e0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:38.077072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc231ca-cd89-4551-8f3f-209fc651e0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:38.077422 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc231ca-cd89-4551-8f3f-209fc651e0a1 admin admin] PATH_INFO: `/v3/users/a8fde143c1d649d18f2bac0abb87cd4f` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:38.079448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc231ca-cd89-4551-8f3f-209fc651e0a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8fde143c1d649d18f2bac0abb87cd4f)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:38.081733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc231ca-cd89-4551-8f3f-209fc651e0a1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:38.160693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4bc231ca-cd89-4551-8f3f-209fc651e0a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8fde143c1d649d18f2bac0abb87cd4f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:38.176693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4bc231ca-cd89-4551-8f3f-209fc651e0a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8fde143c1d649d18f2bac0abb87cd4f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:38.204877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4bc231ca-cd89-4551-8f3f-209fc651e0a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8fde143c1d649d18f2bac0abb87cd4f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:38.206935 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4bc231ca-cd89-4551-8f3f-209fc651e0a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8fde143c1d649d18f2bac0abb87cd4f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:38.221193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4bc231ca-cd89-4551-8f3f-209fc651e0a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8fde143c1d649d18f2bac0abb87cd4f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:38.232384 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1293/2581] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:37 2022] DELETE /identity/v3/users/a8fde143c1d649d18f2bac0abb87cd4f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:38.609292 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c46841-ef6c-4f73-a6ef-c4f656da15aa admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:38.611757 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c8c46841-ef6c-4f73-a6ef-c4f656da15aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:38.649862 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c46841-ef6c-4f73-a6ef-c4f656da15aa admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:38.744837 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:38.763914 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c16547-cea8-43f8-ba84-d190be7e5f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:38.765096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c16547-cea8-43f8-ba84-d190be7e5f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:38.765632 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c16547-cea8-43f8-ba84-d190be7e5f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:38.766795 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c16547-cea8-43f8-ba84-d190be7e5f5b admin admin] PATH_INFO: `/v3/projects/e5d2491f95cb454b9e9d86bf3dd7622f` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:38.768816 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c16547-cea8-43f8-ba84-d190be7e5f5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d2491f95cb454b9e9d86bf3dd7622f)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:38.775714 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c16547-cea8-43f8-ba84-d190be7e5f5b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:38.844195 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-74c16547-cea8-43f8-ba84-d190be7e5f5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d2491f95cb454b9e9d86bf3dd7622f', 'request_id': 'req-74c16547-cea8-43f8-ba84-d190be7e5f5b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:38.863860 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-74c16547-cea8-43f8-ba84-d190be7e5f5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d2491f95cb454b9e9d86bf3dd7622f', 'request_id': 'req-74c16547-cea8-43f8-ba84-d190be7e5f5b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:38.863860 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-74c16547-cea8-43f8-ba84-d190be7e5f5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d2491f95cb454b9e9d86bf3dd7622f', 'request_id': 'req-74c16547-cea8-43f8-ba84-d190be7e5f5b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:38.876997 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-74c16547-cea8-43f8-ba84-d190be7e5f5b admin admin] The token cache is being invalidate because project e5d2491f95cb454b9e9d86bf3dd7622f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:38.877300 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-74c16547-cea8-43f8-ba84-d190be7e5f5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:38.877996 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-74c16547-cea8-43f8-ba84-d190be7e5f5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:38.882548 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1289/2582] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:38 2022] DELETE /identity/v3/projects/e5d2491f95cb454b9e9d86bf3dd7622f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:38.884949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc231ca-cd89-4551-8f3f-209fc651e0a1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:38.886466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4bc231ca-cd89-4551-8f3f-209fc651e0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:38.906775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc231ca-cd89-4551-8f3f-209fc651e0a1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:38.928860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:38.982145 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca00f4-ff75-4524-82e7-634a0393dd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:38.982958 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca00f4-ff75-4524-82e7-634a0393dd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:38.983241 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca00f4-ff75-4524-82e7-634a0393dd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:38.983515 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca00f4-ff75-4524-82e7-634a0393dd05 admin admin] PATH_INFO: `/v3/users/d5558a2741b64d6facd02f007313eed8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:38.985430 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca00f4-ff75-4524-82e7-634a0393dd05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5558a2741b64d6facd02f007313eed8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:38.987450 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca00f4-ff75-4524-82e7-634a0393dd05 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:39.066130 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c3ca00f4-ff75-4524-82e7-634a0393dd05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5558a2741b64d6facd02f007313eed8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:39.092701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c3ca00f4-ff75-4524-82e7-634a0393dd05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5558a2741b64d6facd02f007313eed8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:39.112009 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c3ca00f4-ff75-4524-82e7-634a0393dd05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5558a2741b64d6facd02f007313eed8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:39.119986 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c3ca00f4-ff75-4524-82e7-634a0393dd05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5558a2741b64d6facd02f007313eed8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:39.121360 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21ff56-6f39-4556-9442-2d12ff37cf94 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:39.121827 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21ff56-6f39-4556-9442-2d12ff37cf94 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:39.122127 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21ff56-6f39-4556-9442-2d12ff37cf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:39.141093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c3ca00f4-ff75-4524-82e7-634a0393dd05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5558a2741b64d6facd02f007313eed8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:39.147281 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5c21ff56-6f39-4556-9442-2d12ff37cf94 None None] MFA Rules not processed for user `91cb81b73de1405899bfa73cecb8e1ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:39.149244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5c21ff56-6f39-4556-9442-2d12ff37cf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:39.153182 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1294/2583] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:38 2022] DELETE /identity/v3/users/d5558a2741b64d6facd02f007313eed8 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:39.232171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1290/2584] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:14:39.523535 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca00f4-ff75-4524-82e7-634a0393dd05 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:39.525323 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c3ca00f4-ff75-4524-82e7-634a0393dd05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:39.687159 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca00f4-ff75-4524-82e7-634a0393dd05 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:39.696702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e420324-b5d8-42bf-9fe6-3f273a08f51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:39.698711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e420324-b5d8-42bf-9fe6-3f273a08f51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:39.699514 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e420324-b5d8-42bf-9fe6-3f273a08f51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:39.700866 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e420324-b5d8-42bf-9fe6-3f273a08f51d admin admin] PATH_INFO: `/v3/projects/b130c9a5451741179a9953e2bd97873d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:39.703311 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e420324-b5d8-42bf-9fe6-3f273a08f51d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b130c9a5451741179a9953e2bd97873d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:39.706541 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e420324-b5d8-42bf-9fe6-3f273a08f51d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:39.796727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:39.803532 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e420324-b5d8-42bf-9fe6-3f273a08f51d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b130c9a5451741179a9953e2bd97873d', 'request_id': 'req-9e420324-b5d8-42bf-9fe6-3f273a08f51d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:39.817717 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e420324-b5d8-42bf-9fe6-3f273a08f51d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b130c9a5451741179a9953e2bd97873d', 'request_id': 'req-9e420324-b5d8-42bf-9fe6-3f273a08f51d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:39.840870 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e420324-b5d8-42bf-9fe6-3f273a08f51d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b130c9a5451741179a9953e2bd97873d', 'request_id': 'req-9e420324-b5d8-42bf-9fe6-3f273a08f51d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:39.856887 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e420324-b5d8-42bf-9fe6-3f273a08f51d admin admin] The token cache is being invalidate because project b130c9a5451741179a9953e2bd97873d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:39.857265 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e420324-b5d8-42bf-9fe6-3f273a08f51d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:39.858182 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e420324-b5d8-42bf-9fe6-3f273a08f51d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:39.862701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1295/2585] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:39 2022] DELETE /identity/v3/projects/b130c9a5451741179a9953e2bd97873d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:39.867801 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fa36e-92cb-405b-a79e-6224c5f89632 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:39.868293 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fa36e-92cb-405b-a79e-6224c5f89632 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:39.868514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fa36e-92cb-405b-a79e-6224c5f89632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:39.905644 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9c5fa36e-92cb-405b-a79e-6224c5f89632 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:39.907657 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9c5fa36e-92cb-405b-a79e-6224c5f89632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:40.072141 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1291/2586] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:40.083849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15203a-0fdb-4c3a-a239-73a88b84b4fc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:40.083849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15203a-0fdb-4c3a-a239-73a88b84b4fc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:40.083849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15203a-0fdb-4c3a-a239-73a88b84b4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:40.140219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6b15203a-0fdb-4c3a-a239-73a88b84b4fc None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:40.144154 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6b15203a-0fdb-4c3a-a239-73a88b84b4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:40.169835 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1296/2587] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:40.174330 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fa36e-92cb-405b-a79e-6224c5f89632 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:40.184855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fa36e-92cb-405b-a79e-6224c5f89632 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:40.189808 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335160ab-ec08-4ecf-a867-a32295948213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:40.190555 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335160ab-ec08-4ecf-a867-a32295948213 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:40.190916 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335160ab-ec08-4ecf-a867-a32295948213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:40.191267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335160ab-ec08-4ecf-a867-a32295948213 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:40.192222 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335160ab-ec08-4ecf-a867-a32295948213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:14:40.192599 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335160ab-ec08-4ecf-a867-a32295948213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:40.194462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335160ab-ec08-4ecf-a867-a32295948213 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:40.217200 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1292/2588] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:14:40.226360 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15203a-0fdb-4c3a-a239-73a88b84b4fc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:40.240318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15203a-0fdb-4c3a-a239-73a88b84b4fc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:40.245465 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc7cca-05a5-49b7-a9ff-1505ce73149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:40.246218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc7cca-05a5-49b7-a9ff-1505ce73149f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:40.246579 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc7cca-05a5-49b7-a9ff-1505ce73149f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:40.246794 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc7cca-05a5-49b7-a9ff-1505ce73149f admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:40.247592 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc7cca-05a5-49b7-a9ff-1505ce73149f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:40.249423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc7cca-05a5-49b7-a9ff-1505ce73149f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:40.292347 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1297/2589] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:40 2022] POST /identity/v3/projects => generated 391 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:40.293620 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335160ab-ec08-4ecf-a867-a32295948213 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:40.305267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335160ab-ec08-4ecf-a867-a32295948213 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:40.310563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:40.387808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc7cca-05a5-49b7-a9ff-1505ce73149f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:40.390026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-09dc7cca-05a5-49b7-a9ff-1505ce73149f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:40.394418 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2c162-e8e3-4def-8e04-af5bd8691ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:40.395118 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2c162-e8e3-4def-8e04-af5bd8691ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:40.395543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2c162-e8e3-4def-8e04-af5bd8691ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:40.395852 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2c162-e8e3-4def-8e04-af5bd8691ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:40.396743 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2c162-e8e3-4def-8e04-af5bd8691ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:40.398904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2c162-e8e3-4def-8e04-af5bd8691ee8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:40.414699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc7cca-05a5-49b7-a9ff-1505ce73149f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:40.423075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24950b47-62dd-492c-a48b-01492f6da643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:40.424224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24950b47-62dd-492c-a48b-01492f6da643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:40.424727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24950b47-62dd-492c-a48b-01492f6da643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:40.425121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24950b47-62dd-492c-a48b-01492f6da643 admin admin] PATH_INFO: `/v3/users/9c9292fdef7f41af8fcb9375ce1764e2` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:40.426469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24950b47-62dd-492c-a48b-01492f6da643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9292fdef7f41af8fcb9375ce1764e2)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:40.428615 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24950b47-62dd-492c-a48b-01492f6da643 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:40.444053 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1293/2590] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:40 2022] POST /identity/v3/users => generated 296 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:14:40.449221 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2c162-e8e3-4def-8e04-af5bd8691ee8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:40.461600 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2c162-e8e3-4def-8e04-af5bd8691ee8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:40.467287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6af9c3-6904-4faa-9525-bf267947d36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:40.468006 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6af9c3-6904-4faa-9525-bf267947d36a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:40.468283 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6af9c3-6904-4faa-9525-bf267947d36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:40.468568 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6af9c3-6904-4faa-9525-bf267947d36a admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:40.470068 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6af9c3-6904-4faa-9525-bf267947d36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:40.471952 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6af9c3-6904-4faa-9525-bf267947d36a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:40.486374 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1294/2591] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:14:40.491129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6af9c3-6904-4faa-9525-bf267947d36a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:40.499767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-24950b47-62dd-492c-a48b-01492f6da643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9292fdef7f41af8fcb9375ce1764e2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:40.503005 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6af9c3-6904-4faa-9525-bf267947d36a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:40.509039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcae99-01fc-4463-b9f6-4c195b141bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:40.509715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcae99-01fc-4463-b9f6-4c195b141bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:40.510266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcae99-01fc-4463-b9f6-4c195b141bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:40.510416 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-24950b47-62dd-492c-a48b-01492f6da643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9292fdef7f41af8fcb9375ce1764e2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:40.510571 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcae99-01fc-4463-b9f6-4c195b141bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:40.511520 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcae99-01fc-4463-b9f6-4c195b141bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:40.513446 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcae99-01fc-4463-b9f6-4c195b141bb7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:40.525383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1295/2592] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:40.527083 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-24950b47-62dd-492c-a48b-01492f6da643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9292fdef7f41af8fcb9375ce1764e2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:40.528048 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-24950b47-62dd-492c-a48b-01492f6da643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9292fdef7f41af8fcb9375ce1764e2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:40.529700 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcae99-01fc-4463-b9f6-4c195b141bb7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:40.531687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d7fcae99-01fc-4463-b9f6-4c195b141bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:40.538409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-24950b47-62dd-492c-a48b-01492f6da643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9292fdef7f41af8fcb9375ce1764e2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:40.545821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1298/2593] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:40 2022] DELETE /identity/v3/users/9c9292fdef7f41af8fcb9375ce1764e2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:14:40.546425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcae99-01fc-4463-b9f6-4c195b141bb7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:40.619107 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6a0d3-a8ef-456b-a68b-1d338fcf3a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:40.620042 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6a0d3-a8ef-456b-a68b-1d338fcf3a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:40.620331 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6a0d3-a8ef-456b-a68b-1d338fcf3a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:40.620614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6a0d3-a8ef-456b-a68b-1d338fcf3a43 admin admin] PATH_INFO: `/v3/projects/397b0261c24f46cdaab428937a7063c3/users/3e1ad44d0be842a7902204785a5f4edd/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:40.636412 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f6a0d3-a8ef-456b-a68b-1d338fcf3a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=397b0261c24f46cdaab428937a7063c3, user_id=3e1ad44d0be842a7902204785a5f4edd, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:40.639175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f6a0d3-a8ef-456b-a68b-1d338fcf3a43 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:40.655423 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1296/2594] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:40 2022] PUT /identity/v3/projects/397b0261c24f46cdaab428937a7063c3/users/3e1ad44d0be842a7902204785a5f4edd/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:40.666078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725f10d-b2f4-49b6-8c34-3aa5c6d98034 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:40.666298 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725f10d-b2f4-49b6-8c34-3aa5c6d98034 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:40.666576 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725f10d-b2f4-49b6-8c34-3aa5c6d98034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:40.696063 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6725f10d-b2f4-49b6-8c34-3aa5c6d98034 None None] MFA Rules not processed for user `3e1ad44d0be842a7902204785a5f4edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:40.697487 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6725f10d-b2f4-49b6-8c34-3aa5c6d98034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:40.737502 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6a0d3-a8ef-456b-a68b-1d338fcf3a43 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:40.739246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-71f6a0d3-a8ef-456b-a68b-1d338fcf3a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:40.787748 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1299/2595] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:40.800122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725f10d-b2f4-49b6-8c34-3aa5c6d98034 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:40.801632 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6725f10d-b2f4-49b6-8c34-3aa5c6d98034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:40.808490 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:40.813493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6a0d3-a8ef-456b-a68b-1d338fcf3a43 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:40.819288 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59572d0f-acb2-4c4d-93e3-bf3970d24982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:40.820154 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59572d0f-acb2-4c4d-93e3-bf3970d24982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:40.820453 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59572d0f-acb2-4c4d-93e3-bf3970d24982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:40.820731 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59572d0f-acb2-4c4d-93e3-bf3970d24982 admin admin] PATH_INFO: `/v3/projects/185231fbe57e438a9ee70b39991235b2` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:40.821909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59572d0f-acb2-4c4d-93e3-bf3970d24982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=185231fbe57e438a9ee70b39991235b2)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:40.823926 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59572d0f-acb2-4c4d-93e3-bf3970d24982 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:40.825512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:40.868705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725f10d-b2f4-49b6-8c34-3aa5c6d98034 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:40.876190 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-59572d0f-acb2-4c4d-93e3-bf3970d24982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185231fbe57e438a9ee70b39991235b2', 'request_id': 'req-59572d0f-acb2-4c4d-93e3-bf3970d24982'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:40.884820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-59572d0f-acb2-4c4d-93e3-bf3970d24982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185231fbe57e438a9ee70b39991235b2', 'request_id': 'req-59572d0f-acb2-4c4d-93e3-bf3970d24982'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:40.892585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-59572d0f-acb2-4c4d-93e3-bf3970d24982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185231fbe57e438a9ee70b39991235b2', 'request_id': 'req-59572d0f-acb2-4c4d-93e3-bf3970d24982'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:40.905530 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-59572d0f-acb2-4c4d-93e3-bf3970d24982 admin admin] The token cache is being invalidate because project 185231fbe57e438a9ee70b39991235b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:40.905881 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-59572d0f-acb2-4c4d-93e3-bf3970d24982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:40.906589 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-59572d0f-acb2-4c4d-93e3-bf3970d24982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:40.908860 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1297/2596] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:40 2022] DELETE /identity/v3/projects/185231fbe57e438a9ee70b39991235b2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:14:40.913660 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b470ad-c755-48f3-978e-963f0353d5eb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:40.913956 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b470ad-c755-48f3-978e-963f0353d5eb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:40.914238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b470ad-c755-48f3-978e-963f0353d5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:40.929251 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848297b5-a493-4966-be62-a1c6af27eada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:40.929961 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848297b5-a493-4966-be62-a1c6af27eada service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:40.930376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848297b5-a493-4966-be62-a1c6af27eada service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:40.930666 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848297b5-a493-4966-be62-a1c6af27eada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:40.932557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-848297b5-a493-4966-be62-a1c6af27eada service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:40.932697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a4b470ad-c755-48f3-978e-963f0353d5eb None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:40.933745 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a4b470ad-c755-48f3-978e-963f0353d5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:40.994851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1298/2597] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:14:40.997075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848297b5-a493-4966-be62-a1c6af27eada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:40.998699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848297b5-a493-4966-be62-a1c6af27eada service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:41.004067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad135b83-1228-4c69-a89d-5ecb873fd3d1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:41.004445 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad135b83-1228-4c69-a89d-5ecb873fd3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:41.004808 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad135b83-1228-4c69-a89d-5ecb873fd3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:41.009085 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1300/2598] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:41.023389 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ad135b83-1228-4c69-a89d-5ecb873fd3d1 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:41.024515 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ad135b83-1228-4c69-a89d-5ecb873fd3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:41.032961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1299/2599] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:14:41.037167 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848297b5-a493-4966-be62-a1c6af27eada service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:41.048977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848297b5-a493-4966-be62-a1c6af27eada service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:41.053616 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3256a1-aafa-475a-a08c-72cc753a573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:41.054177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3256a1-aafa-475a-a08c-72cc753a573b admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:41.054463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3256a1-aafa-475a-a08c-72cc753a573b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:41.054743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3256a1-aafa-475a-a08c-72cc753a573b admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:41.055560 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3256a1-aafa-475a-a08c-72cc753a573b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:14:41.055898 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3256a1-aafa-475a-a08c-72cc753a573b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:41.057488 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3256a1-aafa-475a-a08c-72cc753a573b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:41.070865 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1301/2600] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:14:41.075187 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad135b83-1228-4c69-a89d-5ecb873fd3d1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:41.086186 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad135b83-1228-4c69-a89d-5ecb873fd3d1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:41.091060 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94a914-bc6b-49b9-99af-49ff0b8f9409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:41.091844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94a914-bc6b-49b9-99af-49ff0b8f9409 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:41.092156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94a914-bc6b-49b9-99af-49ff0b8f9409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:41.092467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94a914-bc6b-49b9-99af-49ff0b8f9409 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:41.093180 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94a914-bc6b-49b9-99af-49ff0b8f9409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:41.095115 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94a914-bc6b-49b9-99af-49ff0b8f9409 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:41.123897 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1300/2601] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:41 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:41.126938 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3256a1-aafa-475a-a08c-72cc753a573b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:41.137227 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3256a1-aafa-475a-a08c-72cc753a573b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:41.201071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c2028-4c8a-403f-9eb0-0e44bdb9cc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:41.201752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c2028-4c8a-403f-9eb0-0e44bdb9cc8d admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:41.202039 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c2028-4c8a-403f-9eb0-0e44bdb9cc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:41.202320 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c2028-4c8a-403f-9eb0-0e44bdb9cc8d admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:41.203035 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c2028-4c8a-403f-9eb0-0e44bdb9cc8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:41.205141 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c2028-4c8a-403f-9eb0-0e44bdb9cc8d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:41.213557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:41.229475 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1302/2602] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:41 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:41.233570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94a914-bc6b-49b9-99af-49ff0b8f9409 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:41.255929 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94a914-bc6b-49b9-99af-49ff0b8f9409 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:41.260767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce0c67-3537-4671-8784-e5def09490f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:41.261478 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce0c67-3537-4671-8784-e5def09490f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:41.261765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce0c67-3537-4671-8784-e5def09490f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:41.262044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce0c67-3537-4671-8784-e5def09490f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:41.263102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce0c67-3537-4671-8784-e5def09490f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:41.264545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce0c67-3537-4671-8784-e5def09490f4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:41.279061 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1301/2603] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:41.283488 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c2028-4c8a-403f-9eb0-0e44bdb9cc8d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:41.296426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c2028-4c8a-403f-9eb0-0e44bdb9cc8d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:41.302929 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194b7e3-4d0c-446b-82ef-9074775f73b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:41.304216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194b7e3-4d0c-446b-82ef-9074775f73b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:41.304216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194b7e3-4d0c-446b-82ef-9074775f73b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:41.304424 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194b7e3-4d0c-446b-82ef-9074775f73b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:41.305125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194b7e3-4d0c-446b-82ef-9074775f73b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:41.306926 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194b7e3-4d0c-446b-82ef-9074775f73b6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:41.322582 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1303/2604] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:14:41.323674 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce0c67-3537-4671-8784-e5def09490f4 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:41.336607 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce0c67-3537-4671-8784-e5def09490f4 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:41.342088 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b18fa-884f-4f1e-9384-bb680b7b4890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:41.342980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b18fa-884f-4f1e-9384-bb680b7b4890 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:41.343266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b18fa-884f-4f1e-9384-bb680b7b4890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:41.343652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b18fa-884f-4f1e-9384-bb680b7b4890 admin admin] PATH_INFO: `/v3/projects/c44e71f819fb456bb06dbf13227149f1/users/da17a60acd8d49a2a7db4a527f476c50/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:41.367358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b18fa-884f-4f1e-9384-bb680b7b4890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44e71f819fb456bb06dbf13227149f1, user_id=da17a60acd8d49a2a7db4a527f476c50, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:41.367358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b18fa-884f-4f1e-9384-bb680b7b4890 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:41.377857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1302/2605] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:41 2022] PUT /identity/v3/projects/c44e71f819fb456bb06dbf13227149f1/users/da17a60acd8d49a2a7db4a527f476c50/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:14:41.383028 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674849d2-07e6-4e8e-84c7-89c009fdbdd9 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:41.383321 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674849d2-07e6-4e8e-84c7-89c009fdbdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:41.383660 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674849d2-07e6-4e8e-84c7-89c009fdbdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:41.401656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-674849d2-07e6-4e8e-84c7-89c009fdbdd9 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:41.402849 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-674849d2-07e6-4e8e-84c7-89c009fdbdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:41.460631 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1304/2606] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:41.471074 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b18fa-884f-4f1e-9384-bb680b7b4890 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:41.472820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-528b18fa-884f-4f1e-9384-bb680b7b4890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:41.506620 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:41.535514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b18fa-884f-4f1e-9384-bb680b7b4890 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:41.539181 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf93457-1899-4ca8-981a-89cb6f2f04d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:41.539835 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf93457-1899-4ca8-981a-89cb6f2f04d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:41.540161 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf93457-1899-4ca8-981a-89cb6f2f04d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:41.540438 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf93457-1899-4ca8-981a-89cb6f2f04d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:41.550182 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf93457-1899-4ca8-981a-89cb6f2f04d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:41.551650 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf93457-1899-4ca8-981a-89cb6f2f04d7 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:41.561593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1303/2607] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:14:42.452213 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ed7a6-473e-4ccb-b95f-0aa9a5779188 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:42.452736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ed7a6-473e-4ccb-b95f-0aa9a5779188 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:42.453031 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ed7a6-473e-4ccb-b95f-0aa9a5779188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:42.486413 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b24ed7a6-473e-4ccb-b95f-0aa9a5779188 None None] MFA Rules not processed for user `da17a60acd8d49a2a7db4a527f476c50`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:42.488201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b24ed7a6-473e-4ccb-b95f-0aa9a5779188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:42.575354 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1305/2608] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:42.580206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf93457-1899-4ca8-981a-89cb6f2f04d7 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:42.593043 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf93457-1899-4ca8-981a-89cb6f2f04d7 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:42.598809 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f2874-f26a-4ee9-b293-33027468752c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:42.599502 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f2874-f26a-4ee9-b293-33027468752c admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:42.599792 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f2874-f26a-4ee9-b293-33027468752c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:42.600156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f2874-f26a-4ee9-b293-33027468752c admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:42.601120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f2874-f26a-4ee9-b293-33027468752c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:42.603242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f2874-f26a-4ee9-b293-33027468752c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:42.634256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1304/2609] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:42 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:42.635471 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ed7a6-473e-4ccb-b95f-0aa9a5779188 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:42.647765 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ed7a6-473e-4ccb-b95f-0aa9a5779188 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:42.708873 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a642943-a017-476a-a328-540116b73f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:42.709579 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a642943-a017-476a-a328-540116b73f32 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:42.709869 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a642943-a017-476a-a328-540116b73f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:42.710152 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a642943-a017-476a-a328-540116b73f32 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:42.710867 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a642943-a017-476a-a328-540116b73f32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:42.712913 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a642943-a017-476a-a328-540116b73f32 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:42.730705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:42.736412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1306/2610] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:42 2022] POST /identity/v3/users => generated 308 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:14:42.740552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f2874-f26a-4ee9-b293-33027468752c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:42.751320 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f2874-f26a-4ee9-b293-33027468752c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:42.755987 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f598991-888c-4b9a-8f68-c7374a8bbcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:42.756649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f598991-888c-4b9a-8f68-c7374a8bbcdf admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:42.756934 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f598991-888c-4b9a-8f68-c7374a8bbcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:42.757233 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f598991-888c-4b9a-8f68-c7374a8bbcdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:42.757969 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f598991-888c-4b9a-8f68-c7374a8bbcdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:42.759545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f598991-888c-4b9a-8f68-c7374a8bbcdf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:42.771125 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1305/2611] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:42.775231 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a642943-a017-476a-a328-540116b73f32 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:42.785426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a642943-a017-476a-a328-540116b73f32 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:42.790103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8960de1-9c22-45a2-a153-9d3d45a3767d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:42.790982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8960de1-9c22-45a2-a153-9d3d45a3767d admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:42.791265 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8960de1-9c22-45a2-a153-9d3d45a3767d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:42.791542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8960de1-9c22-45a2-a153-9d3d45a3767d admin admin] PATH_INFO: `/v3/projects/3329542d76024b338ada48ff06ac7312/users/d17c9435dce24b09aaf2d91becef333a/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:42.806561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8960de1-9c22-45a2-a153-9d3d45a3767d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3329542d76024b338ada48ff06ac7312, user_id=d17c9435dce24b09aaf2d91becef333a, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:42.809356 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8960de1-9c22-45a2-a153-9d3d45a3767d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:42.822594 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1307/2612] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:42 2022] PUT /identity/v3/projects/3329542d76024b338ada48ff06ac7312/users/d17c9435dce24b09aaf2d91becef333a/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:42.826535 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f598991-888c-4b9a-8f68-c7374a8bbcdf admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:42.837373 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f598991-888c-4b9a-8f68-c7374a8bbcdf admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:42.895390 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595a423-c0f9-4c88-85ec-d43ed46644b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:42.896138 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595a423-c0f9-4c88-85ec-d43ed46644b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:42.896577 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595a423-c0f9-4c88-85ec-d43ed46644b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:42.896871 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595a423-c0f9-4c88-85ec-d43ed46644b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:42.897606 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595a423-c0f9-4c88-85ec-d43ed46644b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:42.899301 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595a423-c0f9-4c88-85ec-d43ed46644b7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:42.910456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1306/2613] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:42.914581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8960de1-9c22-45a2-a153-9d3d45a3767d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:42.929037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8960de1-9c22-45a2-a153-9d3d45a3767d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:42.935049 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff31238-de15-4936-8f2c-aea721f55ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:42.935972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff31238-de15-4936-8f2c-aea721f55ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:42.936258 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff31238-de15-4936-8f2c-aea721f55ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:42.937015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff31238-de15-4936-8f2c-aea721f55ccf admin admin] PATH_INFO: `/v3/projects/3329542d76024b338ada48ff06ac7312/users/d17c9435dce24b09aaf2d91becef333a/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:42.938651 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff31238-de15-4936-8f2c-aea721f55ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3329542d76024b338ada48ff06ac7312, user_id=d17c9435dce24b09aaf2d91becef333a, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:42.941316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff31238-de15-4936-8f2c-aea721f55ccf admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:42.953230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1308/2614] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:42 2022] PUT /identity/v3/projects/3329542d76024b338ada48ff06ac7312/users/d17c9435dce24b09aaf2d91becef333a/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:43.345946 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a9c30-629d-43c4-b633-929baa06969e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:43.346241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a9c30-629d-43c4-b633-929baa06969e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:43.346520 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a9c30-629d-43c4-b633-929baa06969e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:43.366883 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-900a9c30-629d-43c4-b633-929baa06969e None None] MFA Rules not processed for user `a63dd78421064bbe838b1ed0261c13bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:43.367830 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-900a9c30-629d-43c4-b633-929baa06969e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:43.466784 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1307/2615] 10.222.0.41 () {58 vars in 1009 bytes} [Mon May 30 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:43.484774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff31238-de15-4936-8f2c-aea721f55ccf admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:43.487048 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8ff31238-de15-4936-8f2c-aea721f55ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:43.586962 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff31238-de15-4936-8f2c-aea721f55ccf admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:43.597324 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b789985-e91d-419f-8d16-c0fe8ca9f0ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e5f980cdb74227bb31c7e7e5eab74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:43.598188 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b789985-e91d-419f-8d16-c0fe8ca9f0ba service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:43.598501 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b789985-e91d-419f-8d16-c0fe8ca9f0ba service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:43.598844 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b789985-e91d-419f-8d16-c0fe8ca9f0ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:43.609319 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b789985-e91d-419f-8d16-c0fe8ca9f0ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:43.612278 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b789985-e91d-419f-8d16-c0fe8ca9f0ba service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:43.637528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1309/2616] 10.222.0.41 () {60 vars in 1384 bytes} [Mon May 30 12:14:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:14:44.304043 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81aa9a-b93b-4aed-96c9-4586dfc0bdb5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:44.304517 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81aa9a-b93b-4aed-96c9-4586dfc0bdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:44.304914 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81aa9a-b93b-4aed-96c9-4586dfc0bdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:44.362141 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0c81aa9a-b93b-4aed-96c9-4586dfc0bdb5 None None] MFA Rules not processed for user `d17c9435dce24b09aaf2d91becef333a`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:44.363637 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0c81aa9a-b93b-4aed-96c9-4586dfc0bdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:44.427483 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:44.541058 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1308/2617] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:44 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:45.630310 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b789985-e91d-419f-8d16-c0fe8ca9f0ba service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:45.694888 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b789985-e91d-419f-8d16-c0fe8ca9f0ba service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:45.699688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d44efc-ba81-4612-97d4-a594f04da420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:45.700589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d44efc-ba81-4612-97d4-a594f04da420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:45.700952 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d44efc-ba81-4612-97d4-a594f04da420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:45.701145 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d44efc-ba81-4612-97d4-a594f04da420 admin admin] PATH_INFO: `/v3/users/da17a60acd8d49a2a7db4a527f476c50` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:45.702370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d44efc-ba81-4612-97d4-a594f04da420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da17a60acd8d49a2a7db4a527f476c50)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:45.704845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d44efc-ba81-4612-97d4-a594f04da420 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:45.750641 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-56d44efc-ba81-4612-97d4-a594f04da420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da17a60acd8d49a2a7db4a527f476c50'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:45.758117 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-56d44efc-ba81-4612-97d4-a594f04da420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da17a60acd8d49a2a7db4a527f476c50'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:45.759221 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:45.775964 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-56d44efc-ba81-4612-97d4-a594f04da420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da17a60acd8d49a2a7db4a527f476c50'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:45.776656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-56d44efc-ba81-4612-97d4-a594f04da420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da17a60acd8d49a2a7db4a527f476c50'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:45.783985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-56d44efc-ba81-4612-97d4-a594f04da420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da17a60acd8d49a2a7db4a527f476c50'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:45.789810 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1310/2618] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:45 2022] DELETE /identity/v3/users/da17a60acd8d49a2a7db4a527f476c50 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:45.967148 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81aa9a-b93b-4aed-96c9-4586dfc0bdb5 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:45.991398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81aa9a-b93b-4aed-96c9-4586dfc0bdb5 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:46.052290 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8012e8-e512-450f-a56b-7651ba432d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:46.053157 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8012e8-e512-450f-a56b-7651ba432d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:46.053440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8012e8-e512-450f-a56b-7651ba432d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:46.053707 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8012e8-e512-450f-a56b-7651ba432d5f admin admin] PATH_INFO: `/v3/projects/c44e71f819fb456bb06dbf13227149f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:46.054898 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8012e8-e512-450f-a56b-7651ba432d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c44e71f819fb456bb06dbf13227149f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:46.056847 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8012e8-e512-450f-a56b-7651ba432d5f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:46.106593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9c8012e8-e512-450f-a56b-7651ba432d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44e71f819fb456bb06dbf13227149f1', 'request_id': 'req-9c8012e8-e512-450f-a56b-7651ba432d5f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:46.115108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9c8012e8-e512-450f-a56b-7651ba432d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44e71f819fb456bb06dbf13227149f1', 'request_id': 'req-9c8012e8-e512-450f-a56b-7651ba432d5f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:46.121901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9c8012e8-e512-450f-a56b-7651ba432d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44e71f819fb456bb06dbf13227149f1', 'request_id': 'req-9c8012e8-e512-450f-a56b-7651ba432d5f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:46.133859 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9c8012e8-e512-450f-a56b-7651ba432d5f admin admin] The token cache is being invalidate because project c44e71f819fb456bb06dbf13227149f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:46.134146 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9c8012e8-e512-450f-a56b-7651ba432d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:46.134794 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9c8012e8-e512-450f-a56b-7651ba432d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:46.136673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1309/2619] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:45 2022] DELETE /identity/v3/projects/c44e71f819fb456bb06dbf13227149f1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:46.140959 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d44efc-ba81-4612-97d4-a594f04da420 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:46.142709 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-56d44efc-ba81-4612-97d4-a594f04da420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:46.155349 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d44efc-ba81-4612-97d4-a594f04da420 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:46.211559 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b3cd8-ee6c-4feb-ae00-3448636ae275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:46.212547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b3cd8-ee6c-4feb-ae00-3448636ae275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:46.212925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b3cd8-ee6c-4feb-ae00-3448636ae275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:46.213210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b3cd8-ee6c-4feb-ae00-3448636ae275 admin admin] PATH_INFO: `/v3/users/d17c9435dce24b09aaf2d91becef333a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:46.214394 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b3cd8-ee6c-4feb-ae00-3448636ae275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d17c9435dce24b09aaf2d91becef333a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:46.216366 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b3cd8-ee6c-4feb-ae00-3448636ae275 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:46.261515 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9c7b3cd8-ee6c-4feb-ae00-3448636ae275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd17c9435dce24b09aaf2d91becef333a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:46.268292 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9c7b3cd8-ee6c-4feb-ae00-3448636ae275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd17c9435dce24b09aaf2d91becef333a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:46.280189 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9c7b3cd8-ee6c-4feb-ae00-3448636ae275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd17c9435dce24b09aaf2d91becef333a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:46.280850 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9c7b3cd8-ee6c-4feb-ae00-3448636ae275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd17c9435dce24b09aaf2d91becef333a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:46.287621 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9c7b3cd8-ee6c-4feb-ae00-3448636ae275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd17c9435dce24b09aaf2d91becef333a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:46.293438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1311/2620] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:46 2022] DELETE /identity/v3/users/d17c9435dce24b09aaf2d91becef333a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:46.463387 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8012e8-e512-450f-a56b-7651ba432d5f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:46.464962 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9c8012e8-e512-450f-a56b-7651ba432d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:46.481754 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8012e8-e512-450f-a56b-7651ba432d5f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:46.532290 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:46.541907 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a4205-ed9d-4a85-a06a-7844b7c03a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:46.542765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a4205-ed9d-4a85-a06a-7844b7c03a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:46.543068 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a4205-ed9d-4a85-a06a-7844b7c03a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:46.543330 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a4205-ed9d-4a85-a06a-7844b7c03a1b admin admin] PATH_INFO: `/v3/projects/3329542d76024b338ada48ff06ac7312` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:46.544522 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a4205-ed9d-4a85-a06a-7844b7c03a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3329542d76024b338ada48ff06ac7312)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:46.546453 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a4205-ed9d-4a85-a06a-7844b7c03a1b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:46.595153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-da9a4205-ed9d-4a85-a06a-7844b7c03a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3329542d76024b338ada48ff06ac7312', 'request_id': 'req-da9a4205-ed9d-4a85-a06a-7844b7c03a1b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:46.602668 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-da9a4205-ed9d-4a85-a06a-7844b7c03a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3329542d76024b338ada48ff06ac7312', 'request_id': 'req-da9a4205-ed9d-4a85-a06a-7844b7c03a1b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:46.608856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-da9a4205-ed9d-4a85-a06a-7844b7c03a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3329542d76024b338ada48ff06ac7312', 'request_id': 'req-da9a4205-ed9d-4a85-a06a-7844b7c03a1b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:46.619152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-da9a4205-ed9d-4a85-a06a-7844b7c03a1b admin admin] The token cache is being invalidate because project 3329542d76024b338ada48ff06ac7312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:46.619443 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-da9a4205-ed9d-4a85-a06a-7844b7c03a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:46.620107 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-da9a4205-ed9d-4a85-a06a-7844b7c03a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:46.621834 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1310/2621] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:46 2022] DELETE /identity/v3/projects/3329542d76024b338ada48ff06ac7312 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:14:46.626966 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c00743-d8be-484d-8a4d-00420e8e17c1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:46.627259 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c00743-d8be-484d-8a4d-00420e8e17c1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:46.627540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c00743-d8be-484d-8a4d-00420e8e17c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:46.645907 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-37c00743-d8be-484d-8a4d-00420e8e17c1 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:46.647114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-37c00743-d8be-484d-8a4d-00420e8e17c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:46.694480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:46.711767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1312/2622] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:46.719758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3596df-4a62-4bbf-9abd-84e88a0d0778 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:46.720081 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3596df-4a62-4bbf-9abd-84e88a0d0778 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:46.720367 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3596df-4a62-4bbf-9abd-84e88a0d0778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:46.738428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8d3596df-4a62-4bbf-9abd-84e88a0d0778 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:46.740316 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8d3596df-4a62-4bbf-9abd-84e88a0d0778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:46.748091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1311/2623] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:46.752719 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c00743-d8be-484d-8a4d-00420e8e17c1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:46.762328 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c00743-d8be-484d-8a4d-00420e8e17c1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:46.767554 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb371d-b680-43ef-8ec7-696e6ae004eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:46.768234 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb371d-b680-43ef-8ec7-696e6ae004eb admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:46.768524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb371d-b680-43ef-8ec7-696e6ae004eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:46.768805 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb371d-b680-43ef-8ec7-696e6ae004eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:46.769547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb371d-b680-43ef-8ec7-696e6ae004eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:14:46.769855 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb371d-b680-43ef-8ec7-696e6ae004eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:46.771453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb371d-b680-43ef-8ec7-696e6ae004eb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:46.783472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1313/2624] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:14:46.787642 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3596df-4a62-4bbf-9abd-84e88a0d0778 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:46.796770 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3596df-4a62-4bbf-9abd-84e88a0d0778 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:46.801973 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b52b70-3547-4a57-ab56-07c6e362b693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:46.802618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b52b70-3547-4a57-ab56-07c6e362b693 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:46.802897 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b52b70-3547-4a57-ab56-07c6e362b693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:46.803171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b52b70-3547-4a57-ab56-07c6e362b693 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:46.803892 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b52b70-3547-4a57-ab56-07c6e362b693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:46.805771 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b52b70-3547-4a57-ab56-07c6e362b693 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:46.832204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1312/2625] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:46 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:46.836262 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb371d-b680-43ef-8ec7-696e6ae004eb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:46.846430 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb371d-b680-43ef-8ec7-696e6ae004eb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:46.931172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db51a5-b303-4402-84d2-701d7c07f498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:46.931913 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db51a5-b303-4402-84d2-701d7c07f498 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:46.932217 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db51a5-b303-4402-84d2-701d7c07f498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:46.932467 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db51a5-b303-4402-84d2-701d7c07f498 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:46.933170 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db51a5-b303-4402-84d2-701d7c07f498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:46.935436 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db51a5-b303-4402-84d2-701d7c07f498 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:46.965018 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1314/2626] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:46 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:46.969310 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b52b70-3547-4a57-ab56-07c6e362b693 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:46.980894 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b52b70-3547-4a57-ab56-07c6e362b693 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:46.989000 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4781184-8dc9-4794-90cb-f48922e0f74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:46.990241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4781184-8dc9-4794-90cb-f48922e0f74b admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:46.990726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4781184-8dc9-4794-90cb-f48922e0f74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:46.991236 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4781184-8dc9-4794-90cb-f48922e0f74b admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:46.992394 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4781184-8dc9-4794-90cb-f48922e0f74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:46.994303 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4781184-8dc9-4794-90cb-f48922e0f74b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:47.015525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db51a5-b303-4402-84d2-701d7c07f498 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:47.020833 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1313/2627] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:47.030713 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db51a5-b303-4402-84d2-701d7c07f498 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:47.037221 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb034f6-636a-4c25-863f-be219b72b49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:47.037835 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb034f6-636a-4c25-863f-be219b72b49e admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:47.038125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb034f6-636a-4c25-863f-be219b72b49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:47.038401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb034f6-636a-4c25-863f-be219b72b49e admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:47.039136 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb034f6-636a-4c25-863f-be219b72b49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:47.040804 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb034f6-636a-4c25-863f-be219b72b49e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:47.065758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4781184-8dc9-4794-90cb-f48922e0f74b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:47.074756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1315/2628] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:14:47.082811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4781184-8dc9-4794-90cb-f48922e0f74b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:47.097240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbb89e-ebad-450f-8335-a59681024a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:47.098430 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbb89e-ebad-450f-8335-a59681024a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:47.098813 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbb89e-ebad-450f-8335-a59681024a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:47.099191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbb89e-ebad-450f-8335-a59681024a49 admin admin] PATH_INFO: `/v3/projects/c472ece984e64cb5b2b7f03284ea0209/users/38fb962e20c34fca8d9bea61a16e43a9/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:47.119271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbb89e-ebad-450f-8335-a59681024a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c472ece984e64cb5b2b7f03284ea0209, user_id=38fb962e20c34fca8d9bea61a16e43a9, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:47.123057 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbb89e-ebad-450f-8335-a59681024a49 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:47.141085 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1314/2629] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:47 2022] PUT /identity/v3/projects/c472ece984e64cb5b2b7f03284ea0209/users/38fb962e20c34fca8d9bea61a16e43a9/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:47.162183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7da4c3-cf85-45ec-9e41-8c17404772b6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:47.162586 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7da4c3-cf85-45ec-9e41-8c17404772b6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:47.162759 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7da4c3-cf85-45ec-9e41-8c17404772b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:47.201496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3f7da4c3-cf85-45ec-9e41-8c17404772b6 None None] MFA Rules not processed for user `38fb962e20c34fca8d9bea61a16e43a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:47.202775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3f7da4c3-cf85-45ec-9e41-8c17404772b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:47.303057 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1316/2630] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:47.307299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbb89e-ebad-450f-8335-a59681024a49 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:47.395430 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbb89e-ebad-450f-8335-a59681024a49 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:47.408458 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4f2f-cd59-4c59-b541-77dfde90d1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:47.409670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4f2f-cd59-4c59-b541-77dfde90d1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:47.410393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4f2f-cd59-4c59-b541-77dfde90d1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:47.410963 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4f2f-cd59-4c59-b541-77dfde90d1e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:47.412616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4f2f-cd59-4c59-b541-77dfde90d1e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:47.417525 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4f2f-cd59-4c59-b541-77dfde90d1e1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:47.479544 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7da4c3-cf85-45ec-9e41-8c17404772b6 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:47.487753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1315/2631] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:47 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:14:47.495566 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7da4c3-cf85-45ec-9e41-8c17404772b6 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:47.564900 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:47.597218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac9137-64e9-479b-b625-b774a8c4da27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:47.598596 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9137-64e9-479b-b625-b774a8c4da27 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:47.599136 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9137-64e9-479b-b625-b774a8c4da27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:47.599535 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9137-64e9-479b-b625-b774a8c4da27 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:47.601139 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac9137-64e9-479b-b625-b774a8c4da27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:47.603294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac9137-64e9-479b-b625-b774a8c4da27 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:47.637588 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4f2f-cd59-4c59-b541-77dfde90d1e1 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:47.643650 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1317/2632] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:47 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:47.645276 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:47.649776 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4f2f-cd59-4c59-b541-77dfde90d1e1 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:47.657140 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb24bf-1d2f-4746-a650-78b9baf49f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:47.658002 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb24bf-1d2f-4746-a650-78b9baf49f5f admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:47.658486 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb24bf-1d2f-4746-a650-78b9baf49f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:47.658940 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb24bf-1d2f-4746-a650-78b9baf49f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:47.659681 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb24bf-1d2f-4746-a650-78b9baf49f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:47.661337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb24bf-1d2f-4746-a650-78b9baf49f5f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:47.677087 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1316/2633] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:47.681226 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac9137-64e9-479b-b625-b774a8c4da27 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:47.698881 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac9137-64e9-479b-b625-b774a8c4da27 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:47.704454 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a3b8b-8874-4ff9-a7f5-2c5b8f1b9b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:47.705477 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a3b8b-8874-4ff9-a7f5-2c5b8f1b9b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:47.705867 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a3b8b-8874-4ff9-a7f5-2c5b8f1b9b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:47.706267 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a3b8b-8874-4ff9-a7f5-2c5b8f1b9b6a admin admin] PATH_INFO: `/v3/projects/d94ca2f36ba34b159b1cdade875efe5c/users/ee011ea9475c4e19b4864551941b1c92/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:47.723689 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a3b8b-8874-4ff9-a7f5-2c5b8f1b9b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d94ca2f36ba34b159b1cdade875efe5c, user_id=ee011ea9475c4e19b4864551941b1c92, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:47.726669 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a3b8b-8874-4ff9-a7f5-2c5b8f1b9b6a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:47.743275 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1318/2634] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:47 2022] PUT /identity/v3/projects/d94ca2f36ba34b159b1cdade875efe5c/users/ee011ea9475c4e19b4864551941b1c92/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:47.749241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb24bf-1d2f-4746-a650-78b9baf49f5f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:47.761867 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb24bf-1d2f-4746-a650-78b9baf49f5f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:47.827911 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f4c03-ecdc-4d47-9023-575f223b561d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:47.828548 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f4c03-ecdc-4d47-9023-575f223b561d admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:47.828827 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f4c03-ecdc-4d47-9023-575f223b561d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:47.829174 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f4c03-ecdc-4d47-9023-575f223b561d admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:47.829900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f4c03-ecdc-4d47-9023-575f223b561d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:47.831495 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f4c03-ecdc-4d47-9023-575f223b561d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:47.841478 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1317/2635] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:47.846990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a3b8b-8874-4ff9-a7f5-2c5b8f1b9b6a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:47.858172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a3b8b-8874-4ff9-a7f5-2c5b8f1b9b6a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:47.863587 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa2416-ce07-4bb8-9f7b-dacc75e1f3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:47.864517 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa2416-ce07-4bb8-9f7b-dacc75e1f3c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:47.864803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa2416-ce07-4bb8-9f7b-dacc75e1f3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:47.865086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa2416-ce07-4bb8-9f7b-dacc75e1f3c6 admin admin] PATH_INFO: `/v3/projects/d94ca2f36ba34b159b1cdade875efe5c/users/ee011ea9475c4e19b4864551941b1c92/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:47.867125 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa2416-ce07-4bb8-9f7b-dacc75e1f3c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d94ca2f36ba34b159b1cdade875efe5c, user_id=ee011ea9475c4e19b4864551941b1c92, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:47.870028 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa2416-ce07-4bb8-9f7b-dacc75e1f3c6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:47.882555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1319/2636] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:47 2022] PUT /identity/v3/projects/d94ca2f36ba34b159b1cdade875efe5c/users/ee011ea9475c4e19b4864551941b1c92/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:47.894441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26594036-3188-4f18-8811-3819d5744247 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:47.894729 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26594036-3188-4f18-8811-3819d5744247 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:47.895006 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26594036-3188-4f18-8811-3819d5744247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:47.923145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-26594036-3188-4f18-8811-3819d5744247 None None] MFA Rules not processed for user `ee011ea9475c4e19b4864551941b1c92`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:47.924432 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-26594036-3188-4f18-8811-3819d5744247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:48.052076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1318/2637] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:14:48.059039 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa2416-ce07-4bb8-9f7b-dacc75e1f3c6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:48.061412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9bfa2416-ce07-4bb8-9f7b-dacc75e1f3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:48.144370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa2416-ce07-4bb8-9f7b-dacc75e1f3c6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:48.161837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7f29e-593a-4f49-af3f-df43a2a422a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:48.164075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7f29e-593a-4f49-af3f-df43a2a422a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:48.164519 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7f29e-593a-4f49-af3f-df43a2a422a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:48.164951 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7f29e-593a-4f49-af3f-df43a2a422a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:48.181445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7f29e-593a-4f49-af3f-df43a2a422a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:48.183928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7f29e-593a-4f49-af3f-df43a2a422a8 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:48.199974 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1320/2638] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:48.238665 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26594036-3188-4f18-8811-3819d5744247 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:48.356789 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26594036-3188-4f18-8811-3819d5744247 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:48.362096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d42713-3772-482e-954c-f5f3a0ab8042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:48.363022 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d42713-3772-482e-954c-f5f3a0ab8042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:48.363308 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d42713-3772-482e-954c-f5f3a0ab8042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:48.363581 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d42713-3772-482e-954c-f5f3a0ab8042 admin admin] PATH_INFO: `/v3/users/38fb962e20c34fca8d9bea61a16e43a9` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:48.364905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d42713-3772-482e-954c-f5f3a0ab8042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38fb962e20c34fca8d9bea61a16e43a9)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:48.367027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d42713-3772-482e-954c-f5f3a0ab8042 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:48.399602 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:48.452194 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d0d42713-3772-482e-954c-f5f3a0ab8042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38fb962e20c34fca8d9bea61a16e43a9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:48.468216 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d0d42713-3772-482e-954c-f5f3a0ab8042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38fb962e20c34fca8d9bea61a16e43a9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:48.486716 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d0d42713-3772-482e-954c-f5f3a0ab8042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38fb962e20c34fca8d9bea61a16e43a9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:48.487466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d0d42713-3772-482e-954c-f5f3a0ab8042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38fb962e20c34fca8d9bea61a16e43a9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:48.488120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d0d42713-3772-482e-954c-f5f3a0ab8042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38fb962e20c34fca8d9bea61a16e43a9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:48.501739 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1319/2639] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:48 2022] DELETE /identity/v3/users/38fb962e20c34fca8d9bea61a16e43a9 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:48.507229 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5a33b-2dbc-4aed-bd2e-3cddb2f2891d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:48.507609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5a33b-2dbc-4aed-bd2e-3cddb2f2891d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:48.508003 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5a33b-2dbc-4aed-bd2e-3cddb2f2891d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:48.538354 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-23e5a33b-2dbc-4aed-bd2e-3cddb2f2891d None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:48.540030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-23e5a33b-2dbc-4aed-bd2e-3cddb2f2891d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:48.624722 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1321/2640] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:48.654466 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d42713-3772-482e-954c-f5f3a0ab8042 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:48.656106 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d0d42713-3772-482e-954c-f5f3a0ab8042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:48.763688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d42713-3772-482e-954c-f5f3a0ab8042 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:48.782437 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379b3a9-cbdd-4bf3-9855-a1e2e82ad637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:48.783299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379b3a9-cbdd-4bf3-9855-a1e2e82ad637 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:48.783805 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379b3a9-cbdd-4bf3-9855-a1e2e82ad637 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:48.784143 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379b3a9-cbdd-4bf3-9855-a1e2e82ad637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:48.796044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379b3a9-cbdd-4bf3-9855-a1e2e82ad637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:48.798509 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379b3a9-cbdd-4bf3-9855-a1e2e82ad637 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:48.822105 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1320/2641] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:49.147024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5a33b-2dbc-4aed-bd2e-3cddb2f2891d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:49.148544 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-23e5a33b-2dbc-4aed-bd2e-3cddb2f2891d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:49.162843 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5a33b-2dbc-4aed-bd2e-3cddb2f2891d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:49.169534 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273d3c6-f959-400c-bbdc-b7749431305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:49.170534 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273d3c6-f959-400c-bbdc-b7749431305c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:49.170883 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273d3c6-f959-400c-bbdc-b7749431305c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:49.171224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273d3c6-f959-400c-bbdc-b7749431305c admin admin] PATH_INFO: `/v3/projects/c472ece984e64cb5b2b7f03284ea0209` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:49.177625 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273d3c6-f959-400c-bbdc-b7749431305c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c472ece984e64cb5b2b7f03284ea0209)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:49.180284 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273d3c6-f959-400c-bbdc-b7749431305c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:49.235415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:49.245618 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8273d3c6-f959-400c-bbdc-b7749431305c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c472ece984e64cb5b2b7f03284ea0209', 'request_id': 'req-8273d3c6-f959-400c-bbdc-b7749431305c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:49.251921 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8273d3c6-f959-400c-bbdc-b7749431305c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c472ece984e64cb5b2b7f03284ea0209', 'request_id': 'req-8273d3c6-f959-400c-bbdc-b7749431305c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:49.259169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8273d3c6-f959-400c-bbdc-b7749431305c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c472ece984e64cb5b2b7f03284ea0209', 'request_id': 'req-8273d3c6-f959-400c-bbdc-b7749431305c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:49.270053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8273d3c6-f959-400c-bbdc-b7749431305c admin admin] The token cache is being invalidate because project c472ece984e64cb5b2b7f03284ea0209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:49.270341 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8273d3c6-f959-400c-bbdc-b7749431305c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:49.270959 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8273d3c6-f959-400c-bbdc-b7749431305c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:49.272589 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1322/2642] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:49 2022] DELETE /identity/v3/projects/c472ece984e64cb5b2b7f03284ea0209 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:49.276560 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379b3a9-cbdd-4bf3-9855-a1e2e82ad637 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:49.288480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379b3a9-cbdd-4bf3-9855-a1e2e82ad637 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:49.345525 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718e922-280e-4ac6-8416-86a409f720be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:49.346398 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718e922-280e-4ac6-8416-86a409f720be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:49.346688 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718e922-280e-4ac6-8416-86a409f720be admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:49.346970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718e922-280e-4ac6-8416-86a409f720be admin admin] PATH_INFO: `/v3/users/ee011ea9475c4e19b4864551941b1c92` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:49.348247 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718e922-280e-4ac6-8416-86a409f720be admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee011ea9475c4e19b4864551941b1c92)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:49.350167 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718e922-280e-4ac6-8416-86a409f720be admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:49.389820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:49.398419 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1718e922-280e-4ac6-8416-86a409f720be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee011ea9475c4e19b4864551941b1c92'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:49.407905 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1718e922-280e-4ac6-8416-86a409f720be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee011ea9475c4e19b4864551941b1c92'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:49.422437 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1718e922-280e-4ac6-8416-86a409f720be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee011ea9475c4e19b4864551941b1c92'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:49.423312 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1718e922-280e-4ac6-8416-86a409f720be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee011ea9475c4e19b4864551941b1c92'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:49.424018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1718e922-280e-4ac6-8416-86a409f720be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee011ea9475c4e19b4864551941b1c92'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:49.438987 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1321/2643] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:14:49 2022] DELETE /identity/v3/users/ee011ea9475c4e19b4864551941b1c92 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:14:49.740902 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273d3c6-f959-400c-bbdc-b7749431305c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:49.742676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8273d3c6-f959-400c-bbdc-b7749431305c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:49.760553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273d3c6-f959-400c-bbdc-b7749431305c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:49.859054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbf6b3-850b-4d99-b196-92ca156b521c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:49.860772 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbf6b3-850b-4d99-b196-92ca156b521c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:49.861073 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbf6b3-850b-4d99-b196-92ca156b521c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:49.861364 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbf6b3-850b-4d99-b196-92ca156b521c admin admin] PATH_INFO: `/v3/projects/d94ca2f36ba34b159b1cdade875efe5c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:49.862757 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbf6b3-850b-4d99-b196-92ca156b521c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d94ca2f36ba34b159b1cdade875efe5c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:49.864915 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbf6b3-850b-4d99-b196-92ca156b521c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:49.929815 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f9bbf6b3-850b-4d99-b196-92ca156b521c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd94ca2f36ba34b159b1cdade875efe5c', 'request_id': 'req-f9bbf6b3-850b-4d99-b196-92ca156b521c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:49.938126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f9bbf6b3-850b-4d99-b196-92ca156b521c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd94ca2f36ba34b159b1cdade875efe5c', 'request_id': 'req-f9bbf6b3-850b-4d99-b196-92ca156b521c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:49.951804 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f9bbf6b3-850b-4d99-b196-92ca156b521c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd94ca2f36ba34b159b1cdade875efe5c', 'request_id': 'req-f9bbf6b3-850b-4d99-b196-92ca156b521c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:49.968291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f9bbf6b3-850b-4d99-b196-92ca156b521c admin admin] The token cache is being invalidate because project d94ca2f36ba34b159b1cdade875efe5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:14:49.968729 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f9bbf6b3-850b-4d99-b196-92ca156b521c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:49.969433 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f9bbf6b3-850b-4d99-b196-92ca156b521c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:14:49.971693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1323/2644] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:14:49 2022] DELETE /identity/v3/projects/d94ca2f36ba34b159b1cdade875efe5c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:49.977084 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c933a-6800-4f09-9b2f-3162116697c3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:49.977392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c933a-6800-4f09-9b2f-3162116697c3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:49.977673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c933a-6800-4f09-9b2f-3162116697c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:49.998134 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2a2c933a-6800-4f09-9b2f-3162116697c3 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:49.999534 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2a2c933a-6800-4f09-9b2f-3162116697c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:50.076705 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1322/2645] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:50.084421 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc058d-d80f-4790-b569-27677b0b406a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:50.084719 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc058d-d80f-4790-b569-27677b0b406a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:50.085009 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc058d-d80f-4790-b569-27677b0b406a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:50.115681 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-76fc058d-d80f-4790-b569-27677b0b406a None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:50.116971 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-76fc058d-d80f-4790-b569-27677b0b406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:50.126391 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1324/2646] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:50.130486 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c933a-6800-4f09-9b2f-3162116697c3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:50.141434 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c933a-6800-4f09-9b2f-3162116697c3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:50.146192 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b08368-cf8a-4e35-ba18-af53217d9c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:50.146877 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b08368-cf8a-4e35-ba18-af53217d9c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:50.147304 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b08368-cf8a-4e35-ba18-af53217d9c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:50.147587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b08368-cf8a-4e35-ba18-af53217d9c74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:50.148354 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b08368-cf8a-4e35-ba18-af53217d9c74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:14:50.148666 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b08368-cf8a-4e35-ba18-af53217d9c74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:50.150393 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b08368-cf8a-4e35-ba18-af53217d9c74 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:50.165943 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1323/2647] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:14:50.171399 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc058d-d80f-4790-b569-27677b0b406a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:50.181318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc058d-d80f-4790-b569-27677b0b406a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:50.186006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe082a8-3143-423a-a858-9f59e1d38e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:50.186662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe082a8-3143-423a-a858-9f59e1d38e9a admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:50.186948 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe082a8-3143-423a-a858-9f59e1d38e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:50.187225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe082a8-3143-423a-a858-9f59e1d38e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:50.188128 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe082a8-3143-423a-a858-9f59e1d38e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:50.190036 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe082a8-3143-423a-a858-9f59e1d38e9a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:50.222858 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1325/2648] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:50 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:50.224360 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b08368-cf8a-4e35-ba18-af53217d9c74 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:50.237940 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b08368-cf8a-4e35-ba18-af53217d9c74 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:50.298574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944ab23-f6f5-42a5-906a-c88e33312389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:50.299250 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944ab23-f6f5-42a5-906a-c88e33312389 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:50.299536 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944ab23-f6f5-42a5-906a-c88e33312389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:50.299850 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944ab23-f6f5-42a5-906a-c88e33312389 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:50.300558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944ab23-f6f5-42a5-906a-c88e33312389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:50.302532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944ab23-f6f5-42a5-906a-c88e33312389 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:50.327937 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1324/2649] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:50 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:50.330575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe082a8-3143-423a-a858-9f59e1d38e9a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:50.349047 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe082a8-3143-423a-a858-9f59e1d38e9a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:50.354325 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9fd1f-3a58-4b7a-9488-b93233e01c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:50.354999 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9fd1f-3a58-4b7a-9488-b93233e01c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:50.355417 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9fd1f-3a58-4b7a-9488-b93233e01c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:50.355705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9fd1f-3a58-4b7a-9488-b93233e01c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:50.356488 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9fd1f-3a58-4b7a-9488-b93233e01c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:50.358127 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9fd1f-3a58-4b7a-9488-b93233e01c68 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:50.369372 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1326/2650] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:50.373360 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944ab23-f6f5-42a5-906a-c88e33312389 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:50.383980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944ab23-f6f5-42a5-906a-c88e33312389 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:50.388654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d961fa7-5205-49ba-8cb8-c6df63b40bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:50.389313 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d961fa7-5205-49ba-8cb8-c6df63b40bde admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:50.389602 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d961fa7-5205-49ba-8cb8-c6df63b40bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:50.389883 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d961fa7-5205-49ba-8cb8-c6df63b40bde admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:50.391249 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d961fa7-5205-49ba-8cb8-c6df63b40bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:50.392990 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d961fa7-5205-49ba-8cb8-c6df63b40bde admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:50.404652 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1325/2651] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:50.409022 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9fd1f-3a58-4b7a-9488-b93233e01c68 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:50.420513 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9fd1f-3a58-4b7a-9488-b93233e01c68 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:50.425835 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7df0f3-7804-4f80-9a68-ed654d3855e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:50.426818 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7df0f3-7804-4f80-9a68-ed654d3855e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:50.427194 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7df0f3-7804-4f80-9a68-ed654d3855e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:50.427536 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7df0f3-7804-4f80-9a68-ed654d3855e5 admin admin] PATH_INFO: `/v3/projects/ebd2d8ee7f134e379811995b4f1a9e69/users/da3dbd5b640a42afb47439dc792044bc/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:50.443641 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:50.447181 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7df0f3-7804-4f80-9a68-ed654d3855e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd2d8ee7f134e379811995b4f1a9e69, user_id=da3dbd5b640a42afb47439dc792044bc, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:50.450561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7df0f3-7804-4f80-9a68-ed654d3855e5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:50.467376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1327/2652] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:50 2022] PUT /identity/v3/projects/ebd2d8ee7f134e379811995b4f1a9e69/users/da3dbd5b640a42afb47439dc792044bc/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:14:50.477977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286a3db-5125-4b2c-b283-98503fbbe76d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:50.478268 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286a3db-5125-4b2c-b283-98503fbbe76d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:50.478557 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286a3db-5125-4b2c-b283-98503fbbe76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:50.511533 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c286a3db-5125-4b2c-b283-98503fbbe76d None None] MFA Rules not processed for user `da3dbd5b640a42afb47439dc792044bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:50.512821 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c286a3db-5125-4b2c-b283-98503fbbe76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:50.522660 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:50.588573 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1326/2653] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:50.593959 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7df0f3-7804-4f80-9a68-ed654d3855e5 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:50.670899 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7df0f3-7804-4f80-9a68-ed654d3855e5 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:50.675992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f87938-ab7a-4ab2-bbad-98e376926719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:50.676734 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f87938-ab7a-4ab2-bbad-98e376926719 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:50.677131 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f87938-ab7a-4ab2-bbad-98e376926719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:50.677419 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f87938-ab7a-4ab2-bbad-98e376926719 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:50.678248 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f87938-ab7a-4ab2-bbad-98e376926719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:50.680338 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f87938-ab7a-4ab2-bbad-98e376926719 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:50.708251 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1328/2654] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:50 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:14:50.712655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286a3db-5125-4b2c-b283-98503fbbe76d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:50.726001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286a3db-5125-4b2c-b283-98503fbbe76d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:50.787160 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4c511-6008-41da-9d0a-684254ececbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:50.787880 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4c511-6008-41da-9d0a-684254ececbb admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:50.788146 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4c511-6008-41da-9d0a-684254ececbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:50.788428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4c511-6008-41da-9d0a-684254ececbb admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:50.789127 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4c511-6008-41da-9d0a-684254ececbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:50.791065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4c511-6008-41da-9d0a-684254ececbb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:50.818783 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1327/2655] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:50 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:14:50.822604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f87938-ab7a-4ab2-bbad-98e376926719 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:50.833941 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f87938-ab7a-4ab2-bbad-98e376926719 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:50.841449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2aa452-9bb2-46b4-8374-0dd75d0825d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:50.841449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2aa452-9bb2-46b4-8374-0dd75d0825d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:50.841449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2aa452-9bb2-46b4-8374-0dd75d0825d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:50.841449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2aa452-9bb2-46b4-8374-0dd75d0825d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:50.842905 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2aa452-9bb2-46b4-8374-0dd75d0825d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:50.846948 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2aa452-9bb2-46b4-8374-0dd75d0825d8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:50.859290 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1329/2656] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:14:50.869164 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4c511-6008-41da-9d0a-684254ececbb admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:50.880641 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4c511-6008-41da-9d0a-684254ececbb admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:50.894176 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c476a4-b9a3-4598-8310-72fdaac83db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:50.894733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c476a4-b9a3-4598-8310-72fdaac83db2 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:50.895018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c476a4-b9a3-4598-8310-72fdaac83db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:50.895565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c476a4-b9a3-4598-8310-72fdaac83db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:50.896122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c476a4-b9a3-4598-8310-72fdaac83db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:50.899996 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c476a4-b9a3-4598-8310-72fdaac83db2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:50.915855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1328/2657] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:50.918858 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2aa452-9bb2-46b4-8374-0dd75d0825d8 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:50.931647 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2aa452-9bb2-46b4-8374-0dd75d0825d8 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:50.940143 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f79fa4-fbb1-4cf1-b2a9-196158e9249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:50.941114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f79fa4-fbb1-4cf1-b2a9-196158e9249b admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:50.941427 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f79fa4-fbb1-4cf1-b2a9-196158e9249b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:50.941733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f79fa4-fbb1-4cf1-b2a9-196158e9249b admin admin] PATH_INFO: `/v3/projects/054ff3f952304027b98380233e134fc0/users/27e0bffc546f42fe9fbfa143fd9a722d/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:50.959197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f79fa4-fbb1-4cf1-b2a9-196158e9249b admin admin] RBAC: Authorizing `identity:create_grant(project_id=054ff3f952304027b98380233e134fc0, user_id=27e0bffc546f42fe9fbfa143fd9a722d, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:50.961976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f79fa4-fbb1-4cf1-b2a9-196158e9249b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:50.981254 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1330/2658] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:50 2022] PUT /identity/v3/projects/054ff3f952304027b98380233e134fc0/users/27e0bffc546f42fe9fbfa143fd9a722d/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:50.993312 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15b186-bb3d-4d1f-8d7c-787f5ba44957 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:50.993745 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15b186-bb3d-4d1f-8d7c-787f5ba44957 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:50.994074 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15b186-bb3d-4d1f-8d7c-787f5ba44957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:51.026604 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-aa15b186-bb3d-4d1f-8d7c-787f5ba44957 None None] MFA Rules not processed for user `27e0bffc546f42fe9fbfa143fd9a722d`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:51.027836 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-aa15b186-bb3d-4d1f-8d7c-787f5ba44957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:51.105660 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1329/2659] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:51.110232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f79fa4-fbb1-4cf1-b2a9-196158e9249b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:51.243695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f79fa4-fbb1-4cf1-b2a9-196158e9249b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:51.249266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea022b-b115-4881-89f2-012b40704aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:51.249842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea022b-b115-4881-89f2-012b40704aeb admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:51.250316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea022b-b115-4881-89f2-012b40704aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:51.250856 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea022b-b115-4881-89f2-012b40704aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:51.251431 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea022b-b115-4881-89f2-012b40704aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:51.253458 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea022b-b115-4881-89f2-012b40704aeb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:51.290123 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1331/2660] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:14:51 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:14:51.290761 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15b186-bb3d-4d1f-8d7c-787f5ba44957 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:51.304545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15b186-bb3d-4d1f-8d7c-787f5ba44957 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:51.331885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:51.416062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128b468-c6f8-4318-8050-ba757771fe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:51.416904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128b468-c6f8-4318-8050-ba757771fe2e admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:51.417256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128b468-c6f8-4318-8050-ba757771fe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:51.417605 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128b468-c6f8-4318-8050-ba757771fe2e admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:51.418451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128b468-c6f8-4318-8050-ba757771fe2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:51.420516 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128b468-c6f8-4318-8050-ba757771fe2e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:51.459810 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea022b-b115-4881-89f2-012b40704aeb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:51.460076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1330/2661] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:14:51 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:14:51.464696 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea022b-b115-4881-89f2-012b40704aeb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:51.478281 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5a241-5bb8-4733-a8d2-9632b2c9e2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:51.479060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5a241-5bb8-4733-a8d2-9632b2c9e2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:51.479477 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5a241-5bb8-4733-a8d2-9632b2c9e2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:51.479768 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5a241-5bb8-4733-a8d2-9632b2c9e2a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:51.480654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5a241-5bb8-4733-a8d2-9632b2c9e2a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:51.482502 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5a241-5bb8-4733-a8d2-9632b2c9e2a6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:51.501736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1332/2662] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:51.503002 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128b468-c6f8-4318-8050-ba757771fe2e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:51.513700 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128b468-c6f8-4318-8050-ba757771fe2e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:51.519176 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2052b-858d-4bf5-b579-c24286f71486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:51.520171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2052b-858d-4bf5-b579-c24286f71486 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:51.520463 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2052b-858d-4bf5-b579-c24286f71486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:51.520743 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2052b-858d-4bf5-b579-c24286f71486 admin admin] PATH_INFO: `/v3/projects/5ad8a634d48f4fd388a0ba2b3c788eea/users/c39be92518f8470592b57ae7d9959009/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:51.535798 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2052b-858d-4bf5-b579-c24286f71486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad8a634d48f4fd388a0ba2b3c788eea, user_id=c39be92518f8470592b57ae7d9959009, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:51.538477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2052b-858d-4bf5-b579-c24286f71486 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:51.551593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1331/2663] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:51 2022] PUT /identity/v3/projects/5ad8a634d48f4fd388a0ba2b3c788eea/users/c39be92518f8470592b57ae7d9959009/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:51.555609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5a241-5bb8-4733-a8d2-9632b2c9e2a6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:51.566508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5a241-5bb8-4733-a8d2-9632b2c9e2a6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:51.578105 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:51.623574 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06117810-c5b9-474c-bc7e-689bcb5a4bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:51.624206 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06117810-c5b9-474c-bc7e-689bcb5a4bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:51.624513 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06117810-c5b9-474c-bc7e-689bcb5a4bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:51.624779 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06117810-c5b9-474c-bc7e-689bcb5a4bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:51.626122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06117810-c5b9-474c-bc7e-689bcb5a4bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:51.627736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06117810-c5b9-474c-bc7e-689bcb5a4bbf admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:51.638443 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1333/2664] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:14:51.642618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2052b-858d-4bf5-b579-c24286f71486 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:51.653185 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2052b-858d-4bf5-b579-c24286f71486 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:51.659027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3df75-4403-4891-a2a6-8dcf64d6029d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:51.660091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3df75-4403-4891-a2a6-8dcf64d6029d admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:51.660385 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3df75-4403-4891-a2a6-8dcf64d6029d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:51.660670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3df75-4403-4891-a2a6-8dcf64d6029d admin admin] PATH_INFO: `/v3/projects/5ad8a634d48f4fd388a0ba2b3c788eea/users/c39be92518f8470592b57ae7d9959009/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:51.662733 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3df75-4403-4891-a2a6-8dcf64d6029d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad8a634d48f4fd388a0ba2b3c788eea, user_id=c39be92518f8470592b57ae7d9959009, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:51.665523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3df75-4403-4891-a2a6-8dcf64d6029d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:51.678088 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1332/2665] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:14:51 2022] PUT /identity/v3/projects/5ad8a634d48f4fd388a0ba2b3c788eea/users/c39be92518f8470592b57ae7d9959009/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:14:51.689473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fee5e-a91b-4c51-8c39-5f738f30fc7b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:51.690029 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fee5e-a91b-4c51-8c39-5f738f30fc7b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:51.690476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fee5e-a91b-4c51-8c39-5f738f30fc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:51.720877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-216fee5e-a91b-4c51-8c39-5f738f30fc7b None None] MFA Rules not processed for user `c39be92518f8470592b57ae7d9959009`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:14:51.722121 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-216fee5e-a91b-4c51-8c39-5f738f30fc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:51.809418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1334/2666] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:14:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:14:51.820732 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3df75-4403-4891-a2a6-8dcf64d6029d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:51.822459 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6ab3df75-4403-4891-a2a6-8dcf64d6029d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:51.897285 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3df75-4403-4891-a2a6-8dcf64d6029d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:51.900935 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658ba90-0cb3-45bc-8691-618ac4d4f030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:51.901597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658ba90-0cb3-45bc-8691-618ac4d4f030 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:51.901887 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658ba90-0cb3-45bc-8691-618ac4d4f030 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:51.902172 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658ba90-0cb3-45bc-8691-618ac4d4f030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:51.911844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658ba90-0cb3-45bc-8691-618ac4d4f030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:51.913337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658ba90-0cb3-45bc-8691-618ac4d4f030 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:51.923240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1333/2667] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:52.629783 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fee5e-a91b-4c51-8c39-5f738f30fc7b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:52.641266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fee5e-a91b-4c51-8c39-5f738f30fc7b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:52.646930 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71930c5d-6966-4402-bd7c-fd0e60f01d0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:52.647649 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71930c5d-6966-4402-bd7c-fd0e60f01d0a service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:52.648111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71930c5d-6966-4402-bd7c-fd0e60f01d0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:52.648439 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71930c5d-6966-4402-bd7c-fd0e60f01d0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:52.759111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71930c5d-6966-4402-bd7c-fd0e60f01d0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:52.761016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71930c5d-6966-4402-bd7c-fd0e60f01d0a service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:52.773722 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1335/2668] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:14:56.462753 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658ba90-0cb3-45bc-8691-618ac4d4f030 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:14:56.464983 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9658ba90-0cb3-45bc-8691-618ac4d4f030 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:56.550021 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658ba90-0cb3-45bc-8691-618ac4d4f030 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:14:56.557051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d36b3-1396-413e-88db-78367b7efa3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b43eb1a0ac4db5adee3512453459aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:14:56.560628 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d36b3-1396-413e-88db-78367b7efa3d service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:14:56.560932 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d36b3-1396-413e-88db-78367b7efa3d service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:14:56.561219 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d36b3-1396-413e-88db-78367b7efa3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:14:56.563601 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-256d36b3-1396-413e-88db-78367b7efa3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:14:56.576011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d36b3-1396-413e-88db-78367b7efa3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:14:56.577636 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d36b3-1396-413e-88db-78367b7efa3d service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:14:56.589158 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1334/2669] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:14:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:00.175614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71930c5d-6966-4402-bd7c-fd0e60f01d0a service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:00.177095 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-71930c5d-6966-4402-bd7c-fd0e60f01d0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:00.188544 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71930c5d-6966-4402-bd7c-fd0e60f01d0a service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:00.193433 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df196779-c30c-4727-9805-9d59e9cc7a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:00.194070 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df196779-c30c-4727-9805-9d59e9cc7a8f service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:00.194353 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df196779-c30c-4727-9805-9d59e9cc7a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:00.194627 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df196779-c30c-4727-9805-9d59e9cc7a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:00.228355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:00.255024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df196779-c30c-4727-9805-9d59e9cc7a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:00.256522 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df196779-c30c-4727-9805-9d59e9cc7a8f service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:00.266719 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1336/2670] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:02.126568 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d36b3-1396-413e-88db-78367b7efa3d service placement] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:02.128590 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-256d36b3-1396-413e-88db-78367b7efa3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:02.134743 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:02.208546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d36b3-1396-413e-88db-78367b7efa3d service placement] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:02.213134 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b7c7e-fb02-4be6-9816-feea831e827a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:02.214087 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b7c7e-fb02-4be6-9816-feea831e827a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:02.214298 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b7c7e-fb02-4be6-9816-feea831e827a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:02.214583 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b7c7e-fb02-4be6-9816-feea831e827a admin admin] PATH_INFO: `/v3/users/3e1ad44d0be842a7902204785a5f4edd` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:02.215908 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b7c7e-fb02-4be6-9816-feea831e827a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1ad44d0be842a7902204785a5f4edd)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:02.218049 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b7c7e-fb02-4be6-9816-feea831e827a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:02.275787 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e21b7c7e-fb02-4be6-9816-feea831e827a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1ad44d0be842a7902204785a5f4edd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:02.286704 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e21b7c7e-fb02-4be6-9816-feea831e827a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1ad44d0be842a7902204785a5f4edd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:02.306858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e21b7c7e-fb02-4be6-9816-feea831e827a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1ad44d0be842a7902204785a5f4edd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:02.307694 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e21b7c7e-fb02-4be6-9816-feea831e827a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1ad44d0be842a7902204785a5f4edd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:02.308438 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e21b7c7e-fb02-4be6-9816-feea831e827a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1ad44d0be842a7902204785a5f4edd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:02.322244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1335/2671] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:15:02 2022] DELETE /identity/v3/users/3e1ad44d0be842a7902204785a5f4edd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:02.327129 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039125f-0d9c-4faf-9b13-68e4d98c5f49 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:02.327912 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039125f-0d9c-4faf-9b13-68e4d98c5f49 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:02.327912 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039125f-0d9c-4faf-9b13-68e4d98c5f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:02.345837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d039125f-0d9c-4faf-9b13-68e4d98c5f49 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:02.347060 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d039125f-0d9c-4faf-9b13-68e4d98c5f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:02.409566 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1337/2672] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:02.419025 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b7c7e-fb02-4be6-9816-feea831e827a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:02.420594 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e21b7c7e-fb02-4be6-9816-feea831e827a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:02.483059 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b7c7e-fb02-4be6-9816-feea831e827a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:02.488062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15da6b-f420-45f4-8dc7-a618427946c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:02.488745 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15da6b-f420-45f4-8dc7-a618427946c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:02.489019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15da6b-f420-45f4-8dc7-a618427946c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:02.489299 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15da6b-f420-45f4-8dc7-a618427946c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:02.499023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15da6b-f420-45f4-8dc7-a618427946c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:02.500537 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15da6b-f420-45f4-8dc7-a618427946c3 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:02.510096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1336/2673] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:02.567665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039125f-0d9c-4faf-9b13-68e4d98c5f49 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:02.569444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d039125f-0d9c-4faf-9b13-68e4d98c5f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:02.582765 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039125f-0d9c-4faf-9b13-68e4d98c5f49 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:02.587663 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a5f2d-1ee3-45ce-951f-bc6f2891e9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:02.589128 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a5f2d-1ee3-45ce-951f-bc6f2891e9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:02.589612 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a5f2d-1ee3-45ce-951f-bc6f2891e9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:02.589938 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a5f2d-1ee3-45ce-951f-bc6f2891e9dc admin admin] PATH_INFO: `/v3/users/da3dbd5b640a42afb47439dc792044bc` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:02.591302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a5f2d-1ee3-45ce-951f-bc6f2891e9dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=da3dbd5b640a42afb47439dc792044bc)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:02.594079 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a5f2d-1ee3-45ce-951f-bc6f2891e9dc admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:02.644571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9f2a5f2d-1ee3-45ce-951f-bc6f2891e9dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da3dbd5b640a42afb47439dc792044bc'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:02.652334 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9f2a5f2d-1ee3-45ce-951f-bc6f2891e9dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da3dbd5b640a42afb47439dc792044bc'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:02.670172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9f2a5f2d-1ee3-45ce-951f-bc6f2891e9dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da3dbd5b640a42afb47439dc792044bc'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:02.670914 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9f2a5f2d-1ee3-45ce-951f-bc6f2891e9dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da3dbd5b640a42afb47439dc792044bc'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:02.678508 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9f2a5f2d-1ee3-45ce-951f-bc6f2891e9dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da3dbd5b640a42afb47439dc792044bc'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:02.684473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1338/2674] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:15:02 2022] DELETE /identity/v3/users/da3dbd5b640a42afb47439dc792044bc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:02.689138 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4ffb8-1f0a-4e86-bcc5-99460fe94fd4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:02.689525 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4ffb8-1f0a-4e86-bcc5-99460fe94fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:02.689876 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4ffb8-1f0a-4e86-bcc5-99460fe94fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:02.707565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-47f4ffb8-1f0a-4e86-bcc5-99460fe94fd4 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:02.708819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-47f4ffb8-1f0a-4e86-bcc5-99460fe94fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:02.732819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:02.788727 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1337/2675] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:02.795068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a5f2d-1ee3-45ce-951f-bc6f2891e9dc admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:02.796524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9f2a5f2d-1ee3-45ce-951f-bc6f2891e9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:02.798676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4ffb8-1f0a-4e86-bcc5-99460fe94fd4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:02.800006 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-47f4ffb8-1f0a-4e86-bcc5-99460fe94fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:02.810805 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a5f2d-1ee3-45ce-951f-bc6f2891e9dc admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:02.817334 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a4e3e-9b4b-4364-ba98-e8e53f7b0dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:02.818298 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a4e3e-9b4b-4364-ba98-e8e53f7b0dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:02.818496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a4e3e-9b4b-4364-ba98-e8e53f7b0dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:02.818772 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a4e3e-9b4b-4364-ba98-e8e53f7b0dec admin admin] PATH_INFO: `/v3/projects/397b0261c24f46cdaab428937a7063c3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:02.820617 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a4e3e-9b4b-4364-ba98-e8e53f7b0dec admin admin] RBAC: Authorizing `identity:delete_project(project_id=397b0261c24f46cdaab428937a7063c3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:02.822573 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a4e3e-9b4b-4364-ba98-e8e53f7b0dec admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:02.868206 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:02.872326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4ffb8-1f0a-4e86-bcc5-99460fe94fd4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:02.875432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e12a4e3e-9b4b-4364-ba98-e8e53f7b0dec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397b0261c24f46cdaab428937a7063c3', 'request_id': 'req-e12a4e3e-9b4b-4364-ba98-e8e53f7b0dec'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:02.883396 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e12a4e3e-9b4b-4364-ba98-e8e53f7b0dec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397b0261c24f46cdaab428937a7063c3', 'request_id': 'req-e12a4e3e-9b4b-4364-ba98-e8e53f7b0dec'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:02.893214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e12a4e3e-9b4b-4364-ba98-e8e53f7b0dec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397b0261c24f46cdaab428937a7063c3', 'request_id': 'req-e12a4e3e-9b4b-4364-ba98-e8e53f7b0dec'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:02.906054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e12a4e3e-9b4b-4364-ba98-e8e53f7b0dec admin admin] The token cache is being invalidate because project 397b0261c24f46cdaab428937a7063c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:02.906358 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e12a4e3e-9b4b-4364-ba98-e8e53f7b0dec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:02.907017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e12a4e3e-9b4b-4364-ba98-e8e53f7b0dec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:02.908818 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1339/2676] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:15:02 2022] DELETE /identity/v3/projects/397b0261c24f46cdaab428937a7063c3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:02.913553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386ad95-6448-4e95-b4bc-1c25a2a9ab75 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:02.913976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386ad95-6448-4e95-b4bc-1c25a2a9ab75 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:02.914328 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386ad95-6448-4e95-b4bc-1c25a2a9ab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:02.936780 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-7386ad95-6448-4e95-b4bc-1c25a2a9ab75 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:02.938946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7386ad95-6448-4e95-b4bc-1c25a2a9ab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:02.940657 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cbd6a-0a9a-40d7-bb72-448a92b0d89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:02.942221 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cbd6a-0a9a-40d7-bb72-448a92b0d89b service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:02.942673 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cbd6a-0a9a-40d7-bb72-448a92b0d89b service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:02.943611 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cbd6a-0a9a-40d7-bb72-448a92b0d89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:02.946271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-133cbd6a-0a9a-40d7-bb72-448a92b0d89b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:03.034020 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1340/2677] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:03.043352 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df0098-0e66-4f3b-abc6-b36f323e9601 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:03.043701 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df0098-0e66-4f3b-abc6-b36f323e9601 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:03.044077 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df0098-0e66-4f3b-abc6-b36f323e9601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:03.049930 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133cbd6a-0a9a-40d7-bb72-448a92b0d89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:03.052703 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133cbd6a-0a9a-40d7-bb72-448a92b0d89b service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:03.065221 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1338/2678] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:03.071070 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-82df0098-0e66-4f3b-abc6-b36f323e9601 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:03.072376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-82df0098-0e66-4f3b-abc6-b36f323e9601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:03.082389 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1341/2679] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:03.086997 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cbd6a-0a9a-40d7-bb72-448a92b0d89b service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:03.098573 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cbd6a-0a9a-40d7-bb72-448a92b0d89b service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:03.104627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325c201-95df-4e01-8d55-3ffac1429fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:03.105514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c201-95df-4e01-8d55-3ffac1429fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:03.106120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c201-95df-4e01-8d55-3ffac1429fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:03.106120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c201-95df-4e01-8d55-3ffac1429fb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:03.107076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325c201-95df-4e01-8d55-3ffac1429fb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:03.108063 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325c201-95df-4e01-8d55-3ffac1429fb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:03.110273 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325c201-95df-4e01-8d55-3ffac1429fb3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:03.129721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1339/2680] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:03.131787 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df0098-0e66-4f3b-abc6-b36f323e9601 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:03.144723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df0098-0e66-4f3b-abc6-b36f323e9601 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:03.152021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebf9a3-7d12-4596-98fd-627e0334f181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:03.152847 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebf9a3-7d12-4596-98fd-627e0334f181 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:03.153096 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebf9a3-7d12-4596-98fd-627e0334f181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:03.153387 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebf9a3-7d12-4596-98fd-627e0334f181 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:03.154540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebf9a3-7d12-4596-98fd-627e0334f181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:03.157582 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebf9a3-7d12-4596-98fd-627e0334f181 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:03.194514 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325c201-95df-4e01-8d55-3ffac1429fb3 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:03.194829 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1342/2681] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:15:03 2022] POST /identity/v3/projects => generated 399 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:03.205495 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325c201-95df-4e01-8d55-3ffac1429fb3 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:03.228242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:03.281605 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae97736-7223-484e-b204-945bb30a7507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:03.282318 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae97736-7223-484e-b204-945bb30a7507 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:03.282591 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae97736-7223-484e-b204-945bb30a7507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:03.282872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae97736-7223-484e-b204-945bb30a7507 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:03.283574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae97736-7223-484e-b204-945bb30a7507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:03.285556 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae97736-7223-484e-b204-945bb30a7507 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:03.314064 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebf9a3-7d12-4596-98fd-627e0334f181 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:03.314865 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1340/2682] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:15:03 2022] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:15:03.326407 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebf9a3-7d12-4596-98fd-627e0334f181 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:03.332304 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa29853-99d2-491a-93b6-7a81cb74bfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:03.333773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa29853-99d2-491a-93b6-7a81cb74bfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:03.334153 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa29853-99d2-491a-93b6-7a81cb74bfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:03.334438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa29853-99d2-491a-93b6-7a81cb74bfd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:03.335376 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa29853-99d2-491a-93b6-7a81cb74bfd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:03.337086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa29853-99d2-491a-93b6-7a81cb74bfd1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:03.351367 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1343/2683] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:03.356261 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae97736-7223-484e-b204-945bb30a7507 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:03.368740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae97736-7223-484e-b204-945bb30a7507 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:03.373898 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f168e4-c9d6-495d-9c76-60ba27fcd618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:03.375480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f168e4-c9d6-495d-9c76-60ba27fcd618 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:03.375871 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f168e4-c9d6-495d-9c76-60ba27fcd618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:03.376137 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f168e4-c9d6-495d-9c76-60ba27fcd618 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:03.376885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f168e4-c9d6-495d-9c76-60ba27fcd618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:03.378528 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f168e4-c9d6-495d-9c76-60ba27fcd618 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:03.381986 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa29853-99d2-491a-93b6-7a81cb74bfd1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:03.385756 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ffa29853-99d2-491a-93b6-7a81cb74bfd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:03.389826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1341/2684] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:03.394756 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f168e4-c9d6-495d-9c76-60ba27fcd618 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:03.408291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f168e4-c9d6-495d-9c76-60ba27fcd618 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:03.414035 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4c424-1d83-42de-b869-ae9c7418c6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:03.415040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4c424-1d83-42de-b869-ae9c7418c6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:03.415481 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4c424-1d83-42de-b869-ae9c7418c6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:03.415845 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4c424-1d83-42de-b869-ae9c7418c6b5 admin admin] PATH_INFO: `/v3/projects/8df6e92618bb4018a1969b2215ed94f2/users/4f382165bed644fd80ff5fea95e589b0/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:03.417706 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa29853-99d2-491a-93b6-7a81cb74bfd1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:03.432868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec7e85-f23c-4250-9bac-108077e72043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:03.435037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec7e85-f23c-4250-9bac-108077e72043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:03.435374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec7e85-f23c-4250-9bac-108077e72043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:03.435949 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec7e85-f23c-4250-9bac-108077e72043 admin admin] PATH_INFO: `/v3/projects/ebd2d8ee7f134e379811995b4f1a9e69` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:03.437368 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec7e85-f23c-4250-9bac-108077e72043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd2d8ee7f134e379811995b4f1a9e69)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:03.437503 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4c424-1d83-42de-b869-ae9c7418c6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df6e92618bb4018a1969b2215ed94f2, user_id=4f382165bed644fd80ff5fea95e589b0, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:03.439424 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec7e85-f23c-4250-9bac-108077e72043 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:03.440425 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4c424-1d83-42de-b869-ae9c7418c6b5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:03.456012 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1342/2685] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:15:03 2022] PUT /identity/v3/projects/8df6e92618bb4018a1969b2215ed94f2/users/4f382165bed644fd80ff5fea95e589b0/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:03.466428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f89ac1-73c0-46eb-9c5c-a72e89faafcf None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:03.466725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f89ac1-73c0-46eb-9c5c-a72e89faafcf None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:03.467013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f89ac1-73c0-46eb-9c5c-a72e89faafcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:03.496526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-89f89ac1-73c0-46eb-9c5c-a72e89faafcf None None] MFA Rules not processed for user `4f382165bed644fd80ff5fea95e589b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:03.498456 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-89f89ac1-73c0-46eb-9c5c-a72e89faafcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:03.503113 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5eec7e85-f23c-4250-9bac-108077e72043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd2d8ee7f134e379811995b4f1a9e69', 'request_id': 'req-5eec7e85-f23c-4250-9bac-108077e72043'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:03.509610 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5eec7e85-f23c-4250-9bac-108077e72043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd2d8ee7f134e379811995b4f1a9e69', 'request_id': 'req-5eec7e85-f23c-4250-9bac-108077e72043'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:03.519167 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5eec7e85-f23c-4250-9bac-108077e72043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd2d8ee7f134e379811995b4f1a9e69', 'request_id': 'req-5eec7e85-f23c-4250-9bac-108077e72043'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:03.531606 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5eec7e85-f23c-4250-9bac-108077e72043 admin admin] The token cache is being invalidate because project ebd2d8ee7f134e379811995b4f1a9e69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:03.531943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5eec7e85-f23c-4250-9bac-108077e72043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:03.532623 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5eec7e85-f23c-4250-9bac-108077e72043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:03.534253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1344/2686] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:15:03 2022] DELETE /identity/v3/projects/ebd2d8ee7f134e379811995b4f1a9e69 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:03.538142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec7e85-f23c-4250-9bac-108077e72043 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:03.539527 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5eec7e85-f23c-4250-9bac-108077e72043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:03.555230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:03.586488 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1343/2687] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:03.599246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f89ac1-73c0-46eb-9c5c-a72e89faafcf None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:03.601074 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-89f89ac1-73c0-46eb-9c5c-a72e89faafcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:03.612480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec7e85-f23c-4250-9bac-108077e72043 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:03.617167 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7fcfe-7a59-475b-9528-1cccf1307b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:03.618042 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7fcfe-7a59-475b-9528-1cccf1307b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:03.618330 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7fcfe-7a59-475b-9528-1cccf1307b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:03.618614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7fcfe-7a59-475b-9528-1cccf1307b67 admin admin] PATH_INFO: `/v3/users/27e0bffc546f42fe9fbfa143fd9a722d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:03.619852 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7fcfe-7a59-475b-9528-1cccf1307b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e0bffc546f42fe9fbfa143fd9a722d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:03.621783 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7fcfe-7a59-475b-9528-1cccf1307b67 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:03.658455 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f89ac1-73c0-46eb-9c5c-a72e89faafcf None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:03.662234 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a6f48-e0c9-4936-a00a-9c7c7cfaf28d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:03.662960 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a6f48-e0c9-4936-a00a-9c7c7cfaf28d service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:03.663322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a6f48-e0c9-4936-a00a-9c7c7cfaf28d service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:03.663676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a6f48-e0c9-4936-a00a-9c7c7cfaf28d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:03.670235 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a3b7fcfe-7a59-475b-9528-1cccf1307b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e0bffc546f42fe9fbfa143fd9a722d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:03.673301 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a6f48-e0c9-4936-a00a-9c7c7cfaf28d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:03.674750 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a6f48-e0c9-4936-a00a-9c7c7cfaf28d service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:03.678529 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a3b7fcfe-7a59-475b-9528-1cccf1307b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e0bffc546f42fe9fbfa143fd9a722d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:03.683989 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1344/2688] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:15:03.690813 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a3b7fcfe-7a59-475b-9528-1cccf1307b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e0bffc546f42fe9fbfa143fd9a722d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:03.691516 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a3b7fcfe-7a59-475b-9528-1cccf1307b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e0bffc546f42fe9fbfa143fd9a722d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:03.698549 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a3b7fcfe-7a59-475b-9528-1cccf1307b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e0bffc546f42fe9fbfa143fd9a722d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:03.710360 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1345/2689] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:15:03 2022] DELETE /identity/v3/users/27e0bffc546f42fe9fbfa143fd9a722d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:04.040946 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a6f48-e0c9-4936-a00a-9c7c7cfaf28d service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:04.053527 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a6f48-e0c9-4936-a00a-9c7c7cfaf28d service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:04.068345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:04.131395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a14de-9b3b-44e6-9c9e-53801373bee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:04.132306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a14de-9b3b-44e6-9c9e-53801373bee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:04.132629 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a14de-9b3b-44e6-9c9e-53801373bee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:04.132871 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a14de-9b3b-44e6-9c9e-53801373bee5 admin admin] PATH_INFO: `/v3/projects/054ff3f952304027b98380233e134fc0` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:04.134122 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a14de-9b3b-44e6-9c9e-53801373bee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=054ff3f952304027b98380233e134fc0)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:04.136159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a14de-9b3b-44e6-9c9e-53801373bee5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:04.201193 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e07a14de-9b3b-44e6-9c9e-53801373bee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054ff3f952304027b98380233e134fc0', 'request_id': 'req-e07a14de-9b3b-44e6-9c9e-53801373bee5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:04.217470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e07a14de-9b3b-44e6-9c9e-53801373bee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054ff3f952304027b98380233e134fc0', 'request_id': 'req-e07a14de-9b3b-44e6-9c9e-53801373bee5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:04.226143 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e07a14de-9b3b-44e6-9c9e-53801373bee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054ff3f952304027b98380233e134fc0', 'request_id': 'req-e07a14de-9b3b-44e6-9c9e-53801373bee5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:04.241716 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e07a14de-9b3b-44e6-9c9e-53801373bee5 admin admin] The token cache is being invalidate because project 054ff3f952304027b98380233e134fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:04.242212 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e07a14de-9b3b-44e6-9c9e-53801373bee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:04.243810 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e07a14de-9b3b-44e6-9c9e-53801373bee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:04.245410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1345/2690] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:15:04 2022] DELETE /identity/v3/projects/054ff3f952304027b98380233e134fc0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:04.249312 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7fcfe-7a59-475b-9528-1cccf1307b67 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:04.251916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a3b7fcfe-7a59-475b-9528-1cccf1307b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:04.264945 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7fcfe-7a59-475b-9528-1cccf1307b67 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:04.322993 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d57722-eb20-4f9e-8a89-5008f2cb3275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:04.323894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d57722-eb20-4f9e-8a89-5008f2cb3275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:04.324184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d57722-eb20-4f9e-8a89-5008f2cb3275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:04.324476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d57722-eb20-4f9e-8a89-5008f2cb3275 admin admin] PATH_INFO: `/v3/users/c39be92518f8470592b57ae7d9959009` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:04.325678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d57722-eb20-4f9e-8a89-5008f2cb3275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c39be92518f8470592b57ae7d9959009)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:04.327800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d57722-eb20-4f9e-8a89-5008f2cb3275 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:04.365777 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:04.377466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-10d57722-eb20-4f9e-8a89-5008f2cb3275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c39be92518f8470592b57ae7d9959009'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:04.384117 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-10d57722-eb20-4f9e-8a89-5008f2cb3275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c39be92518f8470592b57ae7d9959009'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:04.396797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-10d57722-eb20-4f9e-8a89-5008f2cb3275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c39be92518f8470592b57ae7d9959009'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:04.397434 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-10d57722-eb20-4f9e-8a89-5008f2cb3275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c39be92518f8470592b57ae7d9959009'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:04.404112 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-10d57722-eb20-4f9e-8a89-5008f2cb3275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c39be92518f8470592b57ae7d9959009'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:04.410797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1346/2691] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:15:04 2022] DELETE /identity/v3/users/c39be92518f8470592b57ae7d9959009 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:04.769416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a14de-9b3b-44e6-9c9e-53801373bee5 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:04.771755 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e07a14de-9b3b-44e6-9c9e-53801373bee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:04.790897 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a14de-9b3b-44e6-9c9e-53801373bee5 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:04.867541 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c997f56-6ce7-42ac-8335-b6d783d5bdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:04.868441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c997f56-6ce7-42ac-8335-b6d783d5bdc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:04.868728 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c997f56-6ce7-42ac-8335-b6d783d5bdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:04.869003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c997f56-6ce7-42ac-8335-b6d783d5bdc6 admin admin] PATH_INFO: `/v3/projects/5ad8a634d48f4fd388a0ba2b3c788eea` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:04.870202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c997f56-6ce7-42ac-8335-b6d783d5bdc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad8a634d48f4fd388a0ba2b3c788eea)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:04.872163 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c997f56-6ce7-42ac-8335-b6d783d5bdc6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:04.913585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:04.924145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4c997f56-6ce7-42ac-8335-b6d783d5bdc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad8a634d48f4fd388a0ba2b3c788eea', 'request_id': 'req-4c997f56-6ce7-42ac-8335-b6d783d5bdc6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:04.932343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4c997f56-6ce7-42ac-8335-b6d783d5bdc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad8a634d48f4fd388a0ba2b3c788eea', 'request_id': 'req-4c997f56-6ce7-42ac-8335-b6d783d5bdc6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:04.939690 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4c997f56-6ce7-42ac-8335-b6d783d5bdc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad8a634d48f4fd388a0ba2b3c788eea', 'request_id': 'req-4c997f56-6ce7-42ac-8335-b6d783d5bdc6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:04.953083 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4c997f56-6ce7-42ac-8335-b6d783d5bdc6 admin admin] The token cache is being invalidate because project 5ad8a634d48f4fd388a0ba2b3c788eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:04.953503 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4c997f56-6ce7-42ac-8335-b6d783d5bdc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:04.954237 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4c997f56-6ce7-42ac-8335-b6d783d5bdc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:04.960158 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1346/2692] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:15:04 2022] DELETE /identity/v3/projects/5ad8a634d48f4fd388a0ba2b3c788eea => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:04.963593 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd488146-4263-42a7-a233-45f85d88aa76 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:04.963928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd488146-4263-42a7-a233-45f85d88aa76 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:04.964733 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd488146-4263-42a7-a233-45f85d88aa76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:04.989031 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-dd488146-4263-42a7-a233-45f85d88aa76 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:04.990252 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dd488146-4263-42a7-a233-45f85d88aa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:05.056178 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1347/2693] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:05.066442 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422e737-d4eb-484a-9b35-9636876fa822 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:05.066735 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422e737-d4eb-484a-9b35-9636876fa822 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:05.067018 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422e737-d4eb-484a-9b35-9636876fa822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:05.084859 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1422e737-d4eb-484a-9b35-9636876fa822 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:05.086088 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1422e737-d4eb-484a-9b35-9636876fa822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:05.094188 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1347/2694] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:05.098620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd488146-4263-42a7-a233-45f85d88aa76 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:05.108553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd488146-4263-42a7-a233-45f85d88aa76 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:05.113602 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b24938-c4cb-4df2-9c8a-1120a8838d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:05.114251 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b24938-c4cb-4df2-9c8a-1120a8838d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:05.114535 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b24938-c4cb-4df2-9c8a-1120a8838d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:05.114818 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b24938-c4cb-4df2-9c8a-1120a8838d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:05.115557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b24938-c4cb-4df2-9c8a-1120a8838d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:05.115899 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b24938-c4cb-4df2-9c8a-1120a8838d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:05.117485 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b24938-c4cb-4df2-9c8a-1120a8838d03 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:05.129816 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1348/2695] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:05.134324 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422e737-d4eb-484a-9b35-9636876fa822 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:05.144085 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422e737-d4eb-484a-9b35-9636876fa822 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:05.148941 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a5cc3-1af1-4e11-b9bc-233d71e29301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:05.149671 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a5cc3-1af1-4e11-b9bc-233d71e29301 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:05.150026 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a5cc3-1af1-4e11-b9bc-233d71e29301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:05.150371 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a5cc3-1af1-4e11-b9bc-233d71e29301 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:05.151235 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a5cc3-1af1-4e11-b9bc-233d71e29301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:05.153259 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a5cc3-1af1-4e11-b9bc-233d71e29301 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:05.181834 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1348/2696] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:15:05 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:05.186034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b24938-c4cb-4df2-9c8a-1120a8838d03 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:05.196789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b24938-c4cb-4df2-9c8a-1120a8838d03 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:05.274005 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b8d11-9d46-4460-977b-c3148283147f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:05.274696 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b8d11-9d46-4460-977b-c3148283147f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:05.274983 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b8d11-9d46-4460-977b-c3148283147f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:05.275266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b8d11-9d46-4460-977b-c3148283147f admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:05.276738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b8d11-9d46-4460-977b-c3148283147f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:05.280024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b8d11-9d46-4460-977b-c3148283147f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:05.316695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1349/2697] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:15:05 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:05.320670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a5cc3-1af1-4e11-b9bc-233d71e29301 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:05.334232 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a5cc3-1af1-4e11-b9bc-233d71e29301 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:05.339559 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf57b73-19eb-43a5-8d44-a60cf2f2e4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:05.340376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf57b73-19eb-43a5-8d44-a60cf2f2e4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:05.340818 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf57b73-19eb-43a5-8d44-a60cf2f2e4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:05.341178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf57b73-19eb-43a5-8d44-a60cf2f2e4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:05.342131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf57b73-19eb-43a5-8d44-a60cf2f2e4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:05.344654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf57b73-19eb-43a5-8d44-a60cf2f2e4a8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:05.356396 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1349/2698] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:05.361386 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b8d11-9d46-4460-977b-c3148283147f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:05.372483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b8d11-9d46-4460-977b-c3148283147f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:05.379718 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ba3e7-4f9a-4194-854e-a55cfa599bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:05.380437 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ba3e7-4f9a-4194-854e-a55cfa599bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:05.381891 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf57b73-19eb-43a5-8d44-a60cf2f2e4a8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:05.382303 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ba3e7-4f9a-4194-854e-a55cfa599bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:05.382597 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ba3e7-4f9a-4194-854e-a55cfa599bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:05.385973 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ba3e7-4f9a-4194-854e-a55cfa599bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:05.389017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ba3e7-4f9a-4194-854e-a55cfa599bbd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:05.396820 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2bf57b73-19eb-43a5-8d44-a60cf2f2e4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:05.409110 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1350/2699] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:05.420739 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ba3e7-4f9a-4194-854e-a55cfa599bbd admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:05.433950 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ba3e7-4f9a-4194-854e-a55cfa599bbd admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:05.441945 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30179dae-67df-4ece-b7d0-da077c854cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:05.443005 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30179dae-67df-4ece-b7d0-da077c854cae admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:05.443332 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30179dae-67df-4ece-b7d0-da077c854cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:05.443594 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30179dae-67df-4ece-b7d0-da077c854cae admin admin] PATH_INFO: `/v3/projects/d448151b201a482e8b902ebcd914e5b4/users/ad8ee089616143c3bca918146c19d96d/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:05.466489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf57b73-19eb-43a5-8d44-a60cf2f2e4a8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:05.470826 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30179dae-67df-4ece-b7d0-da077c854cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d448151b201a482e8b902ebcd914e5b4, user_id=ad8ee089616143c3bca918146c19d96d, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:05.472271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4294e-3a31-4c89-b8dd-942f2c44f6c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:05.472941 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4294e-3a31-4c89-b8dd-942f2c44f6c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:05.473229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4294e-3a31-4c89-b8dd-942f2c44f6c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:05.473512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4294e-3a31-4c89-b8dd-942f2c44f6c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:05.473802 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30179dae-67df-4ece-b7d0-da077c854cae admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:05.476575 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:05.478557 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-dea4294e-3a31-4c89-b8dd-942f2c44f6c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:05.498415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1351/2700] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:15:05 2022] PUT /identity/v3/projects/d448151b201a482e8b902ebcd914e5b4/users/ad8ee089616143c3bca918146c19d96d/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:05.514821 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08778539-702d-43f6-b1de-03e6a699365b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:05.515190 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08778539-702d-43f6-b1de-03e6a699365b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:05.515565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08778539-702d-43f6-b1de-03e6a699365b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:05.545103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-08778539-702d-43f6-b1de-03e6a699365b None None] MFA Rules not processed for user `ad8ee089616143c3bca918146c19d96d`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:05.546467 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-08778539-702d-43f6-b1de-03e6a699365b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:05.566327 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4294e-3a31-4c89-b8dd-942f2c44f6c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:05.567782 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4294e-3a31-4c89-b8dd-942f2c44f6c9 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:05.577132 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1350/2701] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:15:05.634111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1352/2702] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:15:05.648974 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4294e-3a31-4c89-b8dd-942f2c44f6c9 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:05.650475 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-dea4294e-3a31-4c89-b8dd-942f2c44f6c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:05.708803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:05.725187 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4294e-3a31-4c89-b8dd-942f2c44f6c9 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:05.819642 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457cb24-cfd7-41ca-9b44-1b50e65b95bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ffa6d38c01f4820a705c06991654bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:05.820711 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457cb24-cfd7-41ca-9b44-1b50e65b95bc service glance] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:05.821180 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457cb24-cfd7-41ca-9b44-1b50e65b95bc service glance] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:05.821586 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457cb24-cfd7-41ca-9b44-1b50e65b95bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:05.852202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457cb24-cfd7-41ca-9b44-1b50e65b95bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:05.854119 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457cb24-cfd7-41ca-9b44-1b50e65b95bc service glance] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:05.868904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1351/2703] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:15.630492 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:INSERT=1,keystone:SELECT=34 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:15.863206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=27 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:21.595873 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08778539-702d-43f6-b1de-03e6a699365b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:21.597479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-08778539-702d-43f6-b1de-03e6a699365b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:21.668156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08778539-702d-43f6-b1de-03e6a699365b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:21.672872 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204bff9-86c2-4be5-ae77-197a13ede30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:21.673750 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204bff9-86c2-4be5-ae77-197a13ede30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:21.674038 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204bff9-86c2-4be5-ae77-197a13ede30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:21.674327 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204bff9-86c2-4be5-ae77-197a13ede30b admin admin] PATH_INFO: `/v3/users/4f382165bed644fd80ff5fea95e589b0` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:21.675542 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204bff9-86c2-4be5-ae77-197a13ede30b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f382165bed644fd80ff5fea95e589b0)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:21.677543 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204bff9-86c2-4be5-ae77-197a13ede30b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:21.722759 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9204bff9-86c2-4be5-ae77-197a13ede30b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f382165bed644fd80ff5fea95e589b0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:21.730184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9204bff9-86c2-4be5-ae77-197a13ede30b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f382165bed644fd80ff5fea95e589b0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:21.743370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9204bff9-86c2-4be5-ae77-197a13ede30b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f382165bed644fd80ff5fea95e589b0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:21.744118 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9204bff9-86c2-4be5-ae77-197a13ede30b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f382165bed644fd80ff5fea95e589b0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:21.751985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9204bff9-86c2-4be5-ae77-197a13ede30b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f382165bed644fd80ff5fea95e589b0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:21.757932 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1353/2704] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:15:21 2022] DELETE /identity/v3/users/4f382165bed644fd80ff5fea95e589b0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:21.762484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4bad9-4d39-4c79-80b4-beca473603a6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:21.763016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4bad9-4d39-4c79-80b4-beca473603a6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:21.763016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4bad9-4d39-4c79-80b4-beca473603a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:21.783825 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-55a4bad9-4d39-4c79-80b4-beca473603a6 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:21.785217 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-55a4bad9-4d39-4c79-80b4-beca473603a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:21.863039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1352/2705] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:21.872625 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204bff9-86c2-4be5-ae77-197a13ede30b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:21.874114 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9204bff9-86c2-4be5-ae77-197a13ede30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:21.881062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b82a4-841e-4f0a-a940-6849f7c072dd None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:21.881411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b82a4-841e-4f0a-a940-6849f7c072dd None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:21.881729 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b82a4-841e-4f0a-a940-6849f7c072dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:21.900455 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ad6b82a4-841e-4f0a-a940-6849f7c072dd None None] MFA Rules not processed for user `f7e7ce32b4c0457196c8765d6c5ada7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:21.901682 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ad6b82a4-841e-4f0a-a940-6849f7c072dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:21.936241 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204bff9-86c2-4be5-ae77-197a13ede30b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:21.940754 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd13975-a615-4a31-90f4-3adf19990559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:21.941410 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd13975-a615-4a31-90f4-3adf19990559 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:21.941695 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd13975-a615-4a31-90f4-3adf19990559 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:21.941978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd13975-a615-4a31-90f4-3adf19990559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:21.951415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd13975-a615-4a31-90f4-3adf19990559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:21.953439 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd13975-a615-4a31-90f4-3adf19990559 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:21.959520 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1353/2706] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:15:21.963238 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1354/2707] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:22.376962 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b82a4-841e-4f0a-a940-6849f7c072dd None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:22.378518 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ad6b82a4-841e-4f0a-a940-6849f7c072dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:22.399741 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b82a4-841e-4f0a-a940-6849f7c072dd None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:22.409016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f13685-303a-4034-99fa-eb3fedb23501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:22.409917 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f13685-303a-4034-99fa-eb3fedb23501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:22.410209 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f13685-303a-4034-99fa-eb3fedb23501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:22.410489 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f13685-303a-4034-99fa-eb3fedb23501 admin admin] PATH_INFO: `/v3/projects/8df6e92618bb4018a1969b2215ed94f2` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:22.411880 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f13685-303a-4034-99fa-eb3fedb23501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df6e92618bb4018a1969b2215ed94f2)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:22.413877 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f13685-303a-4034-99fa-eb3fedb23501 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:22.474618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-34f13685-303a-4034-99fa-eb3fedb23501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df6e92618bb4018a1969b2215ed94f2', 'request_id': 'req-34f13685-303a-4034-99fa-eb3fedb23501'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:22.487464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-34f13685-303a-4034-99fa-eb3fedb23501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df6e92618bb4018a1969b2215ed94f2', 'request_id': 'req-34f13685-303a-4034-99fa-eb3fedb23501'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:22.494899 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-34f13685-303a-4034-99fa-eb3fedb23501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df6e92618bb4018a1969b2215ed94f2', 'request_id': 'req-34f13685-303a-4034-99fa-eb3fedb23501'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:22.505879 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-34f13685-303a-4034-99fa-eb3fedb23501 admin admin] The token cache is being invalidate because project 8df6e92618bb4018a1969b2215ed94f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:22.506175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-34f13685-303a-4034-99fa-eb3fedb23501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:22.506860 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-34f13685-303a-4034-99fa-eb3fedb23501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:22.508443 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1354/2708] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:15:22 2022] DELETE /identity/v3/projects/8df6e92618bb4018a1969b2215ed94f2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:31.224007 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd13975-a615-4a31-90f4-3adf19990559 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:31.225977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4cd13975-a615-4a31-90f4-3adf19990559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:31.237994 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd13975-a615-4a31-90f4-3adf19990559 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:31.256937 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:31.293374 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e92ee2-70ea-44e9-b9f3-366fa199616c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:31.294030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e92ee2-70ea-44e9-b9f3-366fa199616c service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:31.294316 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e92ee2-70ea-44e9-b9f3-366fa199616c service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:31.294596 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e92ee2-70ea-44e9-b9f3-366fa199616c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:31.296416 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-68e92ee2-70ea-44e9-b9f3-366fa199616c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:31.360968 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e92ee2-70ea-44e9-b9f3-366fa199616c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:31.362624 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e92ee2-70ea-44e9-b9f3-366fa199616c service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:31.376467 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1355/2709] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:15:32.502975 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:33.866627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f13685-303a-4034-99fa-eb3fedb23501 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:33.869260 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-34f13685-303a-4034-99fa-eb3fedb23501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:33.952180 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f13685-303a-4034-99fa-eb3fedb23501 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:33.959721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6aeacd-bf01-4508-98e5-66d797ab30ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:33.960987 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6aeacd-bf01-4508-98e5-66d797ab30ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:33.961369 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6aeacd-bf01-4508-98e5-66d797ab30ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:33.961788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6aeacd-bf01-4508-98e5-66d797ab30ee admin admin] PATH_INFO: `/v3/users/28abe6472b0f42b78912fc7c2b41bcaf` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:33.963224 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6aeacd-bf01-4508-98e5-66d797ab30ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=28abe6472b0f42b78912fc7c2b41bcaf)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:33.965659 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6aeacd-bf01-4508-98e5-66d797ab30ee admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:34.040504 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2a6aeacd-bf01-4508-98e5-66d797ab30ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28abe6472b0f42b78912fc7c2b41bcaf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:34.048407 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2a6aeacd-bf01-4508-98e5-66d797ab30ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28abe6472b0f42b78912fc7c2b41bcaf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:34.062409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2a6aeacd-bf01-4508-98e5-66d797ab30ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28abe6472b0f42b78912fc7c2b41bcaf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:34.063220 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2a6aeacd-bf01-4508-98e5-66d797ab30ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28abe6472b0f42b78912fc7c2b41bcaf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:34.063999 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2a6aeacd-bf01-4508-98e5-66d797ab30ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28abe6472b0f42b78912fc7c2b41bcaf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:34.078732 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1355/2710] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:15:33 2022] DELETE /identity/v3/users/28abe6472b0f42b78912fc7c2b41bcaf => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:34.083381 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab53da9-4b94-4e26-8bee-920e8a5e666c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:34.084269 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab53da9-4b94-4e26-8bee-920e8a5e666c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:34.084409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab53da9-4b94-4e26-8bee-920e8a5e666c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:34.105388 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-bab53da9-4b94-4e26-8bee-920e8a5e666c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:34.106706 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bab53da9-4b94-4e26-8bee-920e8a5e666c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:34.180226 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1356/2711] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:15:34.189839 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6aeacd-bf01-4508-98e5-66d797ab30ee admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:34.191879 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2a6aeacd-bf01-4508-98e5-66d797ab30ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:34.257414 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6aeacd-bf01-4508-98e5-66d797ab30ee admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:34.263657 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4576df-b1f3-4fc7-84fc-c34532c7432c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:34.264977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4576df-b1f3-4fc7-84fc-c34532c7432c service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:34.268321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4576df-b1f3-4fc7-84fc-c34532c7432c service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:34.268321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4576df-b1f3-4fc7-84fc-c34532c7432c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:34.279136 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4576df-b1f3-4fc7-84fc-c34532c7432c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:34.280698 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4576df-b1f3-4fc7-84fc-c34532c7432c service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:34.292463 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1356/2712] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:34.580344 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab53da9-4b94-4e26-8bee-920e8a5e666c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:34.581898 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bab53da9-4b94-4e26-8bee-920e8a5e666c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:34.596220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab53da9-4b94-4e26-8bee-920e8a5e666c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:34.601635 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26ccc8-3f44-4904-813a-8abce4d1ad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:34.602734 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26ccc8-3f44-4904-813a-8abce4d1ad2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:34.603353 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26ccc8-3f44-4904-813a-8abce4d1ad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:34.603645 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26ccc8-3f44-4904-813a-8abce4d1ad2b admin admin] PATH_INFO: `/v3/projects/9dce504c42f349ab9e1e5407883f9572` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:34.604917 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26ccc8-3f44-4904-813a-8abce4d1ad2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dce504c42f349ab9e1e5407883f9572)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:34.606832 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26ccc8-3f44-4904-813a-8abce4d1ad2b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:34.655355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1c26ccc8-3f44-4904-813a-8abce4d1ad2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dce504c42f349ab9e1e5407883f9572', 'request_id': 'req-1c26ccc8-3f44-4904-813a-8abce4d1ad2b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:34.661661 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1c26ccc8-3f44-4904-813a-8abce4d1ad2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dce504c42f349ab9e1e5407883f9572', 'request_id': 'req-1c26ccc8-3f44-4904-813a-8abce4d1ad2b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:34.669585 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1c26ccc8-3f44-4904-813a-8abce4d1ad2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dce504c42f349ab9e1e5407883f9572', 'request_id': 'req-1c26ccc8-3f44-4904-813a-8abce4d1ad2b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:34.675228 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:34.685081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1c26ccc8-3f44-4904-813a-8abce4d1ad2b admin admin] The token cache is being invalidate because project 9dce504c42f349ab9e1e5407883f9572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:34.685553 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1c26ccc8-3f44-4904-813a-8abce4d1ad2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:34.686483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1c26ccc8-3f44-4904-813a-8abce4d1ad2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:34.688200 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1357/2713] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:15:34 2022] DELETE /identity/v3/projects/9dce504c42f349ab9e1e5407883f9572 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:34.692751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4576df-b1f3-4fc7-84fc-c34532c7432c service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:34.702763 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4576df-b1f3-4fc7-84fc-c34532c7432c service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:34.721523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:34.771764 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd8da7-6f5f-4b0b-8207-3980646bebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:34.772841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd8da7-6f5f-4b0b-8207-3980646bebeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:34.773240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd8da7-6f5f-4b0b-8207-3980646bebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:34.773621 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd8da7-6f5f-4b0b-8207-3980646bebeb admin admin] PATH_INFO: `/v3/users/4793f8c91eff4adc9dc54a5f477571b6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:34.774984 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd8da7-6f5f-4b0b-8207-3980646bebeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4793f8c91eff4adc9dc54a5f477571b6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:34.777349 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd8da7-6f5f-4b0b-8207-3980646bebeb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:34.853214 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a0bd8da7-6f5f-4b0b-8207-3980646bebeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4793f8c91eff4adc9dc54a5f477571b6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:34.864078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a0bd8da7-6f5f-4b0b-8207-3980646bebeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4793f8c91eff4adc9dc54a5f477571b6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:34.882478 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a0bd8da7-6f5f-4b0b-8207-3980646bebeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4793f8c91eff4adc9dc54a5f477571b6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:34.883653 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a0bd8da7-6f5f-4b0b-8207-3980646bebeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4793f8c91eff4adc9dc54a5f477571b6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:34.884321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a0bd8da7-6f5f-4b0b-8207-3980646bebeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4793f8c91eff4adc9dc54a5f477571b6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:34.914791 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1357/2714] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:15:34 2022] DELETE /identity/v3/users/4793f8c91eff4adc9dc54a5f477571b6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:35.619531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26ccc8-3f44-4904-813a-8abce4d1ad2b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:35.622385 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1c26ccc8-3f44-4904-813a-8abce4d1ad2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:35.644083 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26ccc8-3f44-4904-813a-8abce4d1ad2b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:35.713250 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031a308-02ec-4122-8bd1-33f0c7c85800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:35.714115 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031a308-02ec-4122-8bd1-33f0c7c85800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:35.714398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031a308-02ec-4122-8bd1-33f0c7c85800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:35.714877 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031a308-02ec-4122-8bd1-33f0c7c85800 admin admin] PATH_INFO: `/v3/projects/b594024075ef4328b9971e3075a157d6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:35.716264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031a308-02ec-4122-8bd1-33f0c7c85800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b594024075ef4328b9971e3075a157d6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:35.718301 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031a308-02ec-4122-8bd1-33f0c7c85800 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:35.776594 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e031a308-02ec-4122-8bd1-33f0c7c85800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b594024075ef4328b9971e3075a157d6', 'request_id': 'req-e031a308-02ec-4122-8bd1-33f0c7c85800'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:35.785378 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e031a308-02ec-4122-8bd1-33f0c7c85800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b594024075ef4328b9971e3075a157d6', 'request_id': 'req-e031a308-02ec-4122-8bd1-33f0c7c85800'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:35.796452 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e031a308-02ec-4122-8bd1-33f0c7c85800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b594024075ef4328b9971e3075a157d6', 'request_id': 'req-e031a308-02ec-4122-8bd1-33f0c7c85800'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:35.814268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e031a308-02ec-4122-8bd1-33f0c7c85800 admin admin] The token cache is being invalidate because project b594024075ef4328b9971e3075a157d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:35.814680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e031a308-02ec-4122-8bd1-33f0c7c85800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:35.815748 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e031a308-02ec-4122-8bd1-33f0c7c85800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:35.818222 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1358/2715] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:15:35 2022] DELETE /identity/v3/projects/b594024075ef4328b9971e3075a157d6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:35.823849 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096102cc-c755-4ddc-a56b-02a8c55cc8a8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:35.824156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096102cc-c755-4ddc-a56b-02a8c55cc8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:35.824464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096102cc-c755-4ddc-a56b-02a8c55cc8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:35.846995 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-096102cc-c755-4ddc-a56b-02a8c55cc8a8 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:35.848589 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-096102cc-c755-4ddc-a56b-02a8c55cc8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:35.924450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1358/2716] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:35.928997 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e4eab-3b76-43d7-b319-bc741a4d25e5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:35.929286 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e4eab-3b76-43d7-b319-bc741a4d25e5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:35.929561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e4eab-3b76-43d7-b319-bc741a4d25e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:35.948945 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-037e4eab-3b76-43d7-b319-bc741a4d25e5 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:35.950157 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-037e4eab-3b76-43d7-b319-bc741a4d25e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:35.961932 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1359/2717] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:35.963941 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096102cc-c755-4ddc-a56b-02a8c55cc8a8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:35.977178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096102cc-c755-4ddc-a56b-02a8c55cc8a8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:35.982002 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ddf16-0488-4edb-90da-3282f8698eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:35.982676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ddf16-0488-4edb-90da-3282f8698eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:35.982968 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ddf16-0488-4edb-90da-3282f8698eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:35.983467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ddf16-0488-4edb-90da-3282f8698eb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:35.984465 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ddf16-0488-4edb-90da-3282f8698eb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:35.984902 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ddf16-0488-4edb-90da-3282f8698eb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:35.986555 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ddf16-0488-4edb-90da-3282f8698eb6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:36.003015 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1359/2718] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:36.004561 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e4eab-3b76-43d7-b319-bc741a4d25e5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:36.013990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e4eab-3b76-43d7-b319-bc741a4d25e5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:36.019981 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da512d-083f-401e-8aba-cfb5d1f0e6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:36.020408 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da512d-083f-401e-8aba-cfb5d1f0e6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:36.020696 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da512d-083f-401e-8aba-cfb5d1f0e6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:36.020977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da512d-083f-401e-8aba-cfb5d1f0e6b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:36.021686 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da512d-083f-401e-8aba-cfb5d1f0e6b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:36.023601 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da512d-083f-401e-8aba-cfb5d1f0e6b6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:36.054494 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1360/2719] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:15:36 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:36.055114 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ddf16-0488-4edb-90da-3282f8698eb6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:36.065287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ddf16-0488-4edb-90da-3282f8698eb6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:36.094896 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:36.129054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ed869-5b7d-4d3c-a321-72d06e8e35bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:36.129729 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ed869-5b7d-4d3c-a321-72d06e8e35bc admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:36.130090 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ed869-5b7d-4d3c-a321-72d06e8e35bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:36.130278 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ed869-5b7d-4d3c-a321-72d06e8e35bc admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:36.130972 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ed869-5b7d-4d3c-a321-72d06e8e35bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:36.132911 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ed869-5b7d-4d3c-a321-72d06e8e35bc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:36.153562 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1360/2720] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:15:36 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:15:36.157693 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da512d-083f-401e-8aba-cfb5d1f0e6b6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:36.168651 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da512d-083f-401e-8aba-cfb5d1f0e6b6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:36.173234 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7f0cc-2b3f-45e7-9db6-0b0f9b740b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:36.174106 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7f0cc-2b3f-45e7-9db6-0b0f9b740b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:36.174402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7f0cc-2b3f-45e7-9db6-0b0f9b740b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:36.174687 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7f0cc-2b3f-45e7-9db6-0b0f9b740b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:36.175424 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7f0cc-2b3f-45e7-9db6-0b0f9b740b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:36.177056 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7f0cc-2b3f-45e7-9db6-0b0f9b740b3d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:36.187247 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1361/2721] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:36.191542 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ed869-5b7d-4d3c-a321-72d06e8e35bc admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:36.201662 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ed869-5b7d-4d3c-a321-72d06e8e35bc admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:36.207142 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee89d77-6cad-4a8f-bbc2-7b2a5c0b5ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:36.207800 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee89d77-6cad-4a8f-bbc2-7b2a5c0b5ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:36.208129 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee89d77-6cad-4a8f-bbc2-7b2a5c0b5ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:36.208411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee89d77-6cad-4a8f-bbc2-7b2a5c0b5ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:36.209172 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee89d77-6cad-4a8f-bbc2-7b2a5c0b5ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:36.210799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee89d77-6cad-4a8f-bbc2-7b2a5c0b5ce3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:36.221496 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1361/2722] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:36.226178 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7f0cc-2b3f-45e7-9db6-0b0f9b740b3d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:36.236436 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7f0cc-2b3f-45e7-9db6-0b0f9b740b3d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:36.240917 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef694d9-5e90-4466-91a9-4e5f9ce142b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:36.241791 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef694d9-5e90-4466-91a9-4e5f9ce142b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:36.242079 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef694d9-5e90-4466-91a9-4e5f9ce142b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:36.242360 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef694d9-5e90-4466-91a9-4e5f9ce142b7 admin admin] PATH_INFO: `/v3/projects/9687587aeeb54850bdd03e25f5976822/users/ea33c0dfc0ba4722969854a95d479ead/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:36.257262 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef694d9-5e90-4466-91a9-4e5f9ce142b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9687587aeeb54850bdd03e25f5976822, user_id=ea33c0dfc0ba4722969854a95d479ead, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:36.259959 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef694d9-5e90-4466-91a9-4e5f9ce142b7 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:36.274009 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1362/2723] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:15:36 2022] PUT /identity/v3/projects/9687587aeeb54850bdd03e25f5976822/users/ea33c0dfc0ba4722969854a95d479ead/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:36.285804 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38bf04-f9a6-47da-a237-3a1861d09c2a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:36.286227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38bf04-f9a6-47da-a237-3a1861d09c2a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:36.286585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38bf04-f9a6-47da-a237-3a1861d09c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:36.314144 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8a38bf04-f9a6-47da-a237-3a1861d09c2a None None] MFA Rules not processed for user `ea33c0dfc0ba4722969854a95d479ead`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:36.316152 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8a38bf04-f9a6-47da-a237-3a1861d09c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:36.379922 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1362/2724] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:36.384527 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef694d9-5e90-4466-91a9-4e5f9ce142b7 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:36.411269 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:36.448736 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef694d9-5e90-4466-91a9-4e5f9ce142b7 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:36.453397 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c669c-870f-4abf-9056-d3f8cac05820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:36.454068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c669c-870f-4abf-9056-d3f8cac05820 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:36.454345 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c669c-870f-4abf-9056-d3f8cac05820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:36.454626 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c669c-870f-4abf-9056-d3f8cac05820 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:36.455331 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c669c-870f-4abf-9056-d3f8cac05820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:36.457253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c669c-870f-4abf-9056-d3f8cac05820 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:36.482232 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1363/2725] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:15:36 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:36.486317 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38bf04-f9a6-47da-a237-3a1861d09c2a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:36.497461 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38bf04-f9a6-47da-a237-3a1861d09c2a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:36.554493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698983b7-b6c2-4cf7-bd26-58b8d16cac96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:36.555159 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698983b7-b6c2-4cf7-bd26-58b8d16cac96 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:36.555444 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698983b7-b6c2-4cf7-bd26-58b8d16cac96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:36.555724 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698983b7-b6c2-4cf7-bd26-58b8d16cac96 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:36.556503 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698983b7-b6c2-4cf7-bd26-58b8d16cac96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:36.558361 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698983b7-b6c2-4cf7-bd26-58b8d16cac96 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:36.578046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1363/2726] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:15:36 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:36.582069 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c669c-870f-4abf-9056-d3f8cac05820 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:36.592399 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c669c-870f-4abf-9056-d3f8cac05820 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:36.597889 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a780605-15a4-4233-a97c-8f1abf45ed42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:36.598546 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a780605-15a4-4233-a97c-8f1abf45ed42 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:36.598836 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a780605-15a4-4233-a97c-8f1abf45ed42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:36.599147 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a780605-15a4-4233-a97c-8f1abf45ed42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:36.600182 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a780605-15a4-4233-a97c-8f1abf45ed42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:36.601813 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a780605-15a4-4233-a97c-8f1abf45ed42 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:36.612310 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1364/2727] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:36.616555 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698983b7-b6c2-4cf7-bd26-58b8d16cac96 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:36.626411 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698983b7-b6c2-4cf7-bd26-58b8d16cac96 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:36.631286 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dd3f1-e236-4b89-897b-435291dc8159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:36.632193 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dd3f1-e236-4b89-897b-435291dc8159 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:36.632476 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dd3f1-e236-4b89-897b-435291dc8159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:36.632756 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dd3f1-e236-4b89-897b-435291dc8159 admin admin] PATH_INFO: `/v3/projects/8086eb2a9d8e4eaa819b169f8243c7fa/users/628cf779f087487d99aafb15b70e8c5d/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:36.647114 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dd3f1-e236-4b89-897b-435291dc8159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8086eb2a9d8e4eaa819b169f8243c7fa, user_id=628cf779f087487d99aafb15b70e8c5d, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:36.649854 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dd3f1-e236-4b89-897b-435291dc8159 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:36.665484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1364/2728] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:15:36 2022] PUT /identity/v3/projects/8086eb2a9d8e4eaa819b169f8243c7fa/users/628cf779f087487d99aafb15b70e8c5d/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:36.669438 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a780605-15a4-4233-a97c-8f1abf45ed42 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:36.680194 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a780605-15a4-4233-a97c-8f1abf45ed42 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:36.736240 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68b335-7d17-4409-990b-e78099bd73ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:36.736974 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68b335-7d17-4409-990b-e78099bd73ad admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:36.737257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68b335-7d17-4409-990b-e78099bd73ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:36.737533 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68b335-7d17-4409-990b-e78099bd73ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:36.738255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68b335-7d17-4409-990b-e78099bd73ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:36.739859 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68b335-7d17-4409-990b-e78099bd73ad admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:36.749358 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1365/2729] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:36.753493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dd3f1-e236-4b89-897b-435291dc8159 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:36.758916 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:36.765271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dd3f1-e236-4b89-897b-435291dc8159 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:36.771342 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f5540-8420-410a-82f7-d5e42fa02049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:36.772390 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f5540-8420-410a-82f7-d5e42fa02049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:36.772679 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f5540-8420-410a-82f7-d5e42fa02049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:36.772958 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f5540-8420-410a-82f7-d5e42fa02049 admin admin] PATH_INFO: `/v3/projects/8086eb2a9d8e4eaa819b169f8243c7fa/users/628cf779f087487d99aafb15b70e8c5d/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:36.774968 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f5540-8420-410a-82f7-d5e42fa02049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8086eb2a9d8e4eaa819b169f8243c7fa, user_id=628cf779f087487d99aafb15b70e8c5d, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:36.777678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f5540-8420-410a-82f7-d5e42fa02049 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:36.789183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1365/2730] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:15:36 2022] PUT /identity/v3/projects/8086eb2a9d8e4eaa819b169f8243c7fa/users/628cf779f087487d99aafb15b70e8c5d/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:36.800680 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1118bcf-abd5-4f64-b0ff-aac5578a1330 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:36.800976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1118bcf-abd5-4f64-b0ff-aac5578a1330 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:36.801257 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1118bcf-abd5-4f64-b0ff-aac5578a1330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:36.827299 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b1118bcf-abd5-4f64-b0ff-aac5578a1330 None None] MFA Rules not processed for user `628cf779f087487d99aafb15b70e8c5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:36.828470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b1118bcf-abd5-4f64-b0ff-aac5578a1330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:36.897939 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1366/2731] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:36.909669 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f5540-8420-410a-82f7-d5e42fa02049 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:36.911442 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8a3f5540-8420-410a-82f7-d5e42fa02049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:36.969216 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f5540-8420-410a-82f7-d5e42fa02049 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:36.973667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fababe-361c-45a3-a87c-e767237f3037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:36.974316 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fababe-361c-45a3-a87c-e767237f3037 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:36.974605 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fababe-361c-45a3-a87c-e767237f3037 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:36.975179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fababe-361c-45a3-a87c-e767237f3037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:36.984373 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fababe-361c-45a3-a87c-e767237f3037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:36.985819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fababe-361c-45a3-a87c-e767237f3037 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:36.995473 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1366/2732] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:37.041347 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1118bcf-abd5-4f64-b0ff-aac5578a1330 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:37.042731 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b1118bcf-abd5-4f64-b0ff-aac5578a1330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:37.054496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1118bcf-abd5-4f64-b0ff-aac5578a1330 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:37.058071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34acbd-3451-4e63-9378-16386216953b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:37.058727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34acbd-3451-4e63-9378-16386216953b service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:37.059008 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34acbd-3451-4e63-9378-16386216953b service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:37.059280 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34acbd-3451-4e63-9378-16386216953b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:37.088111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:37.130875 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34acbd-3451-4e63-9378-16386216953b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:37.132350 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34acbd-3451-4e63-9378-16386216953b service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:37.141103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1367/2733] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:42.477062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fababe-361c-45a3-a87c-e767237f3037 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:42.538708 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fababe-361c-45a3-a87c-e767237f3037 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:42.543150 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77dea38-0287-4498-8279-e7ba51797608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:42.544040 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dea38-0287-4498-8279-e7ba51797608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:42.544320 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dea38-0287-4498-8279-e7ba51797608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:42.544593 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dea38-0287-4498-8279-e7ba51797608 admin admin] PATH_INFO: `/v3/users/ea33c0dfc0ba4722969854a95d479ead` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:42.545759 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77dea38-0287-4498-8279-e7ba51797608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea33c0dfc0ba4722969854a95d479ead)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:42.547675 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77dea38-0287-4498-8279-e7ba51797608 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:42.595099 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d77dea38-0287-4498-8279-e7ba51797608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea33c0dfc0ba4722969854a95d479ead'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:42.601703 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d77dea38-0287-4498-8279-e7ba51797608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea33c0dfc0ba4722969854a95d479ead'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:42.613807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d77dea38-0287-4498-8279-e7ba51797608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea33c0dfc0ba4722969854a95d479ead'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:42.614450 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d77dea38-0287-4498-8279-e7ba51797608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea33c0dfc0ba4722969854a95d479ead'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:42.615067 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d77dea38-0287-4498-8279-e7ba51797608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea33c0dfc0ba4722969854a95d479ead'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:42.626998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1367/2734] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:15:42 2022] DELETE /identity/v3/users/ea33c0dfc0ba4722969854a95d479ead => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:42.632067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e16e5a-898c-475d-bbdd-fcf59b18a29d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:42.632547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e16e5a-898c-475d-bbdd-fcf59b18a29d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:42.632671 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e16e5a-898c-475d-bbdd-fcf59b18a29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:42.650601 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-26e16e5a-898c-475d-bbdd-fcf59b18a29d None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:42.651837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-26e16e5a-898c-475d-bbdd-fcf59b18a29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:42.710926 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1368/2735] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:42.720607 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77dea38-0287-4498-8279-e7ba51797608 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:42.722304 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d77dea38-0287-4498-8279-e7ba51797608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:42.738020 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:42.786242 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77dea38-0287-4498-8279-e7ba51797608 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:42.790130 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd59b9-56a5-4901-a198-638be7b81dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:42.790811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd59b9-56a5-4901-a198-638be7b81dfe service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:42.791099 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd59b9-56a5-4901-a198-638be7b81dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:42.791376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd59b9-56a5-4901-a198-638be7b81dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:42.800953 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd59b9-56a5-4901-a198-638be7b81dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:42.802416 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd59b9-56a5-4901-a198-638be7b81dfe service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:42.811900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1368/2736] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:43.151059 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e16e5a-898c-475d-bbdd-fcf59b18a29d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:43.152681 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-26e16e5a-898c-475d-bbdd-fcf59b18a29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:43.169773 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e16e5a-898c-475d-bbdd-fcf59b18a29d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:43.183578 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cc280-0dd5-4400-af78-c777c95af09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:43.185694 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cc280-0dd5-4400-af78-c777c95af09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:43.185991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cc280-0dd5-4400-af78-c777c95af09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:43.186273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cc280-0dd5-4400-af78-c777c95af09d admin admin] PATH_INFO: `/v3/projects/9687587aeeb54850bdd03e25f5976822` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:43.188607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cc280-0dd5-4400-af78-c777c95af09d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9687587aeeb54850bdd03e25f5976822)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:43.193037 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cc280-0dd5-4400-af78-c777c95af09d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:43.273498 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cb3cc280-0dd5-4400-af78-c777c95af09d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9687587aeeb54850bdd03e25f5976822', 'request_id': 'req-cb3cc280-0dd5-4400-af78-c777c95af09d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.281048 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cb3cc280-0dd5-4400-af78-c777c95af09d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9687587aeeb54850bdd03e25f5976822', 'request_id': 'req-cb3cc280-0dd5-4400-af78-c777c95af09d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.292307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cb3cc280-0dd5-4400-af78-c777c95af09d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9687587aeeb54850bdd03e25f5976822', 'request_id': 'req-cb3cc280-0dd5-4400-af78-c777c95af09d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.312795 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cb3cc280-0dd5-4400-af78-c777c95af09d admin admin] The token cache is being invalidate because project 9687587aeeb54850bdd03e25f5976822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:43.313870 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cb3cc280-0dd5-4400-af78-c777c95af09d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.315644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cb3cc280-0dd5-4400-af78-c777c95af09d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.317837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1369/2737] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:15:43 2022] DELETE /identity/v3/projects/9687587aeeb54850bdd03e25f5976822 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:43.321641 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd59b9-56a5-4901-a198-638be7b81dfe service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:43.338803 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd59b9-56a5-4901-a198-638be7b81dfe service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:43.406327 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cd76c-0606-4ec1-a794-e5edbbe950cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:43.407221 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cd76c-0606-4ec1-a794-e5edbbe950cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:43.407508 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cd76c-0606-4ec1-a794-e5edbbe950cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:43.407787 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cd76c-0606-4ec1-a794-e5edbbe950cc admin admin] PATH_INFO: `/v3/users/628cf779f087487d99aafb15b70e8c5d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:43.409116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cd76c-0606-4ec1-a794-e5edbbe950cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=628cf779f087487d99aafb15b70e8c5d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:43.411111 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cd76c-0606-4ec1-a794-e5edbbe950cc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:43.464330 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cd3cd76c-0606-4ec1-a794-e5edbbe950cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '628cf779f087487d99aafb15b70e8c5d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.471554 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cd3cd76c-0606-4ec1-a794-e5edbbe950cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '628cf779f087487d99aafb15b70e8c5d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.483718 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cd3cd76c-0606-4ec1-a794-e5edbbe950cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '628cf779f087487d99aafb15b70e8c5d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.484392 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cd3cd76c-0606-4ec1-a794-e5edbbe950cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '628cf779f087487d99aafb15b70e8c5d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.485006 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cd3cd76c-0606-4ec1-a794-e5edbbe950cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '628cf779f087487d99aafb15b70e8c5d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.498306 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1369/2738] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:15:43 2022] DELETE /identity/v3/users/628cf779f087487d99aafb15b70e8c5d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:43.785836 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cc280-0dd5-4400-af78-c777c95af09d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:43.787513 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cb3cc280-0dd5-4400-af78-c777c95af09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:43.803224 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cc280-0dd5-4400-af78-c777c95af09d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:43.844081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:43.865860 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86686bc6-c7bc-48de-adf2-1112b3138c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:43.866753 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86686bc6-c7bc-48de-adf2-1112b3138c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:43.867039 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86686bc6-c7bc-48de-adf2-1112b3138c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:43.867318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86686bc6-c7bc-48de-adf2-1112b3138c1a admin admin] PATH_INFO: `/v3/projects/8086eb2a9d8e4eaa819b169f8243c7fa` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:43.869092 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86686bc6-c7bc-48de-adf2-1112b3138c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8086eb2a9d8e4eaa819b169f8243c7fa)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:43.871096 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86686bc6-c7bc-48de-adf2-1112b3138c1a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:43.918318 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-86686bc6-c7bc-48de-adf2-1112b3138c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8086eb2a9d8e4eaa819b169f8243c7fa', 'request_id': 'req-86686bc6-c7bc-48de-adf2-1112b3138c1a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.925201 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-86686bc6-c7bc-48de-adf2-1112b3138c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8086eb2a9d8e4eaa819b169f8243c7fa', 'request_id': 'req-86686bc6-c7bc-48de-adf2-1112b3138c1a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.932176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-86686bc6-c7bc-48de-adf2-1112b3138c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8086eb2a9d8e4eaa819b169f8243c7fa', 'request_id': 'req-86686bc6-c7bc-48de-adf2-1112b3138c1a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.942758 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-86686bc6-c7bc-48de-adf2-1112b3138c1a admin admin] The token cache is being invalidate because project 8086eb2a9d8e4eaa819b169f8243c7fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:43.943042 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-86686bc6-c7bc-48de-adf2-1112b3138c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.943684 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-86686bc6-c7bc-48de-adf2-1112b3138c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.945286 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1370/2739] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:15:43 2022] DELETE /identity/v3/projects/8086eb2a9d8e4eaa819b169f8243c7fa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:43.950133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c7d64-8475-47c1-8bc1-f09e41f99387 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:43.950430 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c7d64-8475-47c1-8bc1-f09e41f99387 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:43.950713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c7d64-8475-47c1-8bc1-f09e41f99387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:43.968030 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7c3c7d64-8475-47c1-8bc1-f09e41f99387 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:43.969236 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7c3c7d64-8475-47c1-8bc1-f09e41f99387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:43.999901 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:44.031906 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1370/2740] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:44.040268 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d52e67-118d-41f1-b6dd-3503327c3df5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:44.040554 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d52e67-118d-41f1-b6dd-3503327c3df5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:44.040830 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d52e67-118d-41f1-b6dd-3503327c3df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:44.059799 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c6d52e67-118d-41f1-b6dd-3503327c3df5 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:44.061064 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c6d52e67-118d-41f1-b6dd-3503327c3df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:44.069255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1371/2741] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:44.073448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c7d64-8475-47c1-8bc1-f09e41f99387 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:44.083178 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c7d64-8475-47c1-8bc1-f09e41f99387 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:44.087962 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83ef2d-6f96-473f-a57b-b37f02d3f6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:44.088616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83ef2d-6f96-473f-a57b-b37f02d3f6dd admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:44.088906 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83ef2d-6f96-473f-a57b-b37f02d3f6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:44.089190 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83ef2d-6f96-473f-a57b-b37f02d3f6dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:44.089920 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83ef2d-6f96-473f-a57b-b37f02d3f6dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:44.090236 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83ef2d-6f96-473f-a57b-b37f02d3f6dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:44.091892 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83ef2d-6f96-473f-a57b-b37f02d3f6dd admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:44.104263 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1371/2742] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:44.108357 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d52e67-118d-41f1-b6dd-3503327c3df5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:44.118461 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d52e67-118d-41f1-b6dd-3503327c3df5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:44.123014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30054830-131a-4b2d-a15e-33662944c477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:44.123659 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30054830-131a-4b2d-a15e-33662944c477 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:44.123972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30054830-131a-4b2d-a15e-33662944c477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:44.124248 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30054830-131a-4b2d-a15e-33662944c477 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:44.124946 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30054830-131a-4b2d-a15e-33662944c477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:44.126872 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30054830-131a-4b2d-a15e-33662944c477 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:44.152193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1372/2743] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:15:44 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:44.156175 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83ef2d-6f96-473f-a57b-b37f02d3f6dd admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:44.166765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83ef2d-6f96-473f-a57b-b37f02d3f6dd admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:44.224153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609db8fc-d7fe-47e4-a0bf-e80fa4b3bc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:44.224737 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609db8fc-d7fe-47e4-a0bf-e80fa4b3bc11 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:44.225284 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609db8fc-d7fe-47e4-a0bf-e80fa4b3bc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:44.225560 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609db8fc-d7fe-47e4-a0bf-e80fa4b3bc11 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:44.226329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609db8fc-d7fe-47e4-a0bf-e80fa4b3bc11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:44.228282 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609db8fc-d7fe-47e4-a0bf-e80fa4b3bc11 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:44.248591 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1372/2744] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:15:44 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:15:44.252963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30054830-131a-4b2d-a15e-33662944c477 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:44.263355 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30054830-131a-4b2d-a15e-33662944c477 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:44.268862 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233611c5-b787-4cf7-9aa5-9f079e6adf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:44.269298 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233611c5-b787-4cf7-9aa5-9f079e6adf73 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:44.269581 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233611c5-b787-4cf7-9aa5-9f079e6adf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:44.269861 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233611c5-b787-4cf7-9aa5-9f079e6adf73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:44.270593 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233611c5-b787-4cf7-9aa5-9f079e6adf73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:44.272195 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233611c5-b787-4cf7-9aa5-9f079e6adf73 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:44.283984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1373/2745] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:15:44.287990 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609db8fc-d7fe-47e4-a0bf-e80fa4b3bc11 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:44.298042 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609db8fc-d7fe-47e4-a0bf-e80fa4b3bc11 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:44.303200 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8feb3-214f-44aa-a717-95e978b6459c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:44.303963 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8feb3-214f-44aa-a717-95e978b6459c admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:44.304246 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8feb3-214f-44aa-a717-95e978b6459c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:44.304523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8feb3-214f-44aa-a717-95e978b6459c admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:44.305271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8feb3-214f-44aa-a717-95e978b6459c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:44.306906 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8feb3-214f-44aa-a717-95e978b6459c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:44.317998 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1373/2746] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:44.322212 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233611c5-b787-4cf7-9aa5-9f079e6adf73 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:44.335011 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233611c5-b787-4cf7-9aa5-9f079e6adf73 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:44.340771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b2b4a-6e57-4b86-91d2-8ac62f6cf8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:44.341665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b2b4a-6e57-4b86-91d2-8ac62f6cf8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:44.341972 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b2b4a-6e57-4b86-91d2-8ac62f6cf8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:44.342248 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b2b4a-6e57-4b86-91d2-8ac62f6cf8b3 admin admin] PATH_INFO: `/v3/projects/10263a3a14604883b9ccdc3e5dacfff8/users/1cb2998a47b5424d83d061d4e8161fb7/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:44.359208 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b2b4a-6e57-4b86-91d2-8ac62f6cf8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10263a3a14604883b9ccdc3e5dacfff8, user_id=1cb2998a47b5424d83d061d4e8161fb7, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:44.362627 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b2b4a-6e57-4b86-91d2-8ac62f6cf8b3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:44.389148 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1374/2747] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:15:44 2022] PUT /identity/v3/projects/10263a3a14604883b9ccdc3e5dacfff8/users/1cb2998a47b5424d83d061d4e8161fb7/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:44.396677 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5dec6-0634-4ef8-9623-d87c718bd56b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:44.396922 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5dec6-0634-4ef8-9623-d87c718bd56b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:44.397210 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5dec6-0634-4ef8-9623-d87c718bd56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:44.423965 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-12d5dec6-0634-4ef8-9623-d87c718bd56b None None] MFA Rules not processed for user `1cb2998a47b5424d83d061d4e8161fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:44.425179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-12d5dec6-0634-4ef8-9623-d87c718bd56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:44.492312 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1374/2748] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:44.496815 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b2b4a-6e57-4b86-91d2-8ac62f6cf8b3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:44.558958 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b2b4a-6e57-4b86-91d2-8ac62f6cf8b3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:44.563653 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046b71f-4dfa-4590-ac15-81eb3e35fa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:44.564343 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046b71f-4dfa-4590-ac15-81eb3e35fa44 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:44.565536 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046b71f-4dfa-4590-ac15-81eb3e35fa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:44.565536 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046b71f-4dfa-4590-ac15-81eb3e35fa44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:44.566127 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046b71f-4dfa-4590-ac15-81eb3e35fa44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:44.568068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046b71f-4dfa-4590-ac15-81eb3e35fa44 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:44.577726 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:44.597008 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1375/2749] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:15:44 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:44.601326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5dec6-0634-4ef8-9623-d87c718bd56b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:44.612045 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5dec6-0634-4ef8-9623-d87c718bd56b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:44.637551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:44.668909 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c7047-6c91-4e9e-8190-ba12941be1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:44.669616 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c7047-6c91-4e9e-8190-ba12941be1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:44.669904 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c7047-6c91-4e9e-8190-ba12941be1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:44.670196 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c7047-6c91-4e9e-8190-ba12941be1d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:44.670864 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c7047-6c91-4e9e-8190-ba12941be1d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:44.672885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c7047-6c91-4e9e-8190-ba12941be1d8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:44.693771 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1375/2750] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:15:44 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:44.697800 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046b71f-4dfa-4590-ac15-81eb3e35fa44 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:44.708976 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046b71f-4dfa-4590-ac15-81eb3e35fa44 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:44.713622 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52926da6-5b55-41b8-9ff8-96ecf6c67cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:44.714276 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52926da6-5b55-41b8-9ff8-96ecf6c67cab admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:44.714556 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52926da6-5b55-41b8-9ff8-96ecf6c67cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:44.714830 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52926da6-5b55-41b8-9ff8-96ecf6c67cab admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:44.715558 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52926da6-5b55-41b8-9ff8-96ecf6c67cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:44.717176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52926da6-5b55-41b8-9ff8-96ecf6c67cab admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:44.727978 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1376/2751] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:44.732076 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c7047-6c91-4e9e-8190-ba12941be1d8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:44.742934 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c7047-6c91-4e9e-8190-ba12941be1d8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:44.747494 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de7f43-e78d-479e-9147-c566d681a6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:44.748440 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de7f43-e78d-479e-9147-c566d681a6e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:44.748754 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de7f43-e78d-479e-9147-c566d681a6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:44.749033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de7f43-e78d-479e-9147-c566d681a6e1 admin admin] PATH_INFO: `/v3/projects/e2480a54f6f5432a8cc6f64cf4187f11/users/1b92cf3022914bdba07dd261b12f8708/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:44.764395 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de7f43-e78d-479e-9147-c566d681a6e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2480a54f6f5432a8cc6f64cf4187f11, user_id=1b92cf3022914bdba07dd261b12f8708, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:44.767069 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de7f43-e78d-479e-9147-c566d681a6e1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:44.782934 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1376/2752] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:15:44 2022] PUT /identity/v3/projects/e2480a54f6f5432a8cc6f64cf4187f11/users/1b92cf3022914bdba07dd261b12f8708/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:44.787754 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52926da6-5b55-41b8-9ff8-96ecf6c67cab admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:44.798071 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52926da6-5b55-41b8-9ff8-96ecf6c67cab admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:44.854469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1ba75-5296-4a5d-a86b-0b2f896063d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:44.855130 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1ba75-5296-4a5d-a86b-0b2f896063d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:44.855418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1ba75-5296-4a5d-a86b-0b2f896063d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:44.855699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1ba75-5296-4a5d-a86b-0b2f896063d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:44.856530 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1ba75-5296-4a5d-a86b-0b2f896063d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:44.858127 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1ba75-5296-4a5d-a86b-0b2f896063d9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:44.867935 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1377/2753] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:44.872088 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de7f43-e78d-479e-9147-c566d681a6e1 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:44.883451 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de7f43-e78d-479e-9147-c566d681a6e1 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:44.888112 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cc271-7b79-4ab0-9409-b76aa9ea112e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:44.888994 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cc271-7b79-4ab0-9409-b76aa9ea112e admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:44.889279 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cc271-7b79-4ab0-9409-b76aa9ea112e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:44.889557 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cc271-7b79-4ab0-9409-b76aa9ea112e admin admin] PATH_INFO: `/v3/projects/e2480a54f6f5432a8cc6f64cf4187f11/users/1b92cf3022914bdba07dd261b12f8708/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:44.891535 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cc271-7b79-4ab0-9409-b76aa9ea112e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2480a54f6f5432a8cc6f64cf4187f11, user_id=1b92cf3022914bdba07dd261b12f8708, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:44.894936 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cc271-7b79-4ab0-9409-b76aa9ea112e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:44.905144 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1377/2754] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:15:44 2022] PUT /identity/v3/projects/e2480a54f6f5432a8cc6f64cf4187f11/users/1b92cf3022914bdba07dd261b12f8708/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:44.915323 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae569fe5-4f8e-4fbb-9426-e9ee5b1eef87 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:44.915614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae569fe5-4f8e-4fbb-9426-e9ee5b1eef87 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:44.915950 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae569fe5-4f8e-4fbb-9426-e9ee5b1eef87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:44.943227 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ae569fe5-4f8e-4fbb-9426-e9ee5b1eef87 None None] MFA Rules not processed for user `1b92cf3022914bdba07dd261b12f8708`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:44.944467 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ae569fe5-4f8e-4fbb-9426-e9ee5b1eef87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:45.011418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1378/2755] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:45.022950 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cc271-7b79-4ab0-9409-b76aa9ea112e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:45.024654 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-606cc271-7b79-4ab0-9409-b76aa9ea112e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:45.083747 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cc271-7b79-4ab0-9409-b76aa9ea112e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:45.087648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890711bc-dc0d-4092-8af1-20249e667312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:45.088325 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890711bc-dc0d-4092-8af1-20249e667312 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:45.088607 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890711bc-dc0d-4092-8af1-20249e667312 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:45.088883 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890711bc-dc0d-4092-8af1-20249e667312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:45.098196 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890711bc-dc0d-4092-8af1-20249e667312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:45.099622 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890711bc-dc0d-4092-8af1-20249e667312 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:45.109082 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1378/2756] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:45.186109 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae569fe5-4f8e-4fbb-9426-e9ee5b1eef87 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:45.196719 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae569fe5-4f8e-4fbb-9426-e9ee5b1eef87 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:45.200381 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908f840-6b53-4249-b944-b7333e12da78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:45.201020 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908f840-6b53-4249-b944-b7333e12da78 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:45.201307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908f840-6b53-4249-b944-b7333e12da78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:45.201613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908f840-6b53-4249-b944-b7333e12da78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:45.257411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908f840-6b53-4249-b944-b7333e12da78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:45.258842 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908f840-6b53-4249-b944-b7333e12da78 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:45.263466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:45.268676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1379/2757] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:45.534609 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890711bc-dc0d-4092-8af1-20249e667312 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:45.600592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890711bc-dc0d-4092-8af1-20249e667312 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:45.605138 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e854eb-d15a-4863-9260-f9565f2c5cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:45.606005 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e854eb-d15a-4863-9260-f9565f2c5cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:45.606295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e854eb-d15a-4863-9260-f9565f2c5cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:45.606576 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e854eb-d15a-4863-9260-f9565f2c5cf1 admin admin] PATH_INFO: `/v3/users/1cb2998a47b5424d83d061d4e8161fb7` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:45.607773 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e854eb-d15a-4863-9260-f9565f2c5cf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cb2998a47b5424d83d061d4e8161fb7)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:45.609738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e854eb-d15a-4863-9260-f9565f2c5cf1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:45.637627 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:45.657432 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d8e854eb-d15a-4863-9260-f9565f2c5cf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cb2998a47b5424d83d061d4e8161fb7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:45.664641 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d8e854eb-d15a-4863-9260-f9565f2c5cf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cb2998a47b5424d83d061d4e8161fb7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:45.677686 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d8e854eb-d15a-4863-9260-f9565f2c5cf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cb2998a47b5424d83d061d4e8161fb7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:45.678344 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d8e854eb-d15a-4863-9260-f9565f2c5cf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cb2998a47b5424d83d061d4e8161fb7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:45.678953 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d8e854eb-d15a-4863-9260-f9565f2c5cf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cb2998a47b5424d83d061d4e8161fb7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:45.691232 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1379/2758] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:15:45 2022] DELETE /identity/v3/users/1cb2998a47b5424d83d061d4e8161fb7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:45.695688 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f669d3a-056d-4355-a240-5a1a5e311396 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:45.696035 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f669d3a-056d-4355-a240-5a1a5e311396 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:45.696381 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f669d3a-056d-4355-a240-5a1a5e311396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:45.713765 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1f669d3a-056d-4355-a240-5a1a5e311396 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:45.714963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1f669d3a-056d-4355-a240-5a1a5e311396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:45.775751 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1380/2759] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:45.785112 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e854eb-d15a-4863-9260-f9565f2c5cf1 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:45.786556 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d8e854eb-d15a-4863-9260-f9565f2c5cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:45.843568 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e854eb-d15a-4863-9260-f9565f2c5cf1 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:45.847981 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83b344-1ead-4355-b13b-8cdceacec5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:45.848648 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83b344-1ead-4355-b13b-8cdceacec5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:45.848934 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83b344-1ead-4355-b13b-8cdceacec5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:45.849216 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83b344-1ead-4355-b13b-8cdceacec5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:45.858571 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83b344-1ead-4355-b13b-8cdceacec5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:45.860046 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83b344-1ead-4355-b13b-8cdceacec5f9 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:45.869433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1380/2760] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:15:46.136039 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f669d3a-056d-4355-a240-5a1a5e311396 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:46.137571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1f669d3a-056d-4355-a240-5a1a5e311396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:46.150205 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f669d3a-056d-4355-a240-5a1a5e311396 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:46.154833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818e03d-f646-494d-90fa-02b7f0bc8683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:46.155792 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818e03d-f646-494d-90fa-02b7f0bc8683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:46.156109 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818e03d-f646-494d-90fa-02b7f0bc8683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:46.156391 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818e03d-f646-494d-90fa-02b7f0bc8683 admin admin] PATH_INFO: `/v3/projects/10263a3a14604883b9ccdc3e5dacfff8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:46.157587 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818e03d-f646-494d-90fa-02b7f0bc8683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10263a3a14604883b9ccdc3e5dacfff8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:46.159747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818e03d-f646-494d-90fa-02b7f0bc8683 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:46.208294 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9818e03d-f646-494d-90fa-02b7f0bc8683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10263a3a14604883b9ccdc3e5dacfff8', 'request_id': 'req-9818e03d-f646-494d-90fa-02b7f0bc8683'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:46.214285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9818e03d-f646-494d-90fa-02b7f0bc8683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10263a3a14604883b9ccdc3e5dacfff8', 'request_id': 'req-9818e03d-f646-494d-90fa-02b7f0bc8683'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:46.222229 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9818e03d-f646-494d-90fa-02b7f0bc8683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10263a3a14604883b9ccdc3e5dacfff8', 'request_id': 'req-9818e03d-f646-494d-90fa-02b7f0bc8683'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:46.232829 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9818e03d-f646-494d-90fa-02b7f0bc8683 admin admin] The token cache is being invalidate because project 10263a3a14604883b9ccdc3e5dacfff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:46.233119 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9818e03d-f646-494d-90fa-02b7f0bc8683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:46.233747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9818e03d-f646-494d-90fa-02b7f0bc8683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:46.235315 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1381/2761] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:15:46 2022] DELETE /identity/v3/projects/10263a3a14604883b9ccdc3e5dacfff8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:46.239885 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83b344-1ead-4355-b13b-8cdceacec5f9 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:46.249448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83b344-1ead-4355-b13b-8cdceacec5f9 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:46.305359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b683ae8-391d-4d19-b678-a44b0db597d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:46.306229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b683ae8-391d-4d19-b678-a44b0db597d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:46.306516 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b683ae8-391d-4d19-b678-a44b0db597d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:46.306794 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b683ae8-391d-4d19-b678-a44b0db597d3 admin admin] PATH_INFO: `/v3/users/1b92cf3022914bdba07dd261b12f8708` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:46.308017 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b683ae8-391d-4d19-b678-a44b0db597d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b92cf3022914bdba07dd261b12f8708)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:46.309962 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b683ae8-391d-4d19-b678-a44b0db597d3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:46.354326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4b683ae8-391d-4d19-b678-a44b0db597d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b92cf3022914bdba07dd261b12f8708'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:46.355917 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:46.363103 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4b683ae8-391d-4d19-b678-a44b0db597d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b92cf3022914bdba07dd261b12f8708'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:46.376154 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4b683ae8-391d-4d19-b678-a44b0db597d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b92cf3022914bdba07dd261b12f8708'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:46.376791 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4b683ae8-391d-4d19-b678-a44b0db597d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b92cf3022914bdba07dd261b12f8708'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:46.378455 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4b683ae8-391d-4d19-b678-a44b0db597d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b92cf3022914bdba07dd261b12f8708'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:46.390679 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1381/2762] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:15:46 2022] DELETE /identity/v3/users/1b92cf3022914bdba07dd261b12f8708 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:46.750413 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818e03d-f646-494d-90fa-02b7f0bc8683 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:46.753123 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9818e03d-f646-494d-90fa-02b7f0bc8683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:46.775346 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818e03d-f646-494d-90fa-02b7f0bc8683 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:46.838362 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91711bd-2cc1-4ee0-b8bd-58a9aad0ce5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:46.839225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91711bd-2cc1-4ee0-b8bd-58a9aad0ce5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:46.839505 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91711bd-2cc1-4ee0-b8bd-58a9aad0ce5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:46.839779 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91711bd-2cc1-4ee0-b8bd-58a9aad0ce5e admin admin] PATH_INFO: `/v3/projects/e2480a54f6f5432a8cc6f64cf4187f11` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:46.841028 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91711bd-2cc1-4ee0-b8bd-58a9aad0ce5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2480a54f6f5432a8cc6f64cf4187f11)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:46.843054 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91711bd-2cc1-4ee0-b8bd-58a9aad0ce5e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:46.875475 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:46.896899 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a91711bd-2cc1-4ee0-b8bd-58a9aad0ce5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2480a54f6f5432a8cc6f64cf4187f11', 'request_id': 'req-a91711bd-2cc1-4ee0-b8bd-58a9aad0ce5e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:46.903326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a91711bd-2cc1-4ee0-b8bd-58a9aad0ce5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2480a54f6f5432a8cc6f64cf4187f11', 'request_id': 'req-a91711bd-2cc1-4ee0-b8bd-58a9aad0ce5e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:46.912480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a91711bd-2cc1-4ee0-b8bd-58a9aad0ce5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2480a54f6f5432a8cc6f64cf4187f11', 'request_id': 'req-a91711bd-2cc1-4ee0-b8bd-58a9aad0ce5e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:46.924128 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a91711bd-2cc1-4ee0-b8bd-58a9aad0ce5e admin admin] The token cache is being invalidate because project e2480a54f6f5432a8cc6f64cf4187f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:46.924935 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a91711bd-2cc1-4ee0-b8bd-58a9aad0ce5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:46.925721 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a91711bd-2cc1-4ee0-b8bd-58a9aad0ce5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:46.927398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1382/2763] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:15:46 2022] DELETE /identity/v3/projects/e2480a54f6f5432a8cc6f64cf4187f11 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:46.932549 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f816034-77ff-4807-a783-335021621859 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:46.933028 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f816034-77ff-4807-a783-335021621859 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:46.933264 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f816034-77ff-4807-a783-335021621859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:46.952221 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1f816034-77ff-4807-a783-335021621859 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:46.953469 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1f816034-77ff-4807-a783-335021621859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:47.019089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1382/2764] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:15:47.027234 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe73f8b-f8d6-4bd6-b9ea-f7194fbcd49f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:47.027524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe73f8b-f8d6-4bd6-b9ea-f7194fbcd49f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:47.027807 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe73f8b-f8d6-4bd6-b9ea-f7194fbcd49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:47.046531 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ffe73f8b-f8d6-4bd6-b9ea-f7194fbcd49f None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:47.047745 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ffe73f8b-f8d6-4bd6-b9ea-f7194fbcd49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:47.056136 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1383/2765] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:47.060585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f816034-77ff-4807-a783-335021621859 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:47.071284 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f816034-77ff-4807-a783-335021621859 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:47.075953 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83c8cd-b0eb-4d6d-a544-7fe1d4195f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:47.076638 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83c8cd-b0eb-4d6d-a544-7fe1d4195f9d admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:47.076927 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83c8cd-b0eb-4d6d-a544-7fe1d4195f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:47.077209 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83c8cd-b0eb-4d6d-a544-7fe1d4195f9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:47.077957 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83c8cd-b0eb-4d6d-a544-7fe1d4195f9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:47.078269 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83c8cd-b0eb-4d6d-a544-7fe1d4195f9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:47.080980 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83c8cd-b0eb-4d6d-a544-7fe1d4195f9d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:47.094194 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1383/2766] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:47.105998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe73f8b-f8d6-4bd6-b9ea-f7194fbcd49f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:47.128678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe73f8b-f8d6-4bd6-b9ea-f7194fbcd49f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:47.133614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb62f96-1148-4508-82e4-73aff5e88646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:47.134401 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb62f96-1148-4508-82e4-73aff5e88646 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:47.134746 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb62f96-1148-4508-82e4-73aff5e88646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:47.135088 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb62f96-1148-4508-82e4-73aff5e88646 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:47.137194 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb62f96-1148-4508-82e4-73aff5e88646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:47.138991 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb62f96-1148-4508-82e4-73aff5e88646 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:47.171852 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1384/2767] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:15:47 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:47.173579 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83c8cd-b0eb-4d6d-a544-7fe1d4195f9d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:47.184728 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83c8cd-b0eb-4d6d-a544-7fe1d4195f9d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:47.249441 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca422c1-58ed-447a-884a-8e74c986953a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:47.250121 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca422c1-58ed-447a-884a-8e74c986953a admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:47.250409 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca422c1-58ed-447a-884a-8e74c986953a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:47.250693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca422c1-58ed-447a-884a-8e74c986953a admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:47.251427 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca422c1-58ed-447a-884a-8e74c986953a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:47.254023 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca422c1-58ed-447a-884a-8e74c986953a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:47.277360 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1384/2768] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:15:47 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:47.281176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb62f96-1148-4508-82e4-73aff5e88646 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:47.297752 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb62f96-1148-4508-82e4-73aff5e88646 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:47.306474 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d2392-ccb9-4401-a316-594ae212cd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:47.307378 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d2392-ccb9-4401-a316-594ae212cd09 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:47.307672 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d2392-ccb9-4401-a316-594ae212cd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:47.307982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d2392-ccb9-4401-a316-594ae212cd09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:47.308866 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d2392-ccb9-4401-a316-594ae212cd09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:47.310682 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d2392-ccb9-4401-a316-594ae212cd09 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:47.327600 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1385/2769] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:47.329354 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca422c1-58ed-447a-884a-8e74c986953a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:47.340437 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca422c1-58ed-447a-884a-8e74c986953a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:47.345722 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61168d5a-8729-4924-b7b5-6b17d711b70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:47.346415 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61168d5a-8729-4924-b7b5-6b17d711b70a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:47.346807 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61168d5a-8729-4924-b7b5-6b17d711b70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:47.347227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61168d5a-8729-4924-b7b5-6b17d711b70a admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:47.348120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61168d5a-8729-4924-b7b5-6b17d711b70a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:47.350093 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61168d5a-8729-4924-b7b5-6b17d711b70a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:47.362707 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1385/2770] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:47.368934 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d2392-ccb9-4401-a316-594ae212cd09 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:47.383022 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d2392-ccb9-4401-a316-594ae212cd09 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:47.388359 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35f164-8d84-4f62-a6f4-ca42b18b9d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:47.389253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35f164-8d84-4f62-a6f4-ca42b18b9d93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:47.389534 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35f164-8d84-4f62-a6f4-ca42b18b9d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:47.389812 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35f164-8d84-4f62-a6f4-ca42b18b9d93 admin admin] PATH_INFO: `/v3/projects/dae4bb76b7c24f9581fa22c046e9a0e3/users/171a2e972ca94830a404023ff09896a9/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:47.407127 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35f164-8d84-4f62-a6f4-ca42b18b9d93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae4bb76b7c24f9581fa22c046e9a0e3, user_id=171a2e972ca94830a404023ff09896a9, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:47.410011 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35f164-8d84-4f62-a6f4-ca42b18b9d93 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:47.422782 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1386/2771] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:15:47 2022] PUT /identity/v3/projects/dae4bb76b7c24f9581fa22c046e9a0e3/users/171a2e972ca94830a404023ff09896a9/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:47.434693 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34482b3-1606-4f97-b346-84da00aac1d7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:47.435019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34482b3-1606-4f97-b346-84da00aac1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:47.435307 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34482b3-1606-4f97-b346-84da00aac1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:47.464254 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c34482b3-1606-4f97-b346-84da00aac1d7 None None] MFA Rules not processed for user `171a2e972ca94830a404023ff09896a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:47.465523 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c34482b3-1606-4f97-b346-84da00aac1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:47.488511 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:47.554788 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1386/2772] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:47.572333 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35f164-8d84-4f62-a6f4-ca42b18b9d93 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:47.574183 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9c35f164-8d84-4f62-a6f4-ca42b18b9d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:47.648061 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35f164-8d84-4f62-a6f4-ca42b18b9d93 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:47.652441 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18204ca-a1ec-4c27-ad95-c8af28623022 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ffa6d38c01f4820a705c06991654bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:47.653094 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18204ca-a1ec-4c27-ad95-c8af28623022 service glance] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:47.653383 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18204ca-a1ec-4c27-ad95-c8af28623022 service glance] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:47.653665 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18204ca-a1ec-4c27-ad95-c8af28623022 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:47.663097 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18204ca-a1ec-4c27-ad95-c8af28623022 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:47.664670 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18204ca-a1ec-4c27-ad95-c8af28623022 service glance] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:47.675193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1387/2773] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:50.466147 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34482b3-1606-4f97-b346-84da00aac1d7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:50.467720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c34482b3-1606-4f97-b346-84da00aac1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:50.527254 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34482b3-1606-4f97-b346-84da00aac1d7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:50.531614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8e035-1cbb-40d5-b965-38edfed3dfcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:50.532328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8e035-1cbb-40d5-b965-38edfed3dfcb service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:50.532591 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8e035-1cbb-40d5-b965-38edfed3dfcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:50.533113 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8e035-1cbb-40d5-b965-38edfed3dfcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:50.535711 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-caa8e035-1cbb-40d5-b965-38edfed3dfcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:50.602294 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa8e035-1cbb-40d5-b965-38edfed3dfcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:50.603751 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa8e035-1cbb-40d5-b965-38edfed3dfcb service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:50.614754 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1387/2774] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:52.157802 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18204ca-a1ec-4c27-ad95-c8af28623022 service glance] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:52.159239 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d18204ca-a1ec-4c27-ad95-c8af28623022 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:52.219115 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:52.235124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18204ca-a1ec-4c27-ad95-c8af28623022 service glance] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:52.241601 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb0f82-1028-4c0f-a552-a1e932f74cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:52.242760 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb0f82-1028-4c0f-a552-a1e932f74cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:52.243154 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb0f82-1028-4c0f-a552-a1e932f74cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:52.243894 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb0f82-1028-4c0f-a552-a1e932f74cec admin admin] PATH_INFO: `/v3/users/ad8ee089616143c3bca918146c19d96d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:52.245565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb0f82-1028-4c0f-a552-a1e932f74cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad8ee089616143c3bca918146c19d96d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:52.247737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb0f82-1028-4c0f-a552-a1e932f74cec admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:52.314745 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1acb0f82-1028-4c0f-a552-a1e932f74cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad8ee089616143c3bca918146c19d96d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:52.327345 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1acb0f82-1028-4c0f-a552-a1e932f74cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad8ee089616143c3bca918146c19d96d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:52.345647 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1acb0f82-1028-4c0f-a552-a1e932f74cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad8ee089616143c3bca918146c19d96d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:52.346829 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1acb0f82-1028-4c0f-a552-a1e932f74cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad8ee089616143c3bca918146c19d96d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:52.366903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1acb0f82-1028-4c0f-a552-a1e932f74cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad8ee089616143c3bca918146c19d96d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:52.373136 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1388/2775] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:15:52 2022] DELETE /identity/v3/users/ad8ee089616143c3bca918146c19d96d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:52.377536 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41aca2-781d-431a-a8bb-b0e0fdd8e6dc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:52.378025 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41aca2-781d-431a-a8bb-b0e0fdd8e6dc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:52.378240 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41aca2-781d-431a-a8bb-b0e0fdd8e6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:52.398428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ce41aca2-781d-431a-a8bb-b0e0fdd8e6dc None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:52.399657 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ce41aca2-781d-431a-a8bb-b0e0fdd8e6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:52.474134 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1388/2776] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:15:52.484279 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb0f82-1028-4c0f-a552-a1e932f74cec admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:52.485708 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1acb0f82-1028-4c0f-a552-a1e932f74cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:52.554594 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb0f82-1028-4c0f-a552-a1e932f74cec admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:52.559196 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cd4e3-5cbf-4fc9-b08d-631dcd0bcbfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:52.559868 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cd4e3-5cbf-4fc9-b08d-631dcd0bcbfb service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:52.560158 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cd4e3-5cbf-4fc9-b08d-631dcd0bcbfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:52.560432 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cd4e3-5cbf-4fc9-b08d-631dcd0bcbfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:52.578021 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cd4e3-5cbf-4fc9-b08d-631dcd0bcbfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:52.579472 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cd4e3-5cbf-4fc9-b08d-631dcd0bcbfb service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:52.590239 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1389/2777] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:52.916792 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41aca2-781d-431a-a8bb-b0e0fdd8e6dc None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:52.918826 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ce41aca2-781d-431a-a8bb-b0e0fdd8e6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:52.933856 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41aca2-781d-431a-a8bb-b0e0fdd8e6dc None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:52.939748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb0c33-39e0-48ba-91b1-3f4c738e2873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:52.940816 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb0c33-39e0-48ba-91b1-3f4c738e2873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:52.941180 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb0c33-39e0-48ba-91b1-3f4c738e2873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:52.941533 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb0c33-39e0-48ba-91b1-3f4c738e2873 admin admin] PATH_INFO: `/v3/projects/d448151b201a482e8b902ebcd914e5b4` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:52.942914 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb0c33-39e0-48ba-91b1-3f4c738e2873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d448151b201a482e8b902ebcd914e5b4)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:52.945109 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb0c33-39e0-48ba-91b1-3f4c738e2873 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:52.953474 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:53.010596 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-fefb0c33-39e0-48ba-91b1-3f4c738e2873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd448151b201a482e8b902ebcd914e5b4', 'request_id': 'req-fefb0c33-39e0-48ba-91b1-3f4c738e2873'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:53.022587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-fefb0c33-39e0-48ba-91b1-3f4c738e2873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd448151b201a482e8b902ebcd914e5b4', 'request_id': 'req-fefb0c33-39e0-48ba-91b1-3f4c738e2873'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:53.029225 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-fefb0c33-39e0-48ba-91b1-3f4c738e2873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd448151b201a482e8b902ebcd914e5b4', 'request_id': 'req-fefb0c33-39e0-48ba-91b1-3f4c738e2873'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:53.040326 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-fefb0c33-39e0-48ba-91b1-3f4c738e2873 admin admin] The token cache is being invalidate because project d448151b201a482e8b902ebcd914e5b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:53.040640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-fefb0c33-39e0-48ba-91b1-3f4c738e2873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:53.041875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-fefb0c33-39e0-48ba-91b1-3f4c738e2873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:53.043460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1389/2778] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:15:52 2022] DELETE /identity/v3/projects/d448151b201a482e8b902ebcd914e5b4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:53.048955 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac49c3-c18e-4f53-8d84-4be54d0fabb7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:53.049477 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac49c3-c18e-4f53-8d84-4be54d0fabb7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:53.049770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac49c3-c18e-4f53-8d84-4be54d0fabb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:53.068591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a7ac49c3-c18e-4f53-8d84-4be54d0fabb7 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:53.069717 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a7ac49c3-c18e-4f53-8d84-4be54d0fabb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:53.135686 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1390/2779] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:15:53.145974 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593ec21-b5f9-4417-ad31-c51879a7d5d9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:53.146269 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593ec21-b5f9-4417-ad31-c51879a7d5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:53.146548 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593ec21-b5f9-4417-ad31-c51879a7d5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:53.165607 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6593ec21-b5f9-4417-ad31-c51879a7d5d9 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:53.166935 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6593ec21-b5f9-4417-ad31-c51879a7d5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:53.175563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1390/2780] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:53.180816 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac49c3-c18e-4f53-8d84-4be54d0fabb7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:53.190783 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac49c3-c18e-4f53-8d84-4be54d0fabb7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:53.196165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c582d2-4446-4cff-8f4e-1e111886557f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:53.196844 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c582d2-4446-4cff-8f4e-1e111886557f admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:53.197136 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c582d2-4446-4cff-8f4e-1e111886557f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:53.197418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c582d2-4446-4cff-8f4e-1e111886557f admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:53.198154 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c582d2-4446-4cff-8f4e-1e111886557f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:53.198467 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c582d2-4446-4cff-8f4e-1e111886557f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:53.200086 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c582d2-4446-4cff-8f4e-1e111886557f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:53.212872 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1391/2781] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:53.217238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593ec21-b5f9-4417-ad31-c51879a7d5d9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:53.227548 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593ec21-b5f9-4417-ad31-c51879a7d5d9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:53.232283 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252915da-09f5-4d1e-8871-580b5fa9412c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:53.232968 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252915da-09f5-4d1e-8871-580b5fa9412c admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:53.233254 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252915da-09f5-4d1e-8871-580b5fa9412c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:53.233534 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252915da-09f5-4d1e-8871-580b5fa9412c admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:53.234394 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252915da-09f5-4d1e-8871-580b5fa9412c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:53.236346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252915da-09f5-4d1e-8871-580b5fa9412c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:53.265268 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1391/2782] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:15:53 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:53.269446 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c582d2-4446-4cff-8f4e-1e111886557f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:53.274700 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:53.281592 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c582d2-4446-4cff-8f4e-1e111886557f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:53.346722 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbc2c1-2fef-4572-9477-a959fb0c8b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:53.347445 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbc2c1-2fef-4572-9477-a959fb0c8b45 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:53.347799 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbc2c1-2fef-4572-9477-a959fb0c8b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:53.348202 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbc2c1-2fef-4572-9477-a959fb0c8b45 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:53.349178 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbc2c1-2fef-4572-9477-a959fb0c8b45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:53.351416 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbc2c1-2fef-4572-9477-a959fb0c8b45 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:53.376377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1392/2783] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:15:53 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:53.381255 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252915da-09f5-4d1e-8871-580b5fa9412c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:53.392126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252915da-09f5-4d1e-8871-580b5fa9412c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:53.398809 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20a368-357f-44a4-bc79-c5e34514317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:53.399484 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20a368-357f-44a4-bc79-c5e34514317b admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:53.399769 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20a368-357f-44a4-bc79-c5e34514317b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:53.400140 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20a368-357f-44a4-bc79-c5e34514317b admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:53.400875 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20a368-357f-44a4-bc79-c5e34514317b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:53.402512 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20a368-357f-44a4-bc79-c5e34514317b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:53.422638 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1392/2784] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:15:53.427178 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbc2c1-2fef-4572-9477-a959fb0c8b45 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:53.438164 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbc2c1-2fef-4572-9477-a959fb0c8b45 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:53.443015 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b23b6-f839-4786-a6df-9613d13df34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:53.443681 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b23b6-f839-4786-a6df-9613d13df34c admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:53.444006 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b23b6-f839-4786-a6df-9613d13df34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:53.444287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b23b6-f839-4786-a6df-9613d13df34c admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:53.445057 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b23b6-f839-4786-a6df-9613d13df34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:53.446647 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b23b6-f839-4786-a6df-9613d13df34c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:53.460173 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1393/2785] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:53.463677 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20a368-357f-44a4-bc79-c5e34514317b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:53.475492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20a368-357f-44a4-bc79-c5e34514317b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:53.480343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d772e-8a3b-4f82-8106-aeb28408c88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:53.481267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d772e-8a3b-4f82-8106-aeb28408c88d admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:53.481552 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d772e-8a3b-4f82-8106-aeb28408c88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:53.481821 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d772e-8a3b-4f82-8106-aeb28408c88d admin admin] PATH_INFO: `/v3/projects/9e83e2b961bc410b821ff1902a353f04/users/93bd85236d944f868336a463d9e11c8a/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:53.501642 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d772e-8a3b-4f82-8106-aeb28408c88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e83e2b961bc410b821ff1902a353f04, user_id=93bd85236d944f868336a463d9e11c8a, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:53.504303 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d772e-8a3b-4f82-8106-aeb28408c88d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:53.517726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1393/2786] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:15:53 2022] PUT /identity/v3/projects/9e83e2b961bc410b821ff1902a353f04/users/93bd85236d944f868336a463d9e11c8a/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:53.528786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5143e-b5f7-44f1-a5eb-0cc5d21f2cbe None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:53.529075 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5143e-b5f7-44f1-a5eb-0cc5d21f2cbe None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:53.529381 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5143e-b5f7-44f1-a5eb-0cc5d21f2cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:53.557956 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d5f5143e-b5f7-44f1-a5eb-0cc5d21f2cbe None None] MFA Rules not processed for user `93bd85236d944f868336a463d9e11c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:53.559176 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d5f5143e-b5f7-44f1-a5eb-0cc5d21f2cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:53.628255 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1394/2787] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:15:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:53.640191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d772e-8a3b-4f82-8106-aeb28408c88d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:53.642139 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-449d772e-8a3b-4f82-8106-aeb28408c88d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:53.701762 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d772e-8a3b-4f82-8106-aeb28408c88d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:53.706075 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae00330-6ab7-4f9e-967f-dabad5a80c21 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ffa6d38c01f4820a705c06991654bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:53.706734 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae00330-6ab7-4f9e-967f-dabad5a80c21 service glance] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:53.707027 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae00330-6ab7-4f9e-967f-dabad5a80c21 service glance] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:53.707304 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae00330-6ab7-4f9e-967f-dabad5a80c21 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:53.716922 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae00330-6ab7-4f9e-967f-dabad5a80c21 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:53.718348 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae00330-6ab7-4f9e-967f-dabad5a80c21 service glance] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:53.727760 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1394/2788] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:15:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:03.625172 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:03.723120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:09.499861 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5143e-b5f7-44f1-a5eb-0cc5d21f2cbe None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:09.501692 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d5f5143e-b5f7-44f1-a5eb-0cc5d21f2cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:09.598540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5143e-b5f7-44f1-a5eb-0cc5d21f2cbe None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:09.603927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c615bc-2691-44be-964d-ac402cc07f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:09.604807 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c615bc-2691-44be-964d-ac402cc07f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:09.605100 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c615bc-2691-44be-964d-ac402cc07f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:09.605386 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c615bc-2691-44be-964d-ac402cc07f3e admin admin] PATH_INFO: `/v3/users/171a2e972ca94830a404023ff09896a9` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:09.606782 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c615bc-2691-44be-964d-ac402cc07f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=171a2e972ca94830a404023ff09896a9)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:09.608915 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c615bc-2691-44be-964d-ac402cc07f3e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:09.659982 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-61c615bc-2691-44be-964d-ac402cc07f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '171a2e972ca94830a404023ff09896a9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:09.667743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-61c615bc-2691-44be-964d-ac402cc07f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '171a2e972ca94830a404023ff09896a9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:09.680392 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-61c615bc-2691-44be-964d-ac402cc07f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '171a2e972ca94830a404023ff09896a9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:09.681091 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-61c615bc-2691-44be-964d-ac402cc07f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '171a2e972ca94830a404023ff09896a9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:09.688607 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-61c615bc-2691-44be-964d-ac402cc07f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '171a2e972ca94830a404023ff09896a9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:09.694418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1395/2789] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:16:09 2022] DELETE /identity/v3/users/171a2e972ca94830a404023ff09896a9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:09.698942 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b471f8-7a3c-46b0-a621-f08169888f94 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:09.700033 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b471f8-7a3c-46b0-a621-f08169888f94 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:09.700184 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b471f8-7a3c-46b0-a621-f08169888f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:09.717433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e0b471f8-7a3c-46b0-a621-f08169888f94 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:09.718636 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e0b471f8-7a3c-46b0-a621-f08169888f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:09.780846 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1395/2790] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:09.790480 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c615bc-2691-44be-964d-ac402cc07f3e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:09.791928 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-61c615bc-2691-44be-964d-ac402cc07f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:09.851302 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c615bc-2691-44be-964d-ac402cc07f3e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:09.854977 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4785c31-504b-4f9b-9b54-b4df30ba0bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:09.856353 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4785c31-504b-4f9b-9b54-b4df30ba0bea service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:09.856803 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4785c31-504b-4f9b-9b54-b4df30ba0bea service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:09.857089 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4785c31-504b-4f9b-9b54-b4df30ba0bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:09.866563 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4785c31-504b-4f9b-9b54-b4df30ba0bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:09.868033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4785c31-504b-4f9b-9b54-b4df30ba0bea service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:09.878073 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1396/2791] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:10.156707 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b471f8-7a3c-46b0-a621-f08169888f94 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:10.158135 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e0b471f8-7a3c-46b0-a621-f08169888f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:10.170015 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b471f8-7a3c-46b0-a621-f08169888f94 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:10.174672 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2340da-c8aa-4210-8d4c-8b6dd906e194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:10.175545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2340da-c8aa-4210-8d4c-8b6dd906e194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:10.175846 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2340da-c8aa-4210-8d4c-8b6dd906e194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:10.176131 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2340da-c8aa-4210-8d4c-8b6dd906e194 admin admin] PATH_INFO: `/v3/projects/dae4bb76b7c24f9581fa22c046e9a0e3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:10.177353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2340da-c8aa-4210-8d4c-8b6dd906e194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae4bb76b7c24f9581fa22c046e9a0e3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:10.179337 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2340da-c8aa-4210-8d4c-8b6dd906e194 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:10.227379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ec2340da-c8aa-4210-8d4c-8b6dd906e194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae4bb76b7c24f9581fa22c046e9a0e3', 'request_id': 'req-ec2340da-c8aa-4210-8d4c-8b6dd906e194'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:10.234793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ec2340da-c8aa-4210-8d4c-8b6dd906e194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae4bb76b7c24f9581fa22c046e9a0e3', 'request_id': 'req-ec2340da-c8aa-4210-8d4c-8b6dd906e194'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:10.241089 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ec2340da-c8aa-4210-8d4c-8b6dd906e194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae4bb76b7c24f9581fa22c046e9a0e3', 'request_id': 'req-ec2340da-c8aa-4210-8d4c-8b6dd906e194'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:10.252237 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ec2340da-c8aa-4210-8d4c-8b6dd906e194 admin admin] The token cache is being invalidate because project dae4bb76b7c24f9581fa22c046e9a0e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:10.252526 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ec2340da-c8aa-4210-8d4c-8b6dd906e194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:10.253171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ec2340da-c8aa-4210-8d4c-8b6dd906e194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:10.254677 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1396/2792] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:16:10 2022] DELETE /identity/v3/projects/dae4bb76b7c24f9581fa22c046e9a0e3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:10.259534 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2abe1f-fdb3-4238-a2cc-2d5fd63d0a96 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:10.259841 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2abe1f-fdb3-4238-a2cc-2d5fd63d0a96 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:10.260124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2abe1f-fdb3-4238-a2cc-2d5fd63d0a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:10.278808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-fd2abe1f-fdb3-4238-a2cc-2d5fd63d0a96 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:10.280053 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-fd2abe1f-fdb3-4238-a2cc-2d5fd63d0a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:10.296616 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:10.340641 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1397/2793] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:10.348173 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0c7fd-5dbd-49d7-94b0-226bfabc47e0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:10.348472 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0c7fd-5dbd-49d7-94b0-226bfabc47e0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:10.348755 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0c7fd-5dbd-49d7-94b0-226bfabc47e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:10.367220 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-61a0c7fd-5dbd-49d7-94b0-226bfabc47e0 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:10.368463 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-61a0c7fd-5dbd-49d7-94b0-226bfabc47e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:10.376945 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1397/2794] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:10.381144 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2abe1f-fdb3-4238-a2cc-2d5fd63d0a96 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:10.391724 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2abe1f-fdb3-4238-a2cc-2d5fd63d0a96 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:10.396328 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a8638-f720-4974-8612-7625fef6cc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:10.396980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a8638-f720-4974-8612-7625fef6cc4a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:10.397266 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a8638-f720-4974-8612-7625fef6cc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:10.397548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a8638-f720-4974-8612-7625fef6cc4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:10.398307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a8638-f720-4974-8612-7625fef6cc4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:16:10.398671 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a8638-f720-4974-8612-7625fef6cc4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:10.400253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a8638-f720-4974-8612-7625fef6cc4a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:10.412185 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1398/2795] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:16:10.416302 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0c7fd-5dbd-49d7-94b0-226bfabc47e0 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:10.426138 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0c7fd-5dbd-49d7-94b0-226bfabc47e0 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:10.430868 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676379fc-8622-4878-99df-ba89f50c9bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:10.431840 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676379fc-8622-4878-99df-ba89f50c9bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:10.432191 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676379fc-8622-4878-99df-ba89f50c9bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:10.432572 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676379fc-8622-4878-99df-ba89f50c9bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:10.434013 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676379fc-8622-4878-99df-ba89f50c9bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:10.436371 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676379fc-8622-4878-99df-ba89f50c9bd5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:10.463085 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1398/2796] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:16:10 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:10.467578 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a8638-f720-4974-8612-7625fef6cc4a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:10.477704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a8638-f720-4974-8612-7625fef6cc4a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:10.533775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb39dbc-090b-4b6a-8609-526330a234f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:10.534430 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb39dbc-090b-4b6a-8609-526330a234f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:10.534709 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb39dbc-090b-4b6a-8609-526330a234f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:10.534986 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb39dbc-090b-4b6a-8609-526330a234f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:10.535676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb39dbc-090b-4b6a-8609-526330a234f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:10.537638 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb39dbc-090b-4b6a-8609-526330a234f4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:10.557282 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1399/2797] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:16:10 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:10.562379 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676379fc-8622-4878-99df-ba89f50c9bd5 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:10.572718 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676379fc-8622-4878-99df-ba89f50c9bd5 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:10.578020 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c060a0f-0fe8-42e2-8950-ec792bb3a767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:10.578670 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c060a0f-0fe8-42e2-8950-ec792bb3a767 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:10.578956 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c060a0f-0fe8-42e2-8950-ec792bb3a767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:10.579251 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c060a0f-0fe8-42e2-8950-ec792bb3a767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:10.579996 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c060a0f-0fe8-42e2-8950-ec792bb3a767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:10.581582 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c060a0f-0fe8-42e2-8950-ec792bb3a767 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:10.592155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1399/2798] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:10.596879 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb39dbc-090b-4b6a-8609-526330a234f4 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:10.608496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb39dbc-090b-4b6a-8609-526330a234f4 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:10.613084 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443f391-9624-4c86-ab01-a07d9804cfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:10.613731 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443f391-9624-4c86-ab01-a07d9804cfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:10.614013 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443f391-9624-4c86-ab01-a07d9804cfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:10.614285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443f391-9624-4c86-ab01-a07d9804cfe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:10.615033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443f391-9624-4c86-ab01-a07d9804cfe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:10.616613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443f391-9624-4c86-ab01-a07d9804cfe4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:10.627334 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1400/2799] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:10.631319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c060a0f-0fe8-42e2-8950-ec792bb3a767 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:10.641163 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c060a0f-0fe8-42e2-8950-ec792bb3a767 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:10.645725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f9bd1-dc66-49d8-b25c-3b28c60ec4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:10.646592 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f9bd1-dc66-49d8-b25c-3b28c60ec4c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:10.646877 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f9bd1-dc66-49d8-b25c-3b28c60ec4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:10.647154 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f9bd1-dc66-49d8-b25c-3b28c60ec4c0 admin admin] PATH_INFO: `/v3/projects/a756a3fe24fd407d8b66bca4994c859c/users/7aa043f160dc461c9ad86567b84aa7e1/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:10.661477 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f9bd1-dc66-49d8-b25c-3b28c60ec4c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a756a3fe24fd407d8b66bca4994c859c, user_id=7aa043f160dc461c9ad86567b84aa7e1, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:10.664084 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f9bd1-dc66-49d8-b25c-3b28c60ec4c0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:10.678210 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1400/2800] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:16:10 2022] PUT /identity/v3/projects/a756a3fe24fd407d8b66bca4994c859c/users/7aa043f160dc461c9ad86567b84aa7e1/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:10.689711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293cbee-ed01-4c19-9697-fb0ab2339cd6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:10.690030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293cbee-ed01-4c19-9697-fb0ab2339cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:10.690402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293cbee-ed01-4c19-9697-fb0ab2339cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:10.718845 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c293cbee-ed01-4c19-9697-fb0ab2339cd6 None None] MFA Rules not processed for user `7aa043f160dc461c9ad86567b84aa7e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:10.720170 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c293cbee-ed01-4c19-9697-fb0ab2339cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:10.791398 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1401/2801] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:10.796769 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f9bd1-dc66-49d8-b25c-3b28c60ec4c0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:10.819153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:10.864743 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f9bd1-dc66-49d8-b25c-3b28c60ec4c0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:10.869497 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bade48-48e3-4a07-8d93-8df0daa02270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:10.870160 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bade48-48e3-4a07-8d93-8df0daa02270 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:10.870443 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bade48-48e3-4a07-8d93-8df0daa02270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:10.870720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bade48-48e3-4a07-8d93-8df0daa02270 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:10.872002 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bade48-48e3-4a07-8d93-8df0daa02270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:10.873987 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bade48-48e3-4a07-8d93-8df0daa02270 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:10.898876 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1401/2802] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:16:10 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:10.903528 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293cbee-ed01-4c19-9697-fb0ab2339cd6 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:10.914186 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293cbee-ed01-4c19-9697-fb0ab2339cd6 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:10.927638 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:10.975711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d50f2-0d6d-4832-99ed-94d343fba77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:10.976422 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d50f2-0d6d-4832-99ed-94d343fba77e admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:10.976712 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d50f2-0d6d-4832-99ed-94d343fba77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:10.976988 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d50f2-0d6d-4832-99ed-94d343fba77e admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:10.977694 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d50f2-0d6d-4832-99ed-94d343fba77e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:10.979584 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d50f2-0d6d-4832-99ed-94d343fba77e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:10.999916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1402/2803] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:16:10 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:11.003903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bade48-48e3-4a07-8d93-8df0daa02270 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:11.014383 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bade48-48e3-4a07-8d93-8df0daa02270 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:11.019078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97328e33-e1ef-4c19-849c-1c873642b59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:11.019747 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97328e33-e1ef-4c19-849c-1c873642b59a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:11.020050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97328e33-e1ef-4c19-849c-1c873642b59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:11.020332 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97328e33-e1ef-4c19-849c-1c873642b59a admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:11.021064 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97328e33-e1ef-4c19-849c-1c873642b59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:11.022656 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97328e33-e1ef-4c19-849c-1c873642b59a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:11.033597 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1402/2804] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:11.037826 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d50f2-0d6d-4832-99ed-94d343fba77e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:11.048307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d50f2-0d6d-4832-99ed-94d343fba77e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:11.052936 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c0f67-0b31-463f-9ec3-87511ac55168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:11.053806 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c0f67-0b31-463f-9ec3-87511ac55168 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:11.054090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c0f67-0b31-463f-9ec3-87511ac55168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:11.054365 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c0f67-0b31-463f-9ec3-87511ac55168 admin admin] PATH_INFO: `/v3/projects/a5f286878e254cb2b73cc0aa26fbd6eb/users/13ee05459bd74d818b22ec34f3404337/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:11.068876 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c0f67-0b31-463f-9ec3-87511ac55168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f286878e254cb2b73cc0aa26fbd6eb, user_id=13ee05459bd74d818b22ec34f3404337, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:11.071491 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c0f67-0b31-463f-9ec3-87511ac55168 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:11.083927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1403/2805] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:16:11 2022] PUT /identity/v3/projects/a5f286878e254cb2b73cc0aa26fbd6eb/users/13ee05459bd74d818b22ec34f3404337/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:11.087703 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97328e33-e1ef-4c19-849c-1c873642b59a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:11.098238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97328e33-e1ef-4c19-849c-1c873642b59a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:11.154858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287366e0-433e-4ef2-a5dc-68a9a04adee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:11.155524 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287366e0-433e-4ef2-a5dc-68a9a04adee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:11.155808 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287366e0-433e-4ef2-a5dc-68a9a04adee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:11.156116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287366e0-433e-4ef2-a5dc-68a9a04adee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:11.156841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287366e0-433e-4ef2-a5dc-68a9a04adee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:11.158429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287366e0-433e-4ef2-a5dc-68a9a04adee5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:11.168581 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1403/2806] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:11.172609 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c0f67-0b31-463f-9ec3-87511ac55168 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:11.182630 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c0f67-0b31-463f-9ec3-87511ac55168 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:11.187394 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe6a1c-9b9d-4d6b-93dc-8edb71138496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:11.188305 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe6a1c-9b9d-4d6b-93dc-8edb71138496 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:11.188594 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe6a1c-9b9d-4d6b-93dc-8edb71138496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:11.188873 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe6a1c-9b9d-4d6b-93dc-8edb71138496 admin admin] PATH_INFO: `/v3/projects/a5f286878e254cb2b73cc0aa26fbd6eb/users/13ee05459bd74d818b22ec34f3404337/roles/8196ef570097443bac15d3cf39878486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:11.190827 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe6a1c-9b9d-4d6b-93dc-8edb71138496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f286878e254cb2b73cc0aa26fbd6eb, user_id=13ee05459bd74d818b22ec34f3404337, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:11.193478 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe6a1c-9b9d-4d6b-93dc-8edb71138496 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:11.203550 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1404/2807] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:16:11 2022] PUT /identity/v3/projects/a5f286878e254cb2b73cc0aa26fbd6eb/users/13ee05459bd74d818b22ec34f3404337/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:11.267139 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ca41f-076f-4f8e-8157-e1ac49bfa9c5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:11.267429 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ca41f-076f-4f8e-8157-e1ac49bfa9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:11.267711 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ca41f-076f-4f8e-8157-e1ac49bfa9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:11.295853 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d38ca41f-076f-4f8e-8157-e1ac49bfa9c5 None None] MFA Rules not processed for user `13ee05459bd74d818b22ec34f3404337`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:11.297097 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d38ca41f-076f-4f8e-8157-e1ac49bfa9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:11.363923 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1404/2808] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:11.374758 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe6a1c-9b9d-4d6b-93dc-8edb71138496 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:11.376470 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-fbfe6a1c-9b9d-4d6b-93dc-8edb71138496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:11.433265 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe6a1c-9b9d-4d6b-93dc-8edb71138496 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:11.437648 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def023f8-7e40-4d7c-b341-26a161c215e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:11.438289 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def023f8-7e40-4d7c-b341-26a161c215e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:11.438574 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def023f8-7e40-4d7c-b341-26a161c215e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:11.438854 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def023f8-7e40-4d7c-b341-26a161c215e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:11.493273 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def023f8-7e40-4d7c-b341-26a161c215e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:11.494709 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def023f8-7e40-4d7c-b341-26a161c215e0 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:11.504593 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1405/2809] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:16:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:14.023841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ca41f-076f-4f8e-8157-e1ac49bfa9c5 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:14.040857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:14.086756 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ca41f-076f-4f8e-8157-e1ac49bfa9c5 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:14.091375 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213ae7e-f190-4d05-a54d-e3c43c35f239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:14.092322 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213ae7e-f190-4d05-a54d-e3c43c35f239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.092611 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213ae7e-f190-4d05-a54d-e3c43c35f239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.092894 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213ae7e-f190-4d05-a54d-e3c43c35f239 admin admin] PATH_INFO: `/v3/users/7aa043f160dc461c9ad86567b84aa7e1` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.094097 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213ae7e-f190-4d05-a54d-e3c43c35f239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa043f160dc461c9ad86567b84aa7e1)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:14.096110 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213ae7e-f190-4d05-a54d-e3c43c35f239 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:14.144872 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3213ae7e-f190-4d05-a54d-e3c43c35f239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa043f160dc461c9ad86567b84aa7e1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:14.152329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3213ae7e-f190-4d05-a54d-e3c43c35f239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa043f160dc461c9ad86567b84aa7e1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:14.164771 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3213ae7e-f190-4d05-a54d-e3c43c35f239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa043f160dc461c9ad86567b84aa7e1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:14.165430 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3213ae7e-f190-4d05-a54d-e3c43c35f239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa043f160dc461c9ad86567b84aa7e1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:14.166171 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3213ae7e-f190-4d05-a54d-e3c43c35f239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa043f160dc461c9ad86567b84aa7e1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:14.180845 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1405/2810] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:16:14 2022] DELETE /identity/v3/users/7aa043f160dc461c9ad86567b84aa7e1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:14.186163 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642f78d-42ac-435b-a7ed-91983b3848be None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.186645 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642f78d-42ac-435b-a7ed-91983b3848be None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.186874 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642f78d-42ac-435b-a7ed-91983b3848be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.204980 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-4642f78d-42ac-435b-a7ed-91983b3848be None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:14.206291 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4642f78d-42ac-435b-a7ed-91983b3848be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:14.229310 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:14.284659 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1406/2811] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:14.292765 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213ae7e-f190-4d05-a54d-e3c43c35f239 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:14.294888 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3213ae7e-f190-4d05-a54d-e3c43c35f239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:14.354906 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213ae7e-f190-4d05-a54d-e3c43c35f239 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:14.359319 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885cedd-1f91-4833-930d-cc92db74a68c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:14.360074 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885cedd-1f91-4833-930d-cc92db74a68c service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.360368 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885cedd-1f91-4833-930d-cc92db74a68c service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.360645 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885cedd-1f91-4833-930d-cc92db74a68c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.370193 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885cedd-1f91-4833-930d-cc92db74a68c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:14.371903 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885cedd-1f91-4833-930d-cc92db74a68c service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:14.382346 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1406/2812] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:16:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:14.675332 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642f78d-42ac-435b-a7ed-91983b3848be None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:14.676847 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4642f78d-42ac-435b-a7ed-91983b3848be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:14.689802 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642f78d-42ac-435b-a7ed-91983b3848be None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:14.695625 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e093c3-ca3d-428c-84dd-59b62f349e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:14.696524 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e093c3-ca3d-428c-84dd-59b62f349e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.696808 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e093c3-ca3d-428c-84dd-59b62f349e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.697230 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e093c3-ca3d-428c-84dd-59b62f349e6f admin admin] PATH_INFO: `/v3/projects/a756a3fe24fd407d8b66bca4994c859c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.698958 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e093c3-ca3d-428c-84dd-59b62f349e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a756a3fe24fd407d8b66bca4994c859c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:14.701644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e093c3-ca3d-428c-84dd-59b62f349e6f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:14.751583 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-58e093c3-ca3d-428c-84dd-59b62f349e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a756a3fe24fd407d8b66bca4994c859c', 'request_id': 'req-58e093c3-ca3d-428c-84dd-59b62f349e6f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:14.757711 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-58e093c3-ca3d-428c-84dd-59b62f349e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a756a3fe24fd407d8b66bca4994c859c', 'request_id': 'req-58e093c3-ca3d-428c-84dd-59b62f349e6f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:14.765973 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-58e093c3-ca3d-428c-84dd-59b62f349e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a756a3fe24fd407d8b66bca4994c859c', 'request_id': 'req-58e093c3-ca3d-428c-84dd-59b62f349e6f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:14.776835 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-58e093c3-ca3d-428c-84dd-59b62f349e6f admin admin] The token cache is being invalidate because project a756a3fe24fd407d8b66bca4994c859c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:14.777127 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-58e093c3-ca3d-428c-84dd-59b62f349e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:14.777774 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-58e093c3-ca3d-428c-84dd-59b62f349e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:14.779371 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1407/2813] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:16:14 2022] DELETE /identity/v3/projects/a756a3fe24fd407d8b66bca4994c859c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:14.783274 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885cedd-1f91-4833-930d-cc92db74a68c service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:14.793256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885cedd-1f91-4833-930d-cc92db74a68c service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:14.827600 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:14.854044 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caaa5fb-3097-4de3-823a-e8768f9fa1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:14.854923 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaa5fb-3097-4de3-823a-e8768f9fa1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.855211 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaa5fb-3097-4de3-823a-e8768f9fa1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.855492 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaa5fb-3097-4de3-823a-e8768f9fa1eb admin admin] PATH_INFO: `/v3/users/13ee05459bd74d818b22ec34f3404337` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.857303 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caaa5fb-3097-4de3-823a-e8768f9fa1eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=13ee05459bd74d818b22ec34f3404337)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:14.859232 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caaa5fb-3097-4de3-823a-e8768f9fa1eb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:14.904701 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8caaa5fb-3097-4de3-823a-e8768f9fa1eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13ee05459bd74d818b22ec34f3404337'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:14.911845 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8caaa5fb-3097-4de3-823a-e8768f9fa1eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13ee05459bd74d818b22ec34f3404337'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:14.925619 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8caaa5fb-3097-4de3-823a-e8768f9fa1eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13ee05459bd74d818b22ec34f3404337'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:14.926268 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8caaa5fb-3097-4de3-823a-e8768f9fa1eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13ee05459bd74d818b22ec34f3404337'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:14.926882 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8caaa5fb-3097-4de3-823a-e8768f9fa1eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13ee05459bd74d818b22ec34f3404337'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:14.939607 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1407/2814] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:16:14 2022] DELETE /identity/v3/users/13ee05459bd74d818b22ec34f3404337 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:15.221353 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e093c3-ca3d-428c-84dd-59b62f349e6f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:15.223004 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-58e093c3-ca3d-428c-84dd-59b62f349e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:15.237117 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e093c3-ca3d-428c-84dd-59b62f349e6f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:15.294587 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d988202-2170-4e1b-b717-646fa40ea856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:15.295382 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d988202-2170-4e1b-b717-646fa40ea856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:15.295669 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d988202-2170-4e1b-b717-646fa40ea856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:15.295989 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d988202-2170-4e1b-b717-646fa40ea856 admin admin] PATH_INFO: `/v3/projects/a5f286878e254cb2b73cc0aa26fbd6eb` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:15.297187 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d988202-2170-4e1b-b717-646fa40ea856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f286878e254cb2b73cc0aa26fbd6eb)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:15.299079 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d988202-2170-4e1b-b717-646fa40ea856 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:15.346068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4d988202-2170-4e1b-b717-646fa40ea856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f286878e254cb2b73cc0aa26fbd6eb', 'request_id': 'req-4d988202-2170-4e1b-b717-646fa40ea856'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:15.347165 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:15.354901 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4d988202-2170-4e1b-b717-646fa40ea856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f286878e254cb2b73cc0aa26fbd6eb', 'request_id': 'req-4d988202-2170-4e1b-b717-646fa40ea856'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:15.363775 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4d988202-2170-4e1b-b717-646fa40ea856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f286878e254cb2b73cc0aa26fbd6eb', 'request_id': 'req-4d988202-2170-4e1b-b717-646fa40ea856'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:15.376073 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4d988202-2170-4e1b-b717-646fa40ea856 admin admin] The token cache is being invalidate because project a5f286878e254cb2b73cc0aa26fbd6eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:15.376370 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4d988202-2170-4e1b-b717-646fa40ea856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:15.377011 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4d988202-2170-4e1b-b717-646fa40ea856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:15.378548 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1408/2815] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:16:15 2022] DELETE /identity/v3/projects/a5f286878e254cb2b73cc0aa26fbd6eb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:24.936168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=36,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:25.372258 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=6,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:25.651793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caaa5fb-3097-4de3-823a-e8768f9fa1eb admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:25.653241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8caaa5fb-3097-4de3-823a-e8768f9fa1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:25.665848 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caaa5fb-3097-4de3-823a-e8768f9fa1eb admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:25.722102 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071258dc-1a94-458d-acae-1dc2c6c24a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:25.722970 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071258dc-1a94-458d-acae-1dc2c6c24a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:25.723258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071258dc-1a94-458d-acae-1dc2c6c24a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:25.723535 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071258dc-1a94-458d-acae-1dc2c6c24a2e admin admin] PATH_INFO: `/v3/users/93bd85236d944f868336a463d9e11c8a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:25.725001 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071258dc-1a94-458d-acae-1dc2c6c24a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=93bd85236d944f868336a463d9e11c8a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:25.726920 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071258dc-1a94-458d-acae-1dc2c6c24a2e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:25.776832 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-071258dc-1a94-458d-acae-1dc2c6c24a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93bd85236d944f868336a463d9e11c8a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:25.784720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-071258dc-1a94-458d-acae-1dc2c6c24a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93bd85236d944f868336a463d9e11c8a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:25.797211 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-071258dc-1a94-458d-acae-1dc2c6c24a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93bd85236d944f868336a463d9e11c8a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:25.797857 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-071258dc-1a94-458d-acae-1dc2c6c24a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93bd85236d944f868336a463d9e11c8a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:25.798472 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-071258dc-1a94-458d-acae-1dc2c6c24a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93bd85236d944f868336a463d9e11c8a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:25.811439 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1408/2816] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:16:25 2022] DELETE /identity/v3/users/93bd85236d944f868336a463d9e11c8a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:25.815832 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b93b6d-7e96-424c-8062-40c8ce7aad54 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:25.816129 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b93b6d-7e96-424c-8062-40c8ce7aad54 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:25.816444 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b93b6d-7e96-424c-8062-40c8ce7aad54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:25.834990 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-49b93b6d-7e96-424c-8062-40c8ce7aad54 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:25.836239 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-49b93b6d-7e96-424c-8062-40c8ce7aad54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:25.895809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1409/2817] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:25.905461 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071258dc-1a94-458d-acae-1dc2c6c24a2e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:25.906863 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-071258dc-1a94-458d-acae-1dc2c6c24a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:25.963612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071258dc-1a94-458d-acae-1dc2c6c24a2e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:25.967910 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c21a9-5e90-40cd-be62-efc051c17e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:25.968551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c21a9-5e90-40cd-be62-efc051c17e09 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:25.968837 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c21a9-5e90-40cd-be62-efc051c17e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:25.969116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c21a9-5e90-40cd-be62-efc051c17e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:25.978363 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c21a9-5e90-40cd-be62-efc051c17e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:25.979781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c21a9-5e90-40cd-be62-efc051c17e09 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:25.989811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1409/2818] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:26.255768 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b93b6d-7e96-424c-8062-40c8ce7aad54 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:26.257285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-49b93b6d-7e96-424c-8062-40c8ce7aad54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:26.273234 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b93b6d-7e96-424c-8062-40c8ce7aad54 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:26.278829 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bfb7c-0200-446a-9d58-ea6ffc7d4383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:26.279699 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bfb7c-0200-446a-9d58-ea6ffc7d4383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:26.280026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bfb7c-0200-446a-9d58-ea6ffc7d4383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:26.280423 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bfb7c-0200-446a-9d58-ea6ffc7d4383 admin admin] PATH_INFO: `/v3/projects/9e83e2b961bc410b821ff1902a353f04` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:26.281747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bfb7c-0200-446a-9d58-ea6ffc7d4383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e83e2b961bc410b821ff1902a353f04)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:26.283640 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bfb7c-0200-446a-9d58-ea6ffc7d4383 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:26.330210 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5a3bfb7c-0200-446a-9d58-ea6ffc7d4383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e83e2b961bc410b821ff1902a353f04', 'request_id': 'req-5a3bfb7c-0200-446a-9d58-ea6ffc7d4383'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:26.336555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5a3bfb7c-0200-446a-9d58-ea6ffc7d4383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e83e2b961bc410b821ff1902a353f04', 'request_id': 'req-5a3bfb7c-0200-446a-9d58-ea6ffc7d4383'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:26.344513 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5a3bfb7c-0200-446a-9d58-ea6ffc7d4383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e83e2b961bc410b821ff1902a353f04', 'request_id': 'req-5a3bfb7c-0200-446a-9d58-ea6ffc7d4383'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:26.355130 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5a3bfb7c-0200-446a-9d58-ea6ffc7d4383 admin admin] The token cache is being invalidate because project 9e83e2b961bc410b821ff1902a353f04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:26.355418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5a3bfb7c-0200-446a-9d58-ea6ffc7d4383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:26.356093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5a3bfb7c-0200-446a-9d58-ea6ffc7d4383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:26.357614 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1410/2819] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:16:26 2022] DELETE /identity/v3/projects/9e83e2b961bc410b821ff1902a353f04 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:26.362545 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec7ffd-5f14-432a-b770-e929e5a080e3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:26.362841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec7ffd-5f14-432a-b770-e929e5a080e3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:26.363123 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec7ffd-5f14-432a-b770-e929e5a080e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:26.380790 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-52ec7ffd-5f14-432a-b770-e929e5a080e3 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:26.382002 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-52ec7ffd-5f14-432a-b770-e929e5a080e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:26.399467 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:26.443047 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1410/2820] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:26.451251 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a024b4d-48a3-451b-9e36-c20309ffdfb6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:26.451755 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a024b4d-48a3-451b-9e36-c20309ffdfb6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:26.451897 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a024b4d-48a3-451b-9e36-c20309ffdfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:26.470789 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6a024b4d-48a3-451b-9e36-c20309ffdfb6 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:26.472026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6a024b4d-48a3-451b-9e36-c20309ffdfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:26.480411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1411/2821] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:26.485108 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec7ffd-5f14-432a-b770-e929e5a080e3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:26.494858 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec7ffd-5f14-432a-b770-e929e5a080e3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:26.500357 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe3eef-14f3-4d0d-b637-179168d845aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:26.501019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe3eef-14f3-4d0d-b637-179168d845aa admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:26.501305 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe3eef-14f3-4d0d-b637-179168d845aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:26.501587 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe3eef-14f3-4d0d-b637-179168d845aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:26.502345 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe3eef-14f3-4d0d-b637-179168d845aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:16:26.502658 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe3eef-14f3-4d0d-b637-179168d845aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:26.504327 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe3eef-14f3-4d0d-b637-179168d845aa admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:26.516074 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1411/2822] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:16:26.520142 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a024b4d-48a3-451b-9e36-c20309ffdfb6 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:26.529420 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a024b4d-48a3-451b-9e36-c20309ffdfb6 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:26.534145 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c0240-ebd6-415b-9a18-af8a3ce83c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:26.534794 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c0240-ebd6-415b-9a18-af8a3ce83c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:26.535083 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c0240-ebd6-415b-9a18-af8a3ce83c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:26.535361 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c0240-ebd6-415b-9a18-af8a3ce83c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:26.536090 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c0240-ebd6-415b-9a18-af8a3ce83c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:26.537975 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c0240-ebd6-415b-9a18-af8a3ce83c59 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:26.564519 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1412/2823] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:16:26 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:26.568705 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe3eef-14f3-4d0d-b637-179168d845aa admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:26.578780 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe3eef-14f3-4d0d-b637-179168d845aa admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:26.636702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99438d3-3840-490e-8ba9-be3166ba594e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:26.637793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99438d3-3840-490e-8ba9-be3166ba594e admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:26.638082 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99438d3-3840-490e-8ba9-be3166ba594e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:26.638358 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99438d3-3840-490e-8ba9-be3166ba594e admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:26.639039 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99438d3-3840-490e-8ba9-be3166ba594e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:26.640982 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99438d3-3840-490e-8ba9-be3166ba594e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:26.660710 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1412/2824] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:16:26 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:26.664915 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c0240-ebd6-415b-9a18-af8a3ce83c59 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:26.675591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c0240-ebd6-415b-9a18-af8a3ce83c59 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:26.680264 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ea291-4934-46ae-aecd-fc272f534460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:26.680918 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ea291-4934-46ae-aecd-fc272f534460 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:26.681206 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ea291-4934-46ae-aecd-fc272f534460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:26.681487 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ea291-4934-46ae-aecd-fc272f534460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:26.682225 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ea291-4934-46ae-aecd-fc272f534460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:26.683807 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ea291-4934-46ae-aecd-fc272f534460 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:26.694801 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1413/2825] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:26.698563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99438d3-3840-490e-8ba9-be3166ba594e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:26.708902 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99438d3-3840-490e-8ba9-be3166ba594e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:26.713490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd55aa-f79b-47a2-bae9-c8b2925679e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:26.714135 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd55aa-f79b-47a2-bae9-c8b2925679e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:26.714417 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd55aa-f79b-47a2-bae9-c8b2925679e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:26.714691 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd55aa-f79b-47a2-bae9-c8b2925679e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:26.716428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd55aa-f79b-47a2-bae9-c8b2925679e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:26.718037 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd55aa-f79b-47a2-bae9-c8b2925679e7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:26.727865 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1413/2826] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:26.732462 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ea291-4934-46ae-aecd-fc272f534460 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:26.742278 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ea291-4934-46ae-aecd-fc272f534460 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:26.746917 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970aad3-c1f4-4bc7-af1e-295d4ffa3c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:26.747835 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970aad3-c1f4-4bc7-af1e-295d4ffa3c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:26.748185 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970aad3-c1f4-4bc7-af1e-295d4ffa3c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:26.748466 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970aad3-c1f4-4bc7-af1e-295d4ffa3c7b admin admin] PATH_INFO: `/v3/projects/3df1c80ff40649c591e2a5e42730e28f/users/37f89da78d95477b8fc121b2d048512f/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:26.762566 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970aad3-c1f4-4bc7-af1e-295d4ffa3c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df1c80ff40649c591e2a5e42730e28f, user_id=37f89da78d95477b8fc121b2d048512f, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:26.765247 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970aad3-c1f4-4bc7-af1e-295d4ffa3c7b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:26.779411 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1414/2827] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:16:26 2022] PUT /identity/v3/projects/3df1c80ff40649c591e2a5e42730e28f/users/37f89da78d95477b8fc121b2d048512f/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:26.843520 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99774045-a119-4a5c-ba4e-be7ef0a48c3e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:26.843811 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99774045-a119-4a5c-ba4e-be7ef0a48c3e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:26.844126 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99774045-a119-4a5c-ba4e-be7ef0a48c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:26.871271 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-99774045-a119-4a5c-ba4e-be7ef0a48c3e None None] MFA Rules not processed for user `37f89da78d95477b8fc121b2d048512f`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:26.872518 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-99774045-a119-4a5c-ba4e-be7ef0a48c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:26.935718 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1414/2828] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:26.947799 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970aad3-c1f4-4bc7-af1e-295d4ffa3c7b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:26.949529 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7970aad3-c1f4-4bc7-af1e-295d4ffa3c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:26.971555 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:27.009856 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970aad3-c1f4-4bc7-af1e-295d4ffa3c7b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:27.013577 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435e085-4717-422d-b94e-29f9237a8072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:27.014220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435e085-4717-422d-b94e-29f9237a8072 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:27.014506 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435e085-4717-422d-b94e-29f9237a8072 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:27.014786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435e085-4717-422d-b94e-29f9237a8072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:27.023035 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435e085-4717-422d-b94e-29f9237a8072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:27.024495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435e085-4717-422d-b94e-29f9237a8072 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:27.033747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1415/2829] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:16:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:27.057907 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99774045-a119-4a5c-ba4e-be7ef0a48c3e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:27.084329 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:27.140330 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99774045-a119-4a5c-ba4e-be7ef0a48c3e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:27.144925 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e64b3-fee1-4083-a845-762b5061c872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:27.145801 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e64b3-fee1-4083-a845-762b5061c872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:27.146096 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e64b3-fee1-4083-a845-762b5061c872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:27.146376 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e64b3-fee1-4083-a845-762b5061c872 admin admin] PATH_INFO: `/v3/users/37f89da78d95477b8fc121b2d048512f` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:27.147585 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e64b3-fee1-4083-a845-762b5061c872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37f89da78d95477b8fc121b2d048512f)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:27.149563 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e64b3-fee1-4083-a845-762b5061c872 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:27.194679 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-304e64b3-fee1-4083-a845-762b5061c872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37f89da78d95477b8fc121b2d048512f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:27.202253 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-304e64b3-fee1-4083-a845-762b5061c872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37f89da78d95477b8fc121b2d048512f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:27.213880 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-304e64b3-fee1-4083-a845-762b5061c872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37f89da78d95477b8fc121b2d048512f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:27.214542 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-304e64b3-fee1-4083-a845-762b5061c872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37f89da78d95477b8fc121b2d048512f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:27.215161 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-304e64b3-fee1-4083-a845-762b5061c872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37f89da78d95477b8fc121b2d048512f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:27.228244 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1415/2830] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:16:27 2022] DELETE /identity/v3/users/37f89da78d95477b8fc121b2d048512f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:27.233073 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d27cd2-b822-4b86-b8be-344ce8e985ea None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:27.233397 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d27cd2-b822-4b86-b8be-344ce8e985ea None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:27.233683 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d27cd2-b822-4b86-b8be-344ce8e985ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:27.251001 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-40d27cd2-b822-4b86-b8be-344ce8e985ea None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:27.252248 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-40d27cd2-b822-4b86-b8be-344ce8e985ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:27.310139 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1416/2831] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:27.320818 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e64b3-fee1-4083-a845-762b5061c872 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:27.322243 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-304e64b3-fee1-4083-a845-762b5061c872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:27.379229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e64b3-fee1-4083-a845-762b5061c872 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:27.382835 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c55f3-65f9-49ed-ac66-3d7a95a0a667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:27.383480 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c55f3-65f9-49ed-ac66-3d7a95a0a667 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:27.383767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c55f3-65f9-49ed-ac66-3d7a95a0a667 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:27.384078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c55f3-65f9-49ed-ac66-3d7a95a0a667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:27.393984 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c55f3-65f9-49ed-ac66-3d7a95a0a667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:27.395414 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c55f3-65f9-49ed-ac66-3d7a95a0a667 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:27.405900 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1416/2832] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:27.677819 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d27cd2-b822-4b86-b8be-344ce8e985ea None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:27.679409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-40d27cd2-b822-4b86-b8be-344ce8e985ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:27.693721 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d27cd2-b822-4b86-b8be-344ce8e985ea None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:27.698858 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899f074-e845-4437-9f8e-2e1e4b25f7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:27.701197 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899f074-e845-4437-9f8e-2e1e4b25f7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:27.701371 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899f074-e845-4437-9f8e-2e1e4b25f7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:27.701652 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899f074-e845-4437-9f8e-2e1e4b25f7ce admin admin] PATH_INFO: `/v3/projects/3df1c80ff40649c591e2a5e42730e28f` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:27.703198 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899f074-e845-4437-9f8e-2e1e4b25f7ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df1c80ff40649c591e2a5e42730e28f)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:27.705077 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899f074-e845-4437-9f8e-2e1e4b25f7ce admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:27.752985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5899f074-e845-4437-9f8e-2e1e4b25f7ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df1c80ff40649c591e2a5e42730e28f', 'request_id': 'req-5899f074-e845-4437-9f8e-2e1e4b25f7ce'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:27.759081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5899f074-e845-4437-9f8e-2e1e4b25f7ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df1c80ff40649c591e2a5e42730e28f', 'request_id': 'req-5899f074-e845-4437-9f8e-2e1e4b25f7ce'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:27.767731 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5899f074-e845-4437-9f8e-2e1e4b25f7ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df1c80ff40649c591e2a5e42730e28f', 'request_id': 'req-5899f074-e845-4437-9f8e-2e1e4b25f7ce'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:27.782992 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5899f074-e845-4437-9f8e-2e1e4b25f7ce admin admin] The token cache is being invalidate because project 3df1c80ff40649c591e2a5e42730e28f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:27.783277 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5899f074-e845-4437-9f8e-2e1e4b25f7ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:27.783954 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5899f074-e845-4437-9f8e-2e1e4b25f7ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:27.785493 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1417/2833] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:16:27 2022] DELETE /identity/v3/projects/3df1c80ff40649c591e2a5e42730e28f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:27.790460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cf523-aaef-4738-9bc4-ea4add2cd30d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:27.790828 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cf523-aaef-4738-9bc4-ea4add2cd30d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:27.791120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cf523-aaef-4738-9bc4-ea4add2cd30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:27.808834 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6e7cf523-aaef-4738-9bc4-ea4add2cd30d None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:27.811090 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6e7cf523-aaef-4738-9bc4-ea4add2cd30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:27.845557 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:27.874343 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1417/2834] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:27.882016 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0568de-e0bb-40f6-90f7-66505289776c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:27.882307 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0568de-e0bb-40f6-90f7-66505289776c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:27.882591 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0568de-e0bb-40f6-90f7-66505289776c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:27.901014 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-7b0568de-e0bb-40f6-90f7-66505289776c None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:27.902184 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7b0568de-e0bb-40f6-90f7-66505289776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:27.910547 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1418/2835] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:27.914612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cf523-aaef-4738-9bc4-ea4add2cd30d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:27.924869 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cf523-aaef-4738-9bc4-ea4add2cd30d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:27.929433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826e3b5-8bd9-4679-9f63-6aff06afca00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:27.930083 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826e3b5-8bd9-4679-9f63-6aff06afca00 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:27.930370 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826e3b5-8bd9-4679-9f63-6aff06afca00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:27.930649 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826e3b5-8bd9-4679-9f63-6aff06afca00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:27.931382 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826e3b5-8bd9-4679-9f63-6aff06afca00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:16:27.931692 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826e3b5-8bd9-4679-9f63-6aff06afca00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:27.933335 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826e3b5-8bd9-4679-9f63-6aff06afca00 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:27.945557 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1418/2836] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:16:27.950117 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0568de-e0bb-40f6-90f7-66505289776c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:27.959242 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0568de-e0bb-40f6-90f7-66505289776c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:27.963783 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8e1d8-7aba-4677-b913-f49271ef4ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:27.964453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8e1d8-7aba-4677-b913-f49271ef4ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:27.964734 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8e1d8-7aba-4677-b913-f49271ef4ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:27.965010 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8e1d8-7aba-4677-b913-f49271ef4ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:27.966194 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8e1d8-7aba-4677-b913-f49271ef4ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:27.968089 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8e1d8-7aba-4677-b913-f49271ef4ebe admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:27.994694 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1419/2837] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:16:27 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:28.000065 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826e3b5-8bd9-4679-9f63-6aff06afca00 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:28.010014 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826e3b5-8bd9-4679-9f63-6aff06afca00 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:28.065706 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74556d-3bc4-4656-8698-5e63d5445dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:28.066374 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74556d-3bc4-4656-8698-5e63d5445dbf admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:28.066637 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74556d-3bc4-4656-8698-5e63d5445dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:28.066912 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74556d-3bc4-4656-8698-5e63d5445dbf admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:28.067608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74556d-3bc4-4656-8698-5e63d5445dbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:28.069558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74556d-3bc4-4656-8698-5e63d5445dbf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:28.088767 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1419/2838] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:16:27 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:28.093011 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8e1d8-7aba-4677-b913-f49271ef4ebe admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:28.103457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8e1d8-7aba-4677-b913-f49271ef4ebe admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:28.108947 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9070787-7c81-4087-b965-7b92cd1727fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:28.109596 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9070787-7c81-4087-b965-7b92cd1727fb admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:28.109880 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9070787-7c81-4087-b965-7b92cd1727fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:28.110156 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9070787-7c81-4087-b965-7b92cd1727fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:28.110884 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9070787-7c81-4087-b965-7b92cd1727fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:28.112500 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9070787-7c81-4087-b965-7b92cd1727fb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:28.123718 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1420/2839] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:28.127550 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74556d-3bc4-4656-8698-5e63d5445dbf admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:28.137625 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74556d-3bc4-4656-8698-5e63d5445dbf admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:28.142180 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a45c7e-f032-4de1-84bf-55c3c3bdc102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:28.142837 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a45c7e-f032-4de1-84bf-55c3c3bdc102 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:28.143120 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a45c7e-f032-4de1-84bf-55c3c3bdc102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:28.143399 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a45c7e-f032-4de1-84bf-55c3c3bdc102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:28.144160 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a45c7e-f032-4de1-84bf-55c3c3bdc102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:28.145740 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a45c7e-f032-4de1-84bf-55c3c3bdc102 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:28.155578 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1420/2840] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:28.159595 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9070787-7c81-4087-b965-7b92cd1727fb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:28.169908 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9070787-7c81-4087-b965-7b92cd1727fb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:28.174747 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc3f6e-48e2-4c8b-bcec-b52fa7ca128a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:28.175608 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3f6e-48e2-4c8b-bcec-b52fa7ca128a admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:28.175927 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3f6e-48e2-4c8b-bcec-b52fa7ca128a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:28.176204 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3f6e-48e2-4c8b-bcec-b52fa7ca128a admin admin] PATH_INFO: `/v3/projects/181e26c39bd647f8b03e8093d5f90846/users/8c1b5f12efde40de931cfb27bbc67cdd/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:28.178402 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:28.193504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc3f6e-48e2-4c8b-bcec-b52fa7ca128a admin admin] RBAC: Authorizing `identity:create_grant(project_id=181e26c39bd647f8b03e8093d5f90846, user_id=8c1b5f12efde40de931cfb27bbc67cdd, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:28.196145 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc3f6e-48e2-4c8b-bcec-b52fa7ca128a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:28.208418 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1421/2841] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:16:28 2022] PUT /identity/v3/projects/181e26c39bd647f8b03e8093d5f90846/users/8c1b5f12efde40de931cfb27bbc67cdd/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:28.220964 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf553922-e303-43d5-844f-63287db0ec59 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:28.221256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf553922-e303-43d5-844f-63287db0ec59 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:28.221540 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf553922-e303-43d5-844f-63287db0ec59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:28.248755 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-bf553922-e303-43d5-844f-63287db0ec59 None None] MFA Rules not processed for user `8c1b5f12efde40de931cfb27bbc67cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:28.249977 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bf553922-e303-43d5-844f-63287db0ec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:28.313668 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1421/2842] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:28.324227 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc3f6e-48e2-4c8b-bcec-b52fa7ca128a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:28.326377 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-98cc3f6e-48e2-4c8b-bcec-b52fa7ca128a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:28.384797 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc3f6e-48e2-4c8b-bcec-b52fa7ca128a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:28.389129 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0ca67-1cb2-4851-8308-8be52bafb41f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:28.389766 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0ca67-1cb2-4851-8308-8be52bafb41f service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:28.390052 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0ca67-1cb2-4851-8308-8be52bafb41f service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:28.390326 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0ca67-1cb2-4851-8308-8be52bafb41f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:28.398620 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0ca67-1cb2-4851-8308-8be52bafb41f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:28.400067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0ca67-1cb2-4851-8308-8be52bafb41f service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:28.408969 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1422/2843] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:16:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:38.245229 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf553922-e303-43d5-844f-63287db0ec59 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:38.284050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:38.308283 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf553922-e303-43d5-844f-63287db0ec59 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:38.313676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cac34-712f-42e9-8234-d62f65a47bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:38.314568 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cac34-712f-42e9-8234-d62f65a47bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:38.314855 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cac34-712f-42e9-8234-d62f65a47bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:38.315133 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cac34-712f-42e9-8234-d62f65a47bdd admin admin] PATH_INFO: `/v3/users/8c1b5f12efde40de931cfb27bbc67cdd` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:38.316338 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cac34-712f-42e9-8234-d62f65a47bdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1b5f12efde40de931cfb27bbc67cdd)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:38.318291 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cac34-712f-42e9-8234-d62f65a47bdd admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:38.363615 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b28cac34-712f-42e9-8234-d62f65a47bdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1b5f12efde40de931cfb27bbc67cdd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:38.370087 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b28cac34-712f-42e9-8234-d62f65a47bdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1b5f12efde40de931cfb27bbc67cdd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:38.382470 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b28cac34-712f-42e9-8234-d62f65a47bdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1b5f12efde40de931cfb27bbc67cdd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:38.383123 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b28cac34-712f-42e9-8234-d62f65a47bdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1b5f12efde40de931cfb27bbc67cdd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:38.383716 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b28cac34-712f-42e9-8234-d62f65a47bdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1b5f12efde40de931cfb27bbc67cdd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:38.395961 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1422/2844] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:16:38 2022] DELETE /identity/v3/users/8c1b5f12efde40de931cfb27bbc67cdd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:38.400457 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b3cf6-06ab-4d14-9dc5-123445e52788 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:38.400944 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b3cf6-06ab-4d14-9dc5-123445e52788 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:38.401057 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b3cf6-06ab-4d14-9dc5-123445e52788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:38.417656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b22b3cf6-06ab-4d14-9dc5-123445e52788 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:38.418861 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b22b3cf6-06ab-4d14-9dc5-123445e52788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:38.477580 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1423/2845] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:38.488135 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cac34-712f-42e9-8234-d62f65a47bdd admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:38.489567 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b28cac34-712f-42e9-8234-d62f65a47bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:38.548295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cac34-712f-42e9-8234-d62f65a47bdd admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:38.551924 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827aedc5-1cf5-43bf-aa37-cd37d175e5f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:38.552574 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aedc5-1cf5-43bf-aa37-cd37d175e5f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:38.552861 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aedc5-1cf5-43bf-aa37-cd37d175e5f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:38.553141 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aedc5-1cf5-43bf-aa37-cd37d175e5f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:38.562697 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827aedc5-1cf5-43bf-aa37-cd37d175e5f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:38.564211 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827aedc5-1cf5-43bf-aa37-cd37d175e5f1 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:38.573464 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1423/2846] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:38.839338 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b3cf6-06ab-4d14-9dc5-123445e52788 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:38.840878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b22b3cf6-06ab-4d14-9dc5-123445e52788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:38.853771 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b3cf6-06ab-4d14-9dc5-123445e52788 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:38.858468 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a44f76-1684-4f23-a866-e08f917f8727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:38.859336 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a44f76-1684-4f23-a866-e08f917f8727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:38.859625 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a44f76-1684-4f23-a866-e08f917f8727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:38.859932 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a44f76-1684-4f23-a866-e08f917f8727 admin admin] PATH_INFO: `/v3/projects/181e26c39bd647f8b03e8093d5f90846` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:38.861133 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a44f76-1684-4f23-a866-e08f917f8727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=181e26c39bd647f8b03e8093d5f90846)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:38.863040 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a44f76-1684-4f23-a866-e08f917f8727 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:38.910245 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a2a44f76-1684-4f23-a866-e08f917f8727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '181e26c39bd647f8b03e8093d5f90846', 'request_id': 'req-a2a44f76-1684-4f23-a866-e08f917f8727'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:38.916347 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a2a44f76-1684-4f23-a866-e08f917f8727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '181e26c39bd647f8b03e8093d5f90846', 'request_id': 'req-a2a44f76-1684-4f23-a866-e08f917f8727'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:38.924920 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a2a44f76-1684-4f23-a866-e08f917f8727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '181e26c39bd647f8b03e8093d5f90846', 'request_id': 'req-a2a44f76-1684-4f23-a866-e08f917f8727'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:38.935662 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a2a44f76-1684-4f23-a866-e08f917f8727 admin admin] The token cache is being invalidate because project 181e26c39bd647f8b03e8093d5f90846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:38.935984 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a2a44f76-1684-4f23-a866-e08f917f8727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:38.936612 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a2a44f76-1684-4f23-a866-e08f917f8727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:38.938126 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1424/2847] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:16:38 2022] DELETE /identity/v3/projects/181e26c39bd647f8b03e8093d5f90846 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:38.943355 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f943c-4c73-4b4b-a3b0-3b834728fbf7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:38.943744 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f943c-4c73-4b4b-a3b0-3b834728fbf7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:38.944054 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f943c-4c73-4b4b-a3b0-3b834728fbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:38.962269 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e65f943c-4c73-4b4b-a3b0-3b834728fbf7 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:38.963449 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e65f943c-4c73-4b4b-a3b0-3b834728fbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:39.014202 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:39.025490 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1424/2848] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:39.033704 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e48f1a-345a-4775-abbc-eed6fa384e13 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:39.033996 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e48f1a-345a-4775-abbc-eed6fa384e13 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:39.034274 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e48f1a-345a-4775-abbc-eed6fa384e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:39.052810 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-63e48f1a-345a-4775-abbc-eed6fa384e13 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:39.053998 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-63e48f1a-345a-4775-abbc-eed6fa384e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:39.062727 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1425/2849] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:39.066928 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f943c-4c73-4b4b-a3b0-3b834728fbf7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:39.077457 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f943c-4c73-4b4b-a3b0-3b834728fbf7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:39.082073 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae6674-a0a1-4d55-be79-40ce8bbc2bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:39.082726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae6674-a0a1-4d55-be79-40ce8bbc2bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:39.083014 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae6674-a0a1-4d55-be79-40ce8bbc2bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:39.083293 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae6674-a0a1-4d55-be79-40ce8bbc2bc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:39.084053 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae6674-a0a1-4d55-be79-40ce8bbc2bc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:16:39.084367 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae6674-a0a1-4d55-be79-40ce8bbc2bc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:39.085981 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae6674-a0a1-4d55-be79-40ce8bbc2bc5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:39.097420 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1425/2850] 10.222.0.41 () {58 vars in 1152 bytes} [Mon May 30 12:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:16:39.101716 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e48f1a-345a-4775-abbc-eed6fa384e13 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:39.106111 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:39.112916 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e48f1a-345a-4775-abbc-eed6fa384e13 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:39.118707 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28ab8c-fc21-41ad-868d-ed65ce655cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:39.119364 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28ab8c-fc21-41ad-868d-ed65ce655cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:39.119650 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28ab8c-fc21-41ad-868d-ed65ce655cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:39.119967 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28ab8c-fc21-41ad-868d-ed65ce655cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:39.120683 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28ab8c-fc21-41ad-868d-ed65ce655cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:39.123211 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28ab8c-fc21-41ad-868d-ed65ce655cd2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:39.149356 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1426/2851] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:16:39 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:16:39.154237 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae6674-a0a1-4d55-be79-40ce8bbc2bc5 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:39.164083 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae6674-a0a1-4d55-be79-40ce8bbc2bc5 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:39.222677 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587886e-53f7-4a6a-b1e6-15b85c3c93e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:39.223353 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587886e-53f7-4a6a-b1e6-15b85c3c93e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:39.223655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587886e-53f7-4a6a-b1e6-15b85c3c93e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:39.224025 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587886e-53f7-4a6a-b1e6-15b85c3c93e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:39.224984 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587886e-53f7-4a6a-b1e6-15b85c3c93e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:39.226891 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587886e-53f7-4a6a-b1e6-15b85c3c93e4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:39.246713 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1426/2852] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:16:39 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:16:39.251460 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28ab8c-fc21-41ad-868d-ed65ce655cd2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:39.261898 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28ab8c-fc21-41ad-868d-ed65ce655cd2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:39.267169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abfe09-989b-49c9-832a-9edd66199064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:39.267770 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abfe09-989b-49c9-832a-9edd66199064 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:39.268095 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abfe09-989b-49c9-832a-9edd66199064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:39.268381 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abfe09-989b-49c9-832a-9edd66199064 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:39.269119 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abfe09-989b-49c9-832a-9edd66199064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:39.270702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abfe09-989b-49c9-832a-9edd66199064 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:39.280907 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1427/2853] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:39.284776 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587886e-53f7-4a6a-b1e6-15b85c3c93e4 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:39.295227 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587886e-53f7-4a6a-b1e6-15b85c3c93e4 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:39.299790 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca476b20-4727-4389-9ed2-44d0059d3648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:39.300462 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca476b20-4727-4389-9ed2-44d0059d3648 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:39.300748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca476b20-4727-4389-9ed2-44d0059d3648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:39.301024 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca476b20-4727-4389-9ed2-44d0059d3648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:39.301759 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca476b20-4727-4389-9ed2-44d0059d3648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:39.303338 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca476b20-4727-4389-9ed2-44d0059d3648 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:39.313799 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1427/2854] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:39.317605 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abfe09-989b-49c9-832a-9edd66199064 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:39.328005 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abfe09-989b-49c9-832a-9edd66199064 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:39.332605 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a020a7f-adb5-4b13-acce-f10f484d66bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:39.333503 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a020a7f-adb5-4b13-acce-f10f484d66bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:39.333784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a020a7f-adb5-4b13-acce-f10f484d66bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:39.334063 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a020a7f-adb5-4b13-acce-f10f484d66bb admin admin] PATH_INFO: `/v3/projects/cc29531ccae24475ab6b50e2cc2e5d48/users/0eb80aad1ad74eb4b0a28b1e686ecfab/roles/5674314ace5445ccbca611d8cfdc25f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:39.348644 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a020a7f-adb5-4b13-acce-f10f484d66bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc29531ccae24475ab6b50e2cc2e5d48, user_id=0eb80aad1ad74eb4b0a28b1e686ecfab, role_id=5674314ace5445ccbca611d8cfdc25f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:39.351527 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a020a7f-adb5-4b13-acce-f10f484d66bb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:39.366517 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1428/2855] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:16:39 2022] PUT /identity/v3/projects/cc29531ccae24475ab6b50e2cc2e5d48/users/0eb80aad1ad74eb4b0a28b1e686ecfab/roles/5674314ace5445ccbca611d8cfdc25f1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:39.371493 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e8710-c834-4dd1-9118-d5fa1ffc6ca3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:39.371790 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e8710-c834-4dd1-9118-d5fa1ffc6ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:39.372735 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e8710-c834-4dd1-9118-d5fa1ffc6ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:39.390127 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e41e8710-c834-4dd1-9118-d5fa1ffc6ca3 None None] MFA Rules not processed for user `6a1c89e7dfbe47f0b169c936907738b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:39.391328 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e41e8710-c834-4dd1-9118-d5fa1ffc6ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:39.448612 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1428/2856] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:39.458571 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a020a7f-adb5-4b13-acce-f10f484d66bb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:39.460345 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8a020a7f-adb5-4b13-acce-f10f484d66bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:39.518285 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a020a7f-adb5-4b13-acce-f10f484d66bb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:39.522122 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc6c87-91f4-43c2-9aca-ea8e55036ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:39.522778 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc6c87-91f4-43c2-9aca-ea8e55036ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:39.523067 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc6c87-91f4-43c2-9aca-ea8e55036ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:39.523348 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc6c87-91f4-43c2-9aca-ea8e55036ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:39.533251 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc6c87-91f4-43c2-9aca-ea8e55036ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:39.534685 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc6c87-91f4-43c2-9aca-ea8e55036ba7 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:39.545271 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1429/2857] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:43.506985 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edac42-dcb3-4e02-b3c1-3f8251d56caa None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:43.507454 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edac42-dcb3-4e02-b3c1-3f8251d56caa None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:43.507560 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edac42-dcb3-4e02-b3c1-3f8251d56caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:43.536524 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-15edac42-dcb3-4e02-b3c1-3f8251d56caa None None] MFA Rules not processed for user `0eb80aad1ad74eb4b0a28b1e686ecfab`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:43.537865 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-15edac42-dcb3-4e02-b3c1-3f8251d56caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:43.594556 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:43.612333 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1429/2858] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:43.613263 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc6c87-91f4-43c2-9aca-ea8e55036ba7 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:43.626705 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc6c87-91f4-43c2-9aca-ea8e55036ba7 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:43.631781 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9026e27-efe7-470b-93a0-72c96e5b9534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:43.632488 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9026e27-efe7-470b-93a0-72c96e5b9534 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:43.632776 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9026e27-efe7-470b-93a0-72c96e5b9534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:43.633058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9026e27-efe7-470b-93a0-72c96e5b9534 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:43.633798 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9026e27-efe7-470b-93a0-72c96e5b9534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:43.635694 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9026e27-efe7-470b-93a0-72c96e5b9534 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:43.665103 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1430/2859] 10.222.0.41 () {60 vars in 1152 bytes} [Mon May 30 12:16:43 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:16:43.669841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edac42-dcb3-4e02-b3c1-3f8251d56caa None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:43.681079 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edac42-dcb3-4e02-b3c1-3f8251d56caa None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:43.741738 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed004326-ce95-4efe-a1e3-bbd7dc75a2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:43.742428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004326-ce95-4efe-a1e3-bbd7dc75a2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:43.742715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004326-ce95-4efe-a1e3-bbd7dc75a2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:43.743008 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004326-ce95-4efe-a1e3-bbd7dc75a2e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:43.743698 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed004326-ce95-4efe-a1e3-bbd7dc75a2e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:43.745661 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed004326-ce95-4efe-a1e3-bbd7dc75a2e4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:43.778479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1430/2860] 10.222.0.41 () {60 vars in 1143 bytes} [Mon May 30 12:16:43 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:16:43.781093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9026e27-efe7-470b-93a0-72c96e5b9534 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:43.799676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9026e27-efe7-470b-93a0-72c96e5b9534 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:43.808958 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fd983-581a-43cc-a704-a7e73e942874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:43.810352 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fd983-581a-43cc-a704-a7e73e942874 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:43.810606 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fd983-581a-43cc-a704-a7e73e942874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:43.811018 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fd983-581a-43cc-a704-a7e73e942874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:43.811768 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4fd983-581a-43cc-a704-a7e73e942874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:43.813409 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4fd983-581a-43cc-a704-a7e73e942874 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:43.825026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1431/2861] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:43.829277 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed004326-ce95-4efe-a1e3-bbd7dc75a2e4 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:43.846635 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed004326-ce95-4efe-a1e3-bbd7dc75a2e4 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:43.851934 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6dc3f6-03da-49b1-a079-9a2098838025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:43.852846 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dc3f6-03da-49b1-a079-9a2098838025 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:43.853595 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dc3f6-03da-49b1-a079-9a2098838025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:43.853888 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dc3f6-03da-49b1-a079-9a2098838025 admin admin] PATH_INFO: `/v3/projects/a1cef9963ab3434ca9bbeaf07d3f8b6a/users/49f1140d1d984efe95beba4605ce86b2/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:43.874700 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6dc3f6-03da-49b1-a079-9a2098838025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1cef9963ab3434ca9bbeaf07d3f8b6a, user_id=49f1140d1d984efe95beba4605ce86b2, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:43.877603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6dc3f6-03da-49b1-a079-9a2098838025 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:43.896696 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1431/2862] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:16:43 2022] PUT /identity/v3/projects/a1cef9963ab3434ca9bbeaf07d3f8b6a/users/49f1140d1d984efe95beba4605ce86b2/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:43.900545 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fd983-581a-43cc-a704-a7e73e942874 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:43.912985 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fd983-581a-43cc-a704-a7e73e942874 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:43.978613 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf21ff-fddb-4ae4-9ccf-fbda26f75482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:43.979296 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf21ff-fddb-4ae4-9ccf-fbda26f75482 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:43.979598 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf21ff-fddb-4ae4-9ccf-fbda26f75482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:43.980034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf21ff-fddb-4ae4-9ccf-fbda26f75482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:43.980786 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf21ff-fddb-4ae4-9ccf-fbda26f75482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:43.983017 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf21ff-fddb-4ae4-9ccf-fbda26f75482 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:43.999397 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1432/2863] 10.222.0.41 () {58 vars in 1121 bytes} [Mon May 30 12:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:44.000721 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6dc3f6-03da-49b1-a079-9a2098838025 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:44.011428 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6dc3f6-03da-49b1-a079-9a2098838025 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:44.022860 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ce788-7316-43f8-93ff-e9450936ac0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:44.023781 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ce788-7316-43f8-93ff-e9450936ac0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:44.024153 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ce788-7316-43f8-93ff-e9450936ac0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:44.024386 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ce788-7316-43f8-93ff-e9450936ac0e admin admin] PATH_INFO: `/v3/projects/a1cef9963ab3434ca9bbeaf07d3f8b6a/users/49f1140d1d984efe95beba4605ce86b2/roles/8196ef570097443bac15d3cf39878486` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:44.026906 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ce788-7316-43f8-93ff-e9450936ac0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1cef9963ab3434ca9bbeaf07d3f8b6a, user_id=49f1140d1d984efe95beba4605ce86b2, role_id=8196ef570097443bac15d3cf39878486)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:44.029814 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ce788-7316-43f8-93ff-e9450936ac0e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:44.041687 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1432/2864] 10.222.0.41 () {60 vars in 1482 bytes} [Mon May 30 12:16:43 2022] PUT /identity/v3/projects/a1cef9963ab3434ca9bbeaf07d3f8b6a/users/49f1140d1d984efe95beba4605ce86b2/roles/8196ef570097443bac15d3cf39878486 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:48.691069 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b8929-fed7-436f-8042-f1f7388abca4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:48.691551 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b8929-fed7-436f-8042-f1f7388abca4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:48.691802 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b8929-fed7-436f-8042-f1f7388abca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:48.713583 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:48.724341 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f09b8929-fed7-436f-8042-f1f7388abca4 None None] MFA Rules not processed for user `49f1140d1d984efe95beba4605ce86b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:48.726425 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f09b8929-fed7-436f-8042-f1f7388abca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:48.803848 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1433/2865] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:48.819463 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ce788-7316-43f8-93ff-e9450936ac0e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:48.821791 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9d9ce788-7316-43f8-93ff-e9450936ac0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:48.900870 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ce788-7316-43f8-93ff-e9450936ac0e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:48.907432 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6a875-0435-444d-8245-992dd875da61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:48.908141 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6a875-0435-444d-8245-992dd875da61 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:48.908433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6a875-0435-444d-8245-992dd875da61 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:48.908714 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6a875-0435-444d-8245-992dd875da61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:48.951695 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:48.968030 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6a875-0435-444d-8245-992dd875da61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:48.969676 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6a875-0435-444d-8245-992dd875da61 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:48.980287 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1433/2866] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:16:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:49.986416 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2982b-630c-43e3-a5a4-f22bde6a1319 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:49.986914 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2982b-630c-43e3-a5a4-f22bde6a1319 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:49.987033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2982b-630c-43e3-a5a4-f22bde6a1319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:50.005348 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e6f2982b-630c-43e3-a5a4-f22bde6a1319 None None] MFA Rules not processed for user `0eb80aad1ad74eb4b0a28b1e686ecfab`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:50.006564 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e6f2982b-630c-43e3-a5a4-f22bde6a1319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:50.018413 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1434/2867] 10.222.0.41 () {58 vars in 957 bytes} [Mon May 30 12:16:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:57.207433 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6a875-0435-444d-8245-992dd875da61 service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:57.266062 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6a875-0435-444d-8245-992dd875da61 service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:57.269758 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64367a42-0968-4b21-a1d4-923d40a776ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:57.270437 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64367a42-0968-4b21-a1d4-923d40a776ee service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:57.270726 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64367a42-0968-4b21-a1d4-923d40a776ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:57.271006 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64367a42-0968-4b21-a1d4-923d40a776ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:57.272846 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-64367a42-0968-4b21-a1d4-923d40a776ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:57.287206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64367a42-0968-4b21-a1d4-923d40a776ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:57.288719 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64367a42-0968-4b21-a1d4-923d40a776ee service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:57.301710 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1434/2868] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:16:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:57.983428 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2982b-630c-43e3-a5a4-f22bde6a1319 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:57.985026 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e6f2982b-630c-43e3-a5a4-f22bde6a1319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:58.000921 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2982b-630c-43e3-a5a4-f22bde6a1319 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:58.011061 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a93a1f-414d-4bd6-8409-45f84a5b9cac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:58.012513 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a93a1f-414d-4bd6-8409-45f84a5b9cac service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:58.013034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a93a1f-414d-4bd6-8409-45f84a5b9cac service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:58.013538 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a93a1f-414d-4bd6-8409-45f84a5b9cac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:58.020835 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-90a93a1f-414d-4bd6-8409-45f84a5b9cac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:58.037072 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a93a1f-414d-4bd6-8409-45f84a5b9cac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:58.039069 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a93a1f-414d-4bd6-8409-45f84a5b9cac service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:58.052710 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1435/2869] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:16:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:17:05.839074 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64367a42-0968-4b21-a1d4-923d40a776ee service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:05.840509 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-64367a42-0968-4b21-a1d4-923d40a776ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:05.897090 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64367a42-0968-4b21-a1d4-923d40a776ee service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:05.900637 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d795c2-1ee5-44b5-a1d5-55a2457b0f36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1110aeeded4ab0b6fa2aedfa8740c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:05.901276 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d795c2-1ee5-44b5-a1d5-55a2457b0f36 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:05.901558 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d795c2-1ee5-44b5-a1d5-55a2457b0f36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:05.901833 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d795c2-1ee5-44b5-a1d5-55a2457b0f36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:05.903546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-39d795c2-1ee5-44b5-a1d5-55a2457b0f36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:05.917417 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d795c2-1ee5-44b5-a1d5-55a2457b0f36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:05.918841 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d795c2-1ee5-44b5-a1d5-55a2457b0f36 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:05.930602 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1435/2870] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:17:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:17:08.045943 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=38 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:10.972671 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c82c1-c342-4f2e-a4c9-3ffefc948008 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:10.973237 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c82c1-c342-4f2e-a4c9-3ffefc948008 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:10.973237 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c82c1-c342-4f2e-a4c9-3ffefc948008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:10.992464 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-652c82c1-c342-4f2e-a4c9-3ffefc948008 None None] MFA Rules not processed for user `a63dd78421064bbe838b1ed0261c13bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:10.993694 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-652c82c1-c342-4f2e-a4c9-3ffefc948008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:11.050866 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1436/2871] 10.222.0.41 () {58 vars in 967 bytes} [Mon May 30 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:11.095134 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d795c2-1ee5-44b5-a1d5-55a2457b0f36 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:11.097241 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-39d795c2-1ee5-44b5-a1d5-55a2457b0f36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:11.170911 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d795c2-1ee5-44b5-a1d5-55a2457b0f36 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:11.177608 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f3ce8-2785-46c7-83d8-e5b6e0b743ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e5f980cdb74227bb31c7e7e5eab74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:11.178546 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f3ce8-2785-46c7-83d8-e5b6e0b743ed service swift] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:11.178827 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f3ce8-2785-46c7-83d8-e5b6e0b743ed service swift] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:11.179145 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f3ce8-2785-46c7-83d8-e5b6e0b743ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:11.191655 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f3ce8-2785-46c7-83d8-e5b6e0b743ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:11.193321 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f3ce8-2785-46c7-83d8-e5b6e0b743ed service swift] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:11.208631 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1436/2872] 10.222.0.41 () {60 vars in 1384 bytes} [Mon May 30 12:17:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:17:18.354013 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c82c1-c342-4f2e-a4c9-3ffefc948008 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:18.355565 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-652c82c1-c342-4f2e-a4c9-3ffefc948008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:18.423903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c82c1-c342-4f2e-a4c9-3ffefc948008 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:18.428352 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fbfd3-99f2-40f4-915c-7fab983b8761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:18.429218 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fbfd3-99f2-40f4-915c-7fab983b8761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:18.429495 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fbfd3-99f2-40f4-915c-7fab983b8761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:18.429767 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fbfd3-99f2-40f4-915c-7fab983b8761 admin admin] PATH_INFO: `/v3/users/91cb81b73de1405899bfa73cecb8e1ae` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:18.430965 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fbfd3-99f2-40f4-915c-7fab983b8761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91cb81b73de1405899bfa73cecb8e1ae)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:18.432903 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fbfd3-99f2-40f4-915c-7fab983b8761 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:18.480926 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c72fbfd3-99f2-40f4-915c-7fab983b8761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91cb81b73de1405899bfa73cecb8e1ae'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:18.488604 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c72fbfd3-99f2-40f4-915c-7fab983b8761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91cb81b73de1405899bfa73cecb8e1ae'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:18.500412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c72fbfd3-99f2-40f4-915c-7fab983b8761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91cb81b73de1405899bfa73cecb8e1ae'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:18.501648 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c72fbfd3-99f2-40f4-915c-7fab983b8761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91cb81b73de1405899bfa73cecb8e1ae'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:18.508557 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c72fbfd3-99f2-40f4-915c-7fab983b8761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91cb81b73de1405899bfa73cecb8e1ae'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:18.514453 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1437/2873] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:17:18 2022] DELETE /identity/v3/users/91cb81b73de1405899bfa73cecb8e1ae => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:17:18.691504 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f3ce8-2785-46c7-83d8-e5b6e0b743ed service swift] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:18.703289 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f3ce8-2785-46c7-83d8-e5b6e0b743ed service swift] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:18.719280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:18.768183 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18d160-a6da-47d4-a719-27b487b129b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:18.769163 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18d160-a6da-47d4-a719-27b487b129b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:18.769544 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18d160-a6da-47d4-a719-27b487b129b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:18.769889 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18d160-a6da-47d4-a719-27b487b129b6 admin admin] PATH_INFO: `/v3/projects/cd1f7d3f6294439090a64d1b442e0789` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:18.771179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18d160-a6da-47d4-a719-27b487b129b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd1f7d3f6294439090a64d1b442e0789)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:18.773204 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18d160-a6da-47d4-a719-27b487b129b6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:18.822499 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0d18d160-a6da-47d4-a719-27b487b129b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd1f7d3f6294439090a64d1b442e0789', 'request_id': 'req-0d18d160-a6da-47d4-a719-27b487b129b6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:18.829566 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0d18d160-a6da-47d4-a719-27b487b129b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd1f7d3f6294439090a64d1b442e0789', 'request_id': 'req-0d18d160-a6da-47d4-a719-27b487b129b6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:18.835714 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0d18d160-a6da-47d4-a719-27b487b129b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd1f7d3f6294439090a64d1b442e0789', 'request_id': 'req-0d18d160-a6da-47d4-a719-27b487b129b6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:18.846280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0d18d160-a6da-47d4-a719-27b487b129b6 admin admin] The token cache is being invalidate because project cd1f7d3f6294439090a64d1b442e0789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:17:18.846572 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0d18d160-a6da-47d4-a719-27b487b129b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:18.847207 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0d18d160-a6da-47d4-a719-27b487b129b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:18.848783 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1437/2874] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:17:18 2022] DELETE /identity/v3/projects/cd1f7d3f6294439090a64d1b442e0789 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:18.853019 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fbfd3-99f2-40f4-915c-7fab983b8761 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:18.854426 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c72fbfd3-99f2-40f4-915c-7fab983b8761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:18.868287 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fbfd3-99f2-40f4-915c-7fab983b8761 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:18.888216 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:18.926293 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c6843-8148-4751-bf97-64ee2338489f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:18.927160 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c6843-8148-4751-bf97-64ee2338489f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:18.927447 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c6843-8148-4751-bf97-64ee2338489f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:18.927723 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c6843-8148-4751-bf97-64ee2338489f admin admin] PATH_INFO: `/v3/users/c6f69c6cfffb49d7ae3181cfa6216d59` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:18.928969 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c6843-8148-4751-bf97-64ee2338489f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6f69c6cfffb49d7ae3181cfa6216d59)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:18.930920 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c6843-8148-4751-bf97-64ee2338489f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:18.977925 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6e2c6843-8148-4751-bf97-64ee2338489f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6f69c6cfffb49d7ae3181cfa6216d59'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:18.986494 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6e2c6843-8148-4751-bf97-64ee2338489f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6f69c6cfffb49d7ae3181cfa6216d59'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:18.998737 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6e2c6843-8148-4751-bf97-64ee2338489f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6f69c6cfffb49d7ae3181cfa6216d59'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:18.999436 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6e2c6843-8148-4751-bf97-64ee2338489f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6f69c6cfffb49d7ae3181cfa6216d59'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:19.007214 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6e2c6843-8148-4751-bf97-64ee2338489f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6f69c6cfffb49d7ae3181cfa6216d59'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:19.013161 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1438/2875] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:17:18 2022] DELETE /identity/v3/users/c6f69c6cfffb49d7ae3181cfa6216d59 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:19.191601 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18d160-a6da-47d4-a719-27b487b129b6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:19.193139 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0d18d160-a6da-47d4-a719-27b487b129b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:19.208380 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18d160-a6da-47d4-a719-27b487b129b6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:19.273410 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba32e4-9f64-47cd-bd49-18e444065288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:19.274275 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba32e4-9f64-47cd-bd49-18e444065288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:19.274565 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba32e4-9f64-47cd-bd49-18e444065288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:19.274844 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba32e4-9f64-47cd-bd49-18e444065288 admin admin] PATH_INFO: `/v3/projects/4b5006e8f57a488fa7f3003d29882663` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:19.276069 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba32e4-9f64-47cd-bd49-18e444065288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5006e8f57a488fa7f3003d29882663)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:19.278003 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba32e4-9f64-47cd-bd49-18e444065288 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:19.324787 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e9ba32e4-9f64-47cd-bd49-18e444065288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5006e8f57a488fa7f3003d29882663', 'request_id': 'req-e9ba32e4-9f64-47cd-bd49-18e444065288'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:19.326460 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:19.333390 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e9ba32e4-9f64-47cd-bd49-18e444065288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5006e8f57a488fa7f3003d29882663', 'request_id': 'req-e9ba32e4-9f64-47cd-bd49-18e444065288'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:19.340583 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e9ba32e4-9f64-47cd-bd49-18e444065288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5006e8f57a488fa7f3003d29882663', 'request_id': 'req-e9ba32e4-9f64-47cd-bd49-18e444065288'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:19.352016 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e9ba32e4-9f64-47cd-bd49-18e444065288 admin admin] The token cache is being invalidate because project 4b5006e8f57a488fa7f3003d29882663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:17:19.352312 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e9ba32e4-9f64-47cd-bd49-18e444065288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:19.353724 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e9ba32e4-9f64-47cd-bd49-18e444065288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:19.354478 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1438/2876] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:17:19 2022] DELETE /identity/v3/projects/4b5006e8f57a488fa7f3003d29882663 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:23.655979 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c6843-8148-4751-bf97-64ee2338489f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:23.657415 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6e2c6843-8148-4751-bf97-64ee2338489f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:23.715108 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c6843-8148-4751-bf97-64ee2338489f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:23.763525 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afdc74-2e65-4514-b322-ca8e313f76f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:23.764233 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afdc74-2e65-4514-b322-ca8e313f76f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:23.764520 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afdc74-2e65-4514-b322-ca8e313f76f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:23.764804 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afdc74-2e65-4514-b322-ca8e313f76f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:23.767310 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-14afdc74-2e65-4514-b322-ca8e313f76f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:23.784340 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:23.834812 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afdc74-2e65-4514-b322-ca8e313f76f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:23.836469 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afdc74-2e65-4514-b322-ca8e313f76f2 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:23.846554 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1439/2877] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:17:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:17:29.348641 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:33.841638 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=23 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:46.961270 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba32e4-9f64-47cd-bd49-18e444065288 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:46.962940 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e9ba32e4-9f64-47cd-bd49-18e444065288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:47.057591 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba32e4-9f64-47cd-bd49-18e444065288 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:47.063865 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119af2ed-5a8f-4d60-9235-d718cb9e0f7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:47.064663 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af2ed-5a8f-4d60-9235-d718cb9e0f7c service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:47.064948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af2ed-5a8f-4d60-9235-d718cb9e0f7c service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:47.065224 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af2ed-5a8f-4d60-9235-d718cb9e0f7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:47.075373 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-119af2ed-5a8f-4d60-9235-d718cb9e0f7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:47.089094 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119af2ed-5a8f-4d60-9235-d718cb9e0f7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:47.090981 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119af2ed-5a8f-4d60-9235-d718cb9e0f7c service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:47.103948 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1439/2878] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:17:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:17:49.772306 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afdc74-2e65-4514-b322-ca8e313f76f2 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:49.786567 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afdc74-2e65-4514-b322-ca8e313f76f2 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:49.792096 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba788f-0a87-453c-9d54-e4c1272f96b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:49.792746 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba788f-0a87-453c-9d54-e4c1272f96b0 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:49.793034 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba788f-0a87-453c-9d54-e4c1272f96b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:49.793315 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba788f-0a87-453c-9d54-e4c1272f96b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:49.795193 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9eba788f-0a87-453c-9d54-e4c1272f96b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:49.808809 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba788f-0a87-453c-9d54-e4c1272f96b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:49.810474 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba788f-0a87-453c-9d54-e4c1272f96b0 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:49.822124 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1440/2879] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:17:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:17:57.098228 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=34 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:59.817526 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:00.502038 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119af2ed-5a8f-4d60-9235-d718cb9e0f7c service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:18:00.503533 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-119af2ed-5a8f-4d60-9235-d718cb9e0f7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:18:00.515381 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119af2ed-5a8f-4d60-9235-d718cb9e0f7c service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:18:00.519543 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dc509-9f41-4403-923b-2d4e47bd544a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:18:00.520238 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dc509-9f41-4403-923b-2d4e47bd544a service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:00.520529 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dc509-9f41-4403-923b-2d4e47bd544a service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:00.520809 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dc509-9f41-4403-923b-2d4e47bd544a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:00.522544 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2d0dc509-9f41-4403-923b-2d4e47bd544a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:18:00.588179 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0dc509-9f41-4403-923b-2d4e47bd544a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:18:00.589632 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0dc509-9f41-4403-923b-2d4e47bd544a service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:18:00.600209 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1440/2880] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:18:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:18:06.804102 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba788f-0a87-453c-9d54-e4c1272f96b0 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:18:06.805588 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9eba788f-0a87-453c-9d54-e4c1272f96b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:18:06.820757 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba788f-0a87-453c-9d54-e4c1272f96b0 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:18:06.825540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ff643-8f98-45df-a550-3d2d27dae035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:18:06.826504 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ff643-8f98-45df-a550-3d2d27dae035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:06.826799 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ff643-8f98-45df-a550-3d2d27dae035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:06.827081 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ff643-8f98-45df-a550-3d2d27dae035 admin admin] PATH_INFO: `/v3/users/f7e7ce32b4c0457196c8765d6c5ada7e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:06.829066 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ff643-8f98-45df-a550-3d2d27dae035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e7ce32b4c0457196c8765d6c5ada7e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:18:06.831044 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ff643-8f98-45df-a550-3d2d27dae035 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:18:06.877308 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-927ff643-8f98-45df-a550-3d2d27dae035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e7ce32b4c0457196c8765d6c5ada7e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:06.884463 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-927ff643-8f98-45df-a550-3d2d27dae035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e7ce32b4c0457196c8765d6c5ada7e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:06.896837 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-927ff643-8f98-45df-a550-3d2d27dae035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e7ce32b4c0457196c8765d6c5ada7e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:06.897479 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-927ff643-8f98-45df-a550-3d2d27dae035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e7ce32b4c0457196c8765d6c5ada7e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:06.904272 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-927ff643-8f98-45df-a550-3d2d27dae035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e7ce32b4c0457196c8765d6c5ada7e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:06.911119 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1441/2881] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:18:06 2022] DELETE /identity/v3/users/f7e7ce32b4c0457196c8765d6c5ada7e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:18:07.090893 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dc509-9f41-4403-923b-2d4e47bd544a service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:18:07.104982 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dc509-9f41-4403-923b-2d4e47bd544a service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:18:07.171463 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f455af-c7f2-4eae-9f57-092d5c93725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:18:07.172890 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f455af-c7f2-4eae-9f57-092d5c93725e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:07.173174 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f455af-c7f2-4eae-9f57-092d5c93725e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:07.173444 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f455af-c7f2-4eae-9f57-092d5c93725e admin admin] PATH_INFO: `/v3/projects/4249e846c5d54876a6ed97678450c1d2` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:07.174735 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f455af-c7f2-4eae-9f57-092d5c93725e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4249e846c5d54876a6ed97678450c1d2)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:18:07.176701 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f455af-c7f2-4eae-9f57-092d5c93725e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:18:07.222681 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-74f455af-c7f2-4eae-9f57-092d5c93725e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4249e846c5d54876a6ed97678450c1d2', 'request_id': 'req-74f455af-c7f2-4eae-9f57-092d5c93725e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:07.230672 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-74f455af-c7f2-4eae-9f57-092d5c93725e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4249e846c5d54876a6ed97678450c1d2', 'request_id': 'req-74f455af-c7f2-4eae-9f57-092d5c93725e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:07.237678 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-74f455af-c7f2-4eae-9f57-092d5c93725e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4249e846c5d54876a6ed97678450c1d2', 'request_id': 'req-74f455af-c7f2-4eae-9f57-092d5c93725e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:07.247707 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-74f455af-c7f2-4eae-9f57-092d5c93725e admin admin] The token cache is being invalidate because project 4249e846c5d54876a6ed97678450c1d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:18:07.248011 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-74f455af-c7f2-4eae-9f57-092d5c93725e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:07.248640 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-74f455af-c7f2-4eae-9f57-092d5c93725e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:07.251017 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1441/2882] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:18:07 2022] DELETE /identity/v3/projects/4249e846c5d54876a6ed97678450c1d2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:18:07.255166 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ff643-8f98-45df-a550-3d2d27dae035 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:18:07.256579 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-927ff643-8f98-45df-a550-3d2d27dae035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:18:07.270416 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ff643-8f98-45df-a550-3d2d27dae035 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:18:07.325084 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77e672-c7a6-4626-be98-b6585869388c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:18:07.325878 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77e672-c7a6-4626-be98-b6585869388c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:07.326160 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77e672-c7a6-4626-be98-b6585869388c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:07.326434 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77e672-c7a6-4626-be98-b6585869388c admin admin] PATH_INFO: `/v3/users/4f4f089afae1451da221130ea9fa80b4` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:07.327595 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77e672-c7a6-4626-be98-b6585869388c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f4f089afae1451da221130ea9fa80b4)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:18:07.329630 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77e672-c7a6-4626-be98-b6585869388c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:18:07.375679 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cf77e672-c7a6-4626-be98-b6585869388c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f4f089afae1451da221130ea9fa80b4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:07.382622 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cf77e672-c7a6-4626-be98-b6585869388c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f4f089afae1451da221130ea9fa80b4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:07.394356 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cf77e672-c7a6-4626-be98-b6585869388c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f4f089afae1451da221130ea9fa80b4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:07.394989 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cf77e672-c7a6-4626-be98-b6585869388c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f4f089afae1451da221130ea9fa80b4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:07.396961 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:07.403320 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cf77e672-c7a6-4626-be98-b6585869388c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f4f089afae1451da221130ea9fa80b4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:07.410259 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1442/2883] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:18:07 2022] DELETE /identity/v3/users/4f4f089afae1451da221130ea9fa80b4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:18:07.580111 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f455af-c7f2-4eae-9f57-092d5c93725e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:18:07.581532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-74f455af-c7f2-4eae-9f57-092d5c93725e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:18:07.595019 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f455af-c7f2-4eae-9f57-092d5c93725e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:18:07.617297 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:07.657404 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59153b5-b645-4a3e-ac4b-b3579d442625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:18:07.658267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59153b5-b645-4a3e-ac4b-b3579d442625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:07.658553 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59153b5-b645-4a3e-ac4b-b3579d442625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:07.658834 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59153b5-b645-4a3e-ac4b-b3579d442625 admin admin] PATH_INFO: `/v3/projects/39d96be72478434bb2cf1fce10c9d48c` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:07.660050 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59153b5-b645-4a3e-ac4b-b3579d442625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d96be72478434bb2cf1fce10c9d48c)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:18:07.662051 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59153b5-b645-4a3e-ac4b-b3579d442625 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:18:07.709154 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a59153b5-b645-4a3e-ac4b-b3579d442625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d96be72478434bb2cf1fce10c9d48c', 'request_id': 'req-a59153b5-b645-4a3e-ac4b-b3579d442625'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:07.715657 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a59153b5-b645-4a3e-ac4b-b3579d442625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d96be72478434bb2cf1fce10c9d48c', 'request_id': 'req-a59153b5-b645-4a3e-ac4b-b3579d442625'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:07.722547 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a59153b5-b645-4a3e-ac4b-b3579d442625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d96be72478434bb2cf1fce10c9d48c', 'request_id': 'req-a59153b5-b645-4a3e-ac4b-b3579d442625'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:07.733354 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a59153b5-b645-4a3e-ac4b-b3579d442625 admin admin] The token cache is being invalidate because project 39d96be72478434bb2cf1fce10c9d48c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:18:07.733644 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a59153b5-b645-4a3e-ac4b-b3579d442625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:07.734378 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a59153b5-b645-4a3e-ac4b-b3579d442625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:18:07.737078 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1442/2884] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:18:07 2022] DELETE /identity/v3/projects/39d96be72478434bb2cf1fce10c9d48c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:18:17.406220 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:17.730266 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:19:36.126057 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77e672-c7a6-4626-be98-b6585869388c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:19:36.128177 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cf77e672-c7a6-4626-be98-b6585869388c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:36.234223 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77e672-c7a6-4626-be98-b6585869388c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:19:36.290627 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9861a-8fa5-4168-b2fa-39e3fc27f79a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:19:36.291296 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9861a-8fa5-4168-b2fa-39e3fc27f79a service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:36.291583 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9861a-8fa5-4168-b2fa-39e3fc27f79a service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:36.291909 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9861a-8fa5-4168-b2fa-39e3fc27f79a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:36.294056 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-96d9861a-8fa5-4168-b2fa-39e3fc27f79a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:36.305412 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9861a-8fa5-4168-b2fa-39e3fc27f79a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:19:36.306983 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9861a-8fa5-4168-b2fa-39e3fc27f79a service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:19:36.315414 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1443/2885] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:19:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:19:36.418609 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59153b5-b645-4a3e-ac4b-b3579d442625 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:19:36.420091 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a59153b5-b645-4a3e-ac4b-b3579d442625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:36.437359 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59153b5-b645-4a3e-ac4b-b3579d442625 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:19:36.443325 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24156fda-2f65-4588-9bf2-f410ee68e0a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:19:36.444022 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24156fda-2f65-4588-9bf2-f410ee68e0a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:36.444309 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24156fda-2f65-4588-9bf2-f410ee68e0a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:36.444614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24156fda-2f65-4588-9bf2-f410ee68e0a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:36.446448 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-24156fda-2f65-4588-9bf2-f410ee68e0a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:36.456819 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24156fda-2f65-4588-9bf2-f410ee68e0a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:19:36.458263 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24156fda-2f65-4588-9bf2-f410ee68e0a7 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:19:36.466650 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1443/2886] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:19:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:19:36.569024 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9861a-8fa5-4168-b2fa-39e3fc27f79a service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:19:36.570954 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-96d9861a-8fa5-4168-b2fa-39e3fc27f79a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:36.581390 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9861a-8fa5-4168-b2fa-39e3fc27f79a service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:19:36.585253 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afa72f-629b-4ac8-8f6d-5b0d0795adf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7bc0d4fd924bfb89f874d1c6fc3d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:19:36.585901 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afa72f-629b-4ac8-8f6d-5b0d0795adf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:36.586188 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afa72f-629b-4ac8-8f6d-5b0d0795adf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:36.586467 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afa72f-629b-4ac8-8f6d-5b0d0795adf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:36.589158 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-76afa72f-629b-4ac8-8f6d-5b0d0795adf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:36.656342 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:19:36.700742 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afa72f-629b-4ac8-8f6d-5b0d0795adf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:19:36.702175 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afa72f-629b-4ac8-8f6d-5b0d0795adf6 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:19:36.722962 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1444/2887] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:19:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:19:36.782070 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24156fda-2f65-4588-9bf2-f410ee68e0a7 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:19:36.784116 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-24156fda-2f65-4588-9bf2-f410ee68e0a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:36.852479 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24156fda-2f65-4588-9bf2-f410ee68e0a7 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:19:36.857366 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf6aca-a92c-4b2a-8824-5ade41c75d01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b43eb1a0ac4db5adee3512453459aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:19:36.858010 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf6aca-a92c-4b2a-8824-5ade41c75d01 service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:36.858295 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf6aca-a92c-4b2a-8824-5ade41c75d01 service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:36.858570 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf6aca-a92c-4b2a-8824-5ade41c75d01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:36.860350 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9cdf6aca-a92c-4b2a-8824-5ade41c75d01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:36.871582 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf6aca-a92c-4b2a-8824-5ade41c75d01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:19:36.873211 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf6aca-a92c-4b2a-8824-5ade41c75d01 service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:19:36.883084 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1444/2888] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:19:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:19:40.151541 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afa72f-629b-4ac8-8f6d-5b0d0795adf6 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:19:40.153030 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-76afa72f-629b-4ac8-8f6d-5b0d0795adf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:40.168496 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afa72f-629b-4ac8-8f6d-5b0d0795adf6 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:19:40.174058 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c65023-0bf6-4c7f-bf78-8afdb8e4bc55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3820a613744c15b840681fe6b6e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:19:40.175483 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c65023-0bf6-4c7f-bf78-8afdb8e4bc55 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:40.175784 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c65023-0bf6-4c7f-bf78-8afdb8e4bc55 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:40.176118 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c65023-0bf6-4c7f-bf78-8afdb8e4bc55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:40.177935 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-74c65023-0bf6-4c7f-bf78-8afdb8e4bc55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:40.190274 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c65023-0bf6-4c7f-bf78-8afdb8e4bc55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:19:40.191941 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c65023-0bf6-4c7f-bf78-8afdb8e4bc55 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:19:40.202656 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1445/2889] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:19:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:19:46.879532 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=40 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:19:50.198093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=29 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:20:53.343469 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf6aca-a92c-4b2a-8824-5ade41c75d01 service placement] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:53.344949 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9cdf6aca-a92c-4b2a-8824-5ade41c75d01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:53.380603 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf6aca-a92c-4b2a-8824-5ade41c75d01 service placement] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:53.385618 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f33c4-fd36-4ffc-8955-642bad62dcb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b43eb1a0ac4db5adee3512453459aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:53.386261 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f33c4-fd36-4ffc-8955-642bad62dcb2 service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:53.386551 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f33c4-fd36-4ffc-8955-642bad62dcb2 service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:53.386832 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f33c4-fd36-4ffc-8955-642bad62dcb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:53.388623 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9d0f33c4-fd36-4ffc-8955-642bad62dcb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:53.400005 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f33c4-fd36-4ffc-8955-642bad62dcb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:53.401667 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f33c4-fd36-4ffc-8955-642bad62dcb2 service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:53.412476 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1445/2890] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:20:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:21:03.407256 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=15 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:10.566219 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c65023-0bf6-4c7f-bf78-8afdb8e4bc55 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:10.577743 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c65023-0bf6-4c7f-bf78-8afdb8e4bc55 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:10.582932 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d02b55-fb0e-48f6-992c-237580c7cb1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b43eb1a0ac4db5adee3512453459aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:10.583585 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d02b55-fb0e-48f6-992c-237580c7cb1e service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:10.583895 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d02b55-fb0e-48f6-992c-237580c7cb1e service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:10.584185 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d02b55-fb0e-48f6-992c-237580c7cb1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:10.585975 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-83d02b55-fb0e-48f6-992c-237580c7cb1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:10.598891 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d02b55-fb0e-48f6-992c-237580c7cb1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:10.600654 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d02b55-fb0e-48f6-992c-237580c7cb1e service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:10.611698 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1446/2891] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:21:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:21:13.475124 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f33c4-fd36-4ffc-8955-642bad62dcb2 service placement] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:13.496937 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f33c4-fd36-4ffc-8955-642bad62dcb2 service placement] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:13.504434 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2831538-6b76-4c55-b18f-f6b859b05e57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b43eb1a0ac4db5adee3512453459aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:13.505725 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2831538-6b76-4c55-b18f-f6b859b05e57 service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:13.506336 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2831538-6b76-4c55-b18f-f6b859b05e57 service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:13.506987 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2831538-6b76-4c55-b18f-f6b859b05e57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:13.509258 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a2831538-6b76-4c55-b18f-f6b859b05e57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:13.524265 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2831538-6b76-4c55-b18f-f6b859b05e57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:13.526168 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2831538-6b76-4c55-b18f-f6b859b05e57 service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:13.540876 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1446/2892] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:21:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:21:13.549484 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d02b55-fb0e-48f6-992c-237580c7cb1e service placement] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:13.552530 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-83d02b55-fb0e-48f6-992c-237580c7cb1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:13.659678 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d02b55-fb0e-48f6-992c-237580c7cb1e service placement] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:13.664338 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a3b16-ae38-4248-a889-399e6b34a1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:13.665243 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a3b16-ae38-4248-a889-399e6b34a1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:13.665539 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a3b16-ae38-4248-a889-399e6b34a1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:13.665822 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a3b16-ae38-4248-a889-399e6b34a1fe admin admin] PATH_INFO: `/v3/users/0eb80aad1ad74eb4b0a28b1e686ecfab` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:13.667151 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a3b16-ae38-4248-a889-399e6b34a1fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eb80aad1ad74eb4b0a28b1e686ecfab)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:13.669117 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a3b16-ae38-4248-a889-399e6b34a1fe admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:13.715315 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f45a3b16-ae38-4248-a889-399e6b34a1fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eb80aad1ad74eb4b0a28b1e686ecfab'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:13.722963 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f45a3b16-ae38-4248-a889-399e6b34a1fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eb80aad1ad74eb4b0a28b1e686ecfab'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:13.735452 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f45a3b16-ae38-4248-a889-399e6b34a1fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eb80aad1ad74eb4b0a28b1e686ecfab'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:13.736141 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f45a3b16-ae38-4248-a889-399e6b34a1fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eb80aad1ad74eb4b0a28b1e686ecfab'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:13.743713 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f45a3b16-ae38-4248-a889-399e6b34a1fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eb80aad1ad74eb4b0a28b1e686ecfab'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:13.749833 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1447/2893] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:21:13 2022] DELETE /identity/v3/users/0eb80aad1ad74eb4b0a28b1e686ecfab => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:21:13.924716 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2831538-6b76-4c55-b18f-f6b859b05e57 service placement] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:13.937156 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2831538-6b76-4c55-b18f-f6b859b05e57 service placement] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:13.997637 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e144d-a87f-43f2-80db-bbc36925b902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:13.998510 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e144d-a87f-43f2-80db-bbc36925b902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:13.998793 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e144d-a87f-43f2-80db-bbc36925b902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:13.999069 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e144d-a87f-43f2-80db-bbc36925b902 admin admin] PATH_INFO: `/v3/projects/cc29531ccae24475ab6b50e2cc2e5d48` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:14.000280 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e144d-a87f-43f2-80db-bbc36925b902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc29531ccae24475ab6b50e2cc2e5d48)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:14.002879 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e144d-a87f-43f2-80db-bbc36925b902 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:14.050702 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cd6e144d-a87f-43f2-80db-bbc36925b902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc29531ccae24475ab6b50e2cc2e5d48', 'request_id': 'req-cd6e144d-a87f-43f2-80db-bbc36925b902'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:14.058657 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cd6e144d-a87f-43f2-80db-bbc36925b902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc29531ccae24475ab6b50e2cc2e5d48', 'request_id': 'req-cd6e144d-a87f-43f2-80db-bbc36925b902'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:14.065784 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cd6e144d-a87f-43f2-80db-bbc36925b902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc29531ccae24475ab6b50e2cc2e5d48', 'request_id': 'req-cd6e144d-a87f-43f2-80db-bbc36925b902'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:14.076267 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cd6e144d-a87f-43f2-80db-bbc36925b902 admin admin] The token cache is being invalidate because project cc29531ccae24475ab6b50e2cc2e5d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:21:14.076560 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cd6e144d-a87f-43f2-80db-bbc36925b902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:14.077206 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cd6e144d-a87f-43f2-80db-bbc36925b902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:14.078748 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1447/2894] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:21:13 2022] DELETE /identity/v3/projects/cc29531ccae24475ab6b50e2cc2e5d48 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:21:14.083263 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a3b16-ae38-4248-a889-399e6b34a1fe admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:14.084709 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f45a3b16-ae38-4248-a889-399e6b34a1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:14.098707 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a3b16-ae38-4248-a889-399e6b34a1fe admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:14.132078 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:14.157488 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c94865-f772-4f0e-b72e-1a6b54d8c772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:14.158385 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c94865-f772-4f0e-b72e-1a6b54d8c772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:14.158676 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c94865-f772-4f0e-b72e-1a6b54d8c772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:14.159093 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c94865-f772-4f0e-b72e-1a6b54d8c772 admin admin] PATH_INFO: `/v3/users/49f1140d1d984efe95beba4605ce86b2` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:14.160449 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c94865-f772-4f0e-b72e-1a6b54d8c772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49f1140d1d984efe95beba4605ce86b2)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:14.162429 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c94865-f772-4f0e-b72e-1a6b54d8c772 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:14.208596 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-80c94865-f772-4f0e-b72e-1a6b54d8c772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49f1140d1d984efe95beba4605ce86b2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:14.215476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-80c94865-f772-4f0e-b72e-1a6b54d8c772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49f1140d1d984efe95beba4605ce86b2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:14.228199 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-80c94865-f772-4f0e-b72e-1a6b54d8c772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49f1140d1d984efe95beba4605ce86b2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:14.228840 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-80c94865-f772-4f0e-b72e-1a6b54d8c772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49f1140d1d984efe95beba4605ce86b2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:14.235540 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-80c94865-f772-4f0e-b72e-1a6b54d8c772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49f1140d1d984efe95beba4605ce86b2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:14.241428 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1448/2895] 10.222.0.41 () {58 vars in 1223 bytes} [Mon May 30 12:21:14 2022] DELETE /identity/v3/users/49f1140d1d984efe95beba4605ce86b2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:21:14.414720 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e144d-a87f-43f2-80db-bbc36925b902 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:14.416195 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cd6e144d-a87f-43f2-80db-bbc36925b902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:14.429698 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e144d-a87f-43f2-80db-bbc36925b902 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:14.486388 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24356b-745d-4e4f-acc3-9cde6f7ac5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a1c89e7dfbe47f0b169c936907738b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93674931dbb347aea1d901cb89aa3b24', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:14.487865 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24356b-745d-4e4f-acc3-9cde6f7ac5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:14.488155 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24356b-745d-4e4f-acc3-9cde6f7ac5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:14.488430 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24356b-745d-4e4f-acc3-9cde6f7ac5c5 admin admin] PATH_INFO: `/v3/projects/a1cef9963ab3434ca9bbeaf07d3f8b6a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:14.489614 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24356b-745d-4e4f-acc3-9cde6f7ac5c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1cef9963ab3434ca9bbeaf07d3f8b6a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:14.491518 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24356b-745d-4e4f-acc3-9cde6f7ac5c5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:14.512851 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:14.539491 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4e24356b-745d-4e4f-acc3-9cde6f7ac5c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1cef9963ab3434ca9bbeaf07d3f8b6a', 'request_id': 'req-4e24356b-745d-4e4f-acc3-9cde6f7ac5c5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:14.546623 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4e24356b-745d-4e4f-acc3-9cde6f7ac5c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1cef9963ab3434ca9bbeaf07d3f8b6a', 'request_id': 'req-4e24356b-745d-4e4f-acc3-9cde6f7ac5c5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:14.553453 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4e24356b-745d-4e4f-acc3-9cde6f7ac5c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1cef9963ab3434ca9bbeaf07d3f8b6a', 'request_id': 'req-4e24356b-745d-4e4f-acc3-9cde6f7ac5c5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:14.563715 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4e24356b-745d-4e4f-acc3-9cde6f7ac5c5 admin admin] The token cache is being invalidate because project a1cef9963ab3434ca9bbeaf07d3f8b6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:21:14.564032 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4e24356b-745d-4e4f-acc3-9cde6f7ac5c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:14.565530 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4e24356b-745d-4e4f-acc3-9cde6f7ac5c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:21:14.567141 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1448/2896] 10.222.0.41 () {58 vars in 1232 bytes} [Mon May 30 12:21:14 2022] DELETE /identity/v3/projects/a1cef9963ab3434ca9bbeaf07d3f8b6a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:21:24.238033 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=36,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:24.560752 dv-cinder-839793-13-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:58.363032 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c94865-f772-4f0e-b72e-1a6b54d8c772 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:58.364473 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-80c94865-f772-4f0e-b72e-1a6b54d8c772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:58.434694 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c94865-f772-4f0e-b72e-1a6b54d8c772 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:58.495476 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff27e8e-fc1c-4632-8ac0-5fd1611cf7e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48b43eb1a0ac4db5adee3512453459aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e8426fd0e01433b8aa3a3797c687e03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:58.496169 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff27e8e-fc1c-4632-8ac0-5fd1611cf7e5 service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:58.496458 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff27e8e-fc1c-4632-8ac0-5fd1611cf7e5 service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:58.496738 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff27e8e-fc1c-4632-8ac0-5fd1611cf7e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:58.498530 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6ff27e8e-fc1c-4632-8ac0-5fd1611cf7e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:58.510448 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff27e8e-fc1c-4632-8ac0-5fd1611cf7e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:58.512068 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff27e8e-fc1c-4632-8ac0-5fd1611cf7e5 service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:58.522139 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1449/2897] 10.222.0.41 () {60 vars in 1365 bytes} [Mon May 30 12:25:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:26:08.517702 dv-cinder-839793-13-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=58 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}